ci-cri-containerd-e2e-cos-gce-reboot #1619679341552078848
Recent runs || View in Spyglass
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sdropping\sall\sinbound\spackets\sfor\sa\swhile\sand\sensure\sthey\sfunction\safterwards$'
[FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:05.378 There were additional failures detected after the initial failure. These are visible in the timelinefrom ginkgo_report.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:10:35.258 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:10:35.258 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:10:35.258 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:10:35.258 Jan 29 13:10:35.258: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:10:35.26 Jan 29 13:10:35.299: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:37.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:39.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:41.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:43.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:45.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:47.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:49.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:51.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:53.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:55.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:57.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:59.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:01.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:03.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.378: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.378: INFO: Unexpected error: <*errors.errorString | 0xc0000d1ca0>: { s: "timed out waiting for the condition", } [FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:05.378 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:05.378 (30.12s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:05.378 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:11:05.378 Jan 29 13:11:05.418: INFO: Unexpected error: <*url.Error | 0xc0024e34d0>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc003d1e640>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc003f75680>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc001464600>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:11:05.418 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:05.418 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:05.418 Jan 29 13:11:05.418: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:05.457 (39ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:05.457 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:05.457 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:05.457 (0s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:05.457 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:05.457 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:05.457 (0s) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:05.457 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:05.458 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sdropping\sall\sinbound\spackets\sfor\sa\swhile\sand\sensure\sthey\sfunction\safterwards$'
[FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:05.378 There were additional failures detected after the initial failure. These are visible in the timelinefrom junit_01.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:10:35.258 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:10:35.258 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:10:35.258 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:10:35.258 Jan 29 13:10:35.258: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:10:35.26 Jan 29 13:10:35.299: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:37.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:39.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:41.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:43.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:45.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:47.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:49.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:51.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:53.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:55.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:57.340: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:59.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:01.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:03.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.339: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.378: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:05.378: INFO: Unexpected error: <*errors.errorString | 0xc0000d1ca0>: { s: "timed out waiting for the condition", } [FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:05.378 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:05.378 (30.12s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:05.378 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:11:05.378 Jan 29 13:11:05.418: INFO: Unexpected error: <*url.Error | 0xc0024e34d0>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc003d1e640>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc003f75680>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc001464600>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:11:05.418 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:05.418 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:05.418 Jan 29 13:11:05.418: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:05.457 (39ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:05.457 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:05.457 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:05.457 (0s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:05.457 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:05.457 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:05.457 (0s) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:05.457 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:05.458 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sordering\sclean\sreboot\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:02:40.346from ginkgo_report.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:00:28.981 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:00:28.981 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:00:28.981 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:00:28.982 Jan 29 13:00:28.982: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:00:28.983 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 13:00:29.107 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 13:00:29.187 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:00:29.267 (285ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:00:29.267 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:00:29.267 (0s) > Enter [It] each node by ordering clean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:97 @ 01/29/23 13:00:29.267 Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:00:29.476: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:29.476: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.530: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 53.110523ms Jan 29 13:00:29.530: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.531: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 54.551405ms Jan 29 13:00:29.531: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 53.956851ms Jan 29 13:00:29.531: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.531: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 54.932798ms Jan 29 13:00:29.531: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:29.531: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 55.41914ms Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 55.046989ms Jan 29 13:00:29.533: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.532: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=false. Elapsed: 55.525974ms Jan 29 13:00:29.533: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-f6wf' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:29.533: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 55.405142ms Jan 29 13:00:29.533: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.533: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.533: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 13:00:29.533: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 13:00:30.072: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 13:00:30.115: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:31.575: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 2.098038259s Jan 29 13:00:31.575: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 2.098139891s Jan 29 13:00:31.576: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 2.098724052s Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:00:32.158: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:33.574: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 4.096975326s Jan 29 13:00:33.574: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 4.09792965s Jan 29 13:00:33.574: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:00:33.575: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:33.575: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 13:00:33.575: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:33.575: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 13:00:34.106: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 13:00:34.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:34.205: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:35.573: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 6.096946215s Jan 29 13:00:35.574: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:36.214: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:36.248: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:37.573: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 8.09643444s Jan 29 13:00:37.573: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:38.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:38.290: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:39.574: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 10.097478286s Jan 29 13:00:39.574: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 13:00:39.574: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:39.574: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 13:00:39.574: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 13:00:40.112: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 13:00:40.153: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:40.299: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:40.333: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.197: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.375: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.239: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.385: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.418: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.282: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.428: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.460: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.325: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.471: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.504: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.368: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.513: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.547: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.411: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.556: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.589: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.454: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.600: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.633: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.651: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.675: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.657: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.783: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.821: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.826: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.864: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.744: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.870: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.929: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.794: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.914: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.972: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:06.840: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:06.960: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:07.019: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:08.884: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:09.005: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:09.081: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:10.928: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:11.047: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:11.125: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:12.968: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:13.089: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:13.168: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:15.008: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:15.129: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:15.207: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:17.047: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:17.169: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:17.247: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:19.087: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:19.209: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:19.287: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:21.127: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:21.249: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:21.328: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:23.168: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:23.289: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:23.368: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:25.207: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:25.329: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:25.408: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:27.247: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:27.369: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:27.449: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:29.287: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:29.409: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:29.490: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:31.327: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:31.449: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:31.531: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:33.368: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:33.490: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:33.571: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:35.410: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:35.531: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:35.611: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:37.451: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:37.571: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:37.652: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:39.492: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:39.612: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:39.692: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:41.533: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:41.652: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:41.733: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:43.573: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:43.692: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:43.773: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:45.613: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:45.732: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:45.814: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:47.655: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:47.773: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:47.855: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:49.695: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:49.813: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:49.895: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:51.736: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:51.853: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:51.936: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:53.776: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:53.894: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:53.976: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:55.817: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:55.934: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:56.016: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:57.858: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:57.975: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:58.056: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:59.898: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:00.018: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:00.096: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:01.939: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:02.059: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:02.138: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:03.980: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:04.099: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:04.178: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:06.021: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:06.139: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:06.218: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:08.062: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:08.180: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:08.258: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:10.102: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:10.221: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:10.299: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:12.143: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:12.261: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:12.339: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:17.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:17.911: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:17.911: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.943: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.956: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.956: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:21.989: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:22.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:22.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.032: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.046: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.046: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.076: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.119: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:30.137: INFO: Node bootstrap-e2e-minion-group-ct19 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:30.170: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:30.184: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:32.214: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:32.228: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:34.229: INFO: Node bootstrap-e2e-minion-group-cws9 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:34.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:36.302: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:38.345: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:40.345: INFO: Node bootstrap-e2e-minion-group-f6wf didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-ct19 failed reboot test. Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-cws9 failed reboot test. Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-f6wf failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:02:40.346 < Exit [It] each node by ordering clean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:97 @ 01/29/23 13:02:40.346 (2m11.079s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:02:40.346 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:02:40.346 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-ffllt to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.720961531s (1.72098729s including waiting) Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-qhqpd to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.418759668s (1.418773861s including waiting) Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "http://10.64.1.3:8181/ready": dial tcp 10.64.1.3:8181: connect: connection refused Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "config-volume" : object "kube-system"/"coredns" not registered Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f: {replicaset-controller } FailedCreate: Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-ffllt Jan 29 13:02:40.403: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-qhqpd Jan 29 13:02:40.403: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 1 Jan 29 13:02:40.403: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 2 from 1 Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_7982b became leader Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_cb5e8 became leader Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_50fad became leader Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-6hmkl to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.423530478s (1.423541743s including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-rptqg to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 653.623539ms (653.637202ms including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-w22sq to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.058743675s (1.058777973s including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-6hmkl Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-w22sq Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-rptqg Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6" already present on machine Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Readiness probe failed: Get "https://127.0.0.1:443/readyz": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-apiserver Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Liveness probe failed: Get "https://127.0.0.1:443/livez?exclude=etcd&exclude=kms-provider-0&exclude=kms-provider-1": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-controller-manager Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-controller-manager Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-controller-manager in pod kube-controller-manager-bootstrap-e2e-master_kube-system(a9901ac1fc908c01cd17c25062859343) Jan 29 13:02:40.403: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_71d2bb23-05b2-4ff0-abb2-d62d30500b82 became leader Jan 29 13:02:40.403: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_9be65189-f395-43ec-8127-df007406fb1b became leader Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } Scheduled: Successfully assigned kube-system/kube-dns-autoscaler-5f6455f985-j7ht7 to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" in 1.617088921s (1.617098535s including waiting) Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" already present on machine Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-" is forbidden: error looking up service account kube-system/kube-dns-autoscaler: serviceaccount "kube-dns-autoscaler" not found Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } SuccessfulCreate: Created pod: kube-dns-autoscaler-5f6455f985-j7ht7 Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler: {deployment-controller } ScalingReplicaSet: Scaled up replica set kube-dns-autoscaler-5f6455f985 to 1 Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-cws9_kube-system(16bcfdb33a89c2f030450814ec3fe739) Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-scheduler in pod kube-scheduler-bootstrap-e2e-master_kube-system(b286b0d19b475d76fb3eba5bf7889986) Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_e3e642b1-3c7d-4170-854d-206e3a5570f0 became leader Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_86ac1391-6ab5-43be-a725-fd2ce30379f7 became leader Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_63f7c13b-3d96-4b28-be84-6ca74aeeac0f became leader Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } Scheduled: Successfully assigned kube-system/l7-default-backend-8549d69d99-wk944 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" in 1.216619885s (1.216627078s including waiting) Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" already present on machine Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/l7-default-backend-8549d69d99-wk944 Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99: {replicaset-controller } SuccessfulCreate: Created pod: l7-default-backend-8549d69d99-wk944 Jan 29 13:02:40.404: INFO: event for l7-default-backend: {deployment-controller } ScalingReplicaSet: Scaled up replica set l7-default-backend-8549d69d99 to 1 Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1" already present on machine Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container l7-lb-controller in pod l7-lb-controller-bootstrap-e2e-master_kube-system(f922c87738da4b787ed79e8be7ae0573) Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-5cfjp to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 803.71872ms (803.737128ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.686824679s (1.68683837s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-mfrhp to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 732.917974ms (732.927763ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.939728202s (2.939751821s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-qkvrv to bootstrap-e2e-master Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 982.356767ms (982.364932ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.852484558s (1.852526362s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-rsxdm to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 773.200901ms (773.212801ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.956595063s (1.956613123s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-qkvrv Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-5cfjp Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-mfrhp Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-rsxdm Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-6764bf875c-ll7k6 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 2.537965673s (2.537975481s including waiting) Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 2.961132536s (2.961140218s including waiting) Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: Get "https://10.64.2.7:10250/readyz": dial tcp 10.64.2.7:10250: connect: connection refused Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulDelete: Deleted pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-867b8754b9-gl5gs to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 1.725742909s (1.725762024s including waiting) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 965.045186ms (965.056623ms including waiting) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": dial tcp 10.64.1.4:10250: connect: connection refused Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.4:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.5:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "metrics-server-config-volume" : object "kube-system"/"metrics-server-config" not registered Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.8:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.8:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-867b8754b9-gl5gs Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-6764bf875c to 1 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-867b8754b9 to 1 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled down replica set metrics-server-v0.5.2-6764bf875c to 0 from 1 Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } Scheduled: Successfully assigned kube-system/volume-snapshot-controller-0 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" in 2.27992334s (2.279930738s including waiting) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/volume-snapshot-controller-0 Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller: {statefulset-controller } SuccessfulCreate: create Pod volume-snapshot-controller-0 in StatefulSet volume-snapshot-controller successful < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:02:40.405 (59ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:02:40.405 Jan 29 13:02:40.405: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:02:40.454 (49ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:02:40.454 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:02:40.454 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:02:40.454 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:02:40.455 STEP: Collecting events from namespace "reboot-3740". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:02:40.455 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 13:02:40.497 Jan 29 13:02:40.543: INFO: POD NODE PHASE GRACE CONDITIONS Jan 29 13:02:40.543: INFO: Jan 29 13:02:40.595: INFO: Logging node info for node bootstrap-e2e-master Jan 29 13:02:40.638: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 8e1b3b00-0184-4954-a6b8-395bd0b41aaa 1340 0 2023-01-29 12:55:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:56:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 13:02:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858370560 0} {<nil>} 3767940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596226560 0} {<nil>} 3511940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:56:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.145.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:52758f7247e2e803f500fb807091093a,SystemUUID:52758f72-47e2-e803-f500-fb807091093a,BootID:aa737e34-48fe-4c27-ab0d-8516bcd13e33,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:135952851,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:125275449,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:57552184,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.640: INFO: Logging kubelet events for node bootstrap-e2e-master Jan 29 13:02:40.686: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jan 29 13:02:40.730: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Jan 29 13:02:40.730: INFO: Logging node info for node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.773: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-ct19 f4d8d037-c618-4a0b-805c-3939ff7d9269 1350 0 2023-01-29 12:56:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-ct19 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:56:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status} {node-problem-detector Update v1 2023-01-29 13:02:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-ct19,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:59:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.193.65,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c09e7c28f8d7857f29cb4179c2f98be7,SystemUUID:c09e7c28-f8d7-857f-29cb-4179c2f98be7,BootID:b3323607-88f0-4ec2-b469-f4fa57b9d5c7,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.774: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.819: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.864: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-ct19: error trying to reach service: No agent available Jan 29 13:02:40.864: INFO: Logging node info for node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.909: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-cws9 975cbf5d-1092-4142-b7a6-525e693a3596 1164 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-cws9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-cws9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.233.152.110,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38e91f781481e79e6df55f28f4c94137,SystemUUID:38e91f78-1481-e79e-6df5-5f28f4c94137,BootID:73270c8a-15fd-4f7b-837c-5c9d3cee5808,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.910: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.967: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:41.033: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-cws9: error trying to reach service: No agent available Jan 29 13:02:41.033: INFO: Logging node info for node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.077: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f6wf 00e5297f-551b-409a-9b31-4d98cdcfa0a7 1182 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f6wf kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-f6wf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.79.46,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:13420fb7de7e4ce4474f14dd79c7f5bf,SystemUUID:13420fb7-de7e-4ce4-474f-14dd79c7f5bf,BootID:6f6ab58d-72b2-4a3a-8d22-d00bd1cb98b9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:41.079: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.124: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.168: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-f6wf: error trying to reach service: No agent available END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:02:41.168 (713ms) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:02:41.168 (713ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:02:41.168 STEP: Destroying namespace "reboot-3740" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:02:41.168 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:02:41.213 (45ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:02:41.214 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:02:41.214 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sordering\sclean\sreboot\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:02:40.346from junit_01.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:00:28.981 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:00:28.981 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:00:28.981 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:00:28.982 Jan 29 13:00:28.982: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:00:28.983 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 13:00:29.107 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 13:00:29.187 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:00:29.267 (285ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:00:29.267 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:00:29.267 (0s) > Enter [It] each node by ordering clean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:97 @ 01/29/23 13:00:29.267 Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 13:00:29.360: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:00:29.433: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:00:29.476: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:29.476: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.477: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:00:29.530: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 53.110523ms Jan 29 13:00:29.530: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.531: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 54.551405ms Jan 29 13:00:29.531: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 53.956851ms Jan 29 13:00:29.531: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.531: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 54.932798ms Jan 29 13:00:29.531: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:29.531: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 55.41914ms Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.532: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 55.046989ms Jan 29 13:00:29.533: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.532: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=false. Elapsed: 55.525974ms Jan 29 13:00:29.533: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-f6wf' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:29.533: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 55.405142ms Jan 29 13:00:29.533: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:00:29.533: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:00:29.533: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 13:00:29.533: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 13:00:30.072: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 13:00:30.072: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 13:00:30.115: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:31.575: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 2.098038259s Jan 29 13:00:31.575: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 2.098139891s Jan 29 13:00:31.576: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:15 +0000 UTC ContainersNotReady containers with unready status: [kube-proxy]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 2.098724052s Jan 29 13:00:31.576: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:00:32.158: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:33.574: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 4.096975326s Jan 29 13:00:33.574: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 4.09792965s Jan 29 13:00:33.574: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:00:33.575: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-cws9 metadata-proxy-v0.1-5cfjp] Jan 29 13:00:33.575: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 13:00:33.575: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:33.575: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 13:00:34.106: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 13:00:34.106: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 13:00:34.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:34.205: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:35.573: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 6.096946215s Jan 29 13:00:35.574: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:36.214: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:36.248: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:37.573: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=false. Elapsed: 8.09643444s Jan 29 13:00:37.573: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:20 +0000 UTC ContainersNotReady containers with unready status: [volume-snapshot-controller]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:56:16 +0000 UTC }] Jan 29 13:00:38.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:38.290: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:39.574: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 10.097478286s Jan 29 13:00:39.574: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 13:00:39.574: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:00:39.574: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 13:00:39.574: INFO: SSH "nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'sleep 10 && sudo reboot' >/dev/null 2>&1 & Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 13:00:40.112: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 13:00:40.112: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 13:00:40.153: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:40.299: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:40.333: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.197: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:42.375: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.239: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.385: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:44.418: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.282: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.428: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:46.460: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.325: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.471: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:48.504: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.368: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.513: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:50.547: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.411: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.556: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:52.589: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.454: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.600: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:54.633: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.651: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:56.675: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.657: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.783: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:58.821: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.826: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:00.864: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.744: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.870: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:02.929: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.794: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.914: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:04.972: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:06.840: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:06.960: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:07.019: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:08.884: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:09.005: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:09.081: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:10.928: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:11.047: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:11.125: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:01:12.968: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:13.089: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:13.168: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:15.008: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:15.129: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:15.207: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:17.047: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:17.169: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:17.247: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:19.087: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:19.209: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:19.287: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:21.127: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:21.249: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:21.328: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:23.168: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:23.289: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:23.368: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:25.207: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:25.329: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:25.408: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:27.247: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:27.369: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:27.449: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:29.287: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:29.409: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:29.490: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:31.327: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:31.449: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:31.531: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:33.368: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:33.490: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:33.571: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:35.410: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:35.531: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:35.611: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:37.451: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:37.571: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:37.652: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:39.492: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:39.612: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:39.692: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:41.533: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:41.652: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:41.733: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:43.573: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:43.692: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:43.773: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:45.613: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:45.732: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:45.814: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:47.655: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:47.773: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:47.855: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:49.695: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:49.813: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:49.895: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:51.736: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:51.853: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:51.936: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:53.776: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:53.894: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:53.976: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:55.817: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:55.934: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:56.016: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:57.858: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:01:57.975: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:01:58.056: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:01:59.898: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:00.018: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:00.096: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:01.939: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:02.059: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:02.138: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:03.980: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:04.099: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:04.178: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:06.021: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:06.139: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:06.218: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:08.062: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:08.180: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:08.258: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:10.102: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:10.221: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:10.299: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:12.143: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:12.261: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:12.339: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:17.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:17.911: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:17.911: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.943: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.956: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:19.956: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:21.989: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:22.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:22.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.032: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.046: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:24.046: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.076: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:26.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.119: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:28.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:30.137: INFO: Node bootstrap-e2e-minion-group-ct19 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:30.170: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:30.184: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:32.214: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:32.228: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:34.229: INFO: Node bootstrap-e2e-minion-group-cws9 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:34.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:36.302: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:38.345: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:02:40.345: INFO: Node bootstrap-e2e-minion-group-f6wf didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-ct19 failed reboot test. Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-cws9 failed reboot test. Jan 29 13:02:40.346: INFO: Node bootstrap-e2e-minion-group-f6wf failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:02:40.346 < Exit [It] each node by ordering clean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:97 @ 01/29/23 13:02:40.346 (2m11.079s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:02:40.346 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:02:40.346 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-ffllt to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.720961531s (1.72098729s including waiting) Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-qhqpd to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.418759668s (1.418773861s including waiting) Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "http://10.64.1.3:8181/ready": dial tcp 10.64.1.3:8181: connect: connection refused Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "config-volume" : object "kube-system"/"coredns" not registered Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f: {replicaset-controller } FailedCreate: Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Jan 29 13:02:40.402: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-ffllt Jan 29 13:02:40.403: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-qhqpd Jan 29 13:02:40.403: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 1 Jan 29 13:02:40.403: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 2 from 1 Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_7982b became leader Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_cb5e8 became leader Jan 29 13:02:40.403: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_50fad became leader Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-6hmkl to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.423530478s (1.423541743s including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.403: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-rptqg to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 653.623539ms (653.637202ms including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-w22sq to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.058743675s (1.058777973s including waiting) Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-6hmkl Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-w22sq Jan 29 13:02:40.403: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-rptqg Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-addon-manager Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6" already present on machine Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Readiness probe failed: Get "https://127.0.0.1:443/readyz": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-apiserver Jan 29 13:02:40.403: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Liveness probe failed: Get "https://127.0.0.1:443/livez?exclude=etcd&exclude=kms-provider-0&exclude=kms-provider-1": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-controller-manager Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-controller-manager Jan 29 13:02:40.403: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-controller-manager in pod kube-controller-manager-bootstrap-e2e-master_kube-system(a9901ac1fc908c01cd17c25062859343) Jan 29 13:02:40.403: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_71d2bb23-05b2-4ff0-abb2-d62d30500b82 became leader Jan 29 13:02:40.403: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_9be65189-f395-43ec-8127-df007406fb1b became leader Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } Scheduled: Successfully assigned kube-system/kube-dns-autoscaler-5f6455f985-j7ht7 to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" in 1.617088921s (1.617098535s including waiting) Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" already present on machine Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-" is forbidden: error looking up service account kube-system/kube-dns-autoscaler: serviceaccount "kube-dns-autoscaler" not found Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } SuccessfulCreate: Created pod: kube-dns-autoscaler-5f6455f985-j7ht7 Jan 29 13:02:40.403: INFO: event for kube-dns-autoscaler: {deployment-controller } ScalingReplicaSet: Scaled up replica set kube-dns-autoscaler-5f6455f985 to 1 Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-cws9_kube-system(16bcfdb33a89c2f030450814ec3fe739) Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:02:40.403: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:02:40.404: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-scheduler Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-scheduler in pod kube-scheduler-bootstrap-e2e-master_kube-system(b286b0d19b475d76fb3eba5bf7889986) Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_e3e642b1-3c7d-4170-854d-206e3a5570f0 became leader Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_86ac1391-6ab5-43be-a725-fd2ce30379f7 became leader Jan 29 13:02:40.404: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_63f7c13b-3d96-4b28-be84-6ca74aeeac0f became leader Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: { } Scheduled: Successfully assigned kube-system/l7-default-backend-8549d69d99-wk944 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" in 1.216619885s (1.216627078s including waiting) Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" already present on machine Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/l7-default-backend-8549d69d99-wk944 Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:02:40.404: INFO: event for l7-default-backend-8549d69d99: {replicaset-controller } SuccessfulCreate: Created pod: l7-default-backend-8549d69d99-wk944 Jan 29 13:02:40.404: INFO: event for l7-default-backend: {deployment-controller } ScalingReplicaSet: Scaled up replica set l7-default-backend-8549d69d99 to 1 Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1" already present on machine Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container l7-lb-controller in pod l7-lb-controller-bootstrap-e2e-master_kube-system(f922c87738da4b787ed79e8be7ae0573) Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container l7-lb-controller Jan 29 13:02:40.404: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-5cfjp to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 803.71872ms (803.737128ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.686824679s (1.68683837s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-mfrhp to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 732.917974ms (732.927763ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.939728202s (2.939751821s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-qkvrv to bootstrap-e2e-master Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 982.356767ms (982.364932ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.852484558s (1.852526362s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-rsxdm to bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 773.200901ms (773.212801ms including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.956595063s (1.956613123s including waiting) Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-qkvrv Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-5cfjp Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-mfrhp Jan 29 13:02:40.404: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-rsxdm Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-6764bf875c-ll7k6 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 2.537965673s (2.537975481s including waiting) Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 2.961132536s (2.961140218s including waiting) Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server-nanny Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.404: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: Get "https://10.64.2.7:10250/readyz": dial tcp 10.64.2.7:10250: connect: connection refused Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulDelete: Deleted pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-867b8754b9-gl5gs to bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 1.725742909s (1.725762024s including waiting) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 965.045186ms (965.056623ms including waiting) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": dial tcp 10.64.1.4:10250: connect: connection refused Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.4:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.5:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "metrics-server-config-volume" : object "kube-system"/"metrics-server-config" not registered Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.8:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.8:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2-867b8754b9: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-867b8754b9-gl5gs Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-6764bf875c to 1 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-867b8754b9 to 1 Jan 29 13:02:40.405: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled down replica set metrics-server-v0.5.2-6764bf875c to 0 from 1 Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: { } Scheduled: Successfully assigned kube-system/volume-snapshot-controller-0 to bootstrap-e2e-minion-group-f6wf Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" in 2.27992334s (2.279930738s including waiting) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/volume-snapshot-controller-0 Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:02:40.405: INFO: event for volume-snapshot-controller: {statefulset-controller } SuccessfulCreate: create Pod volume-snapshot-controller-0 in StatefulSet volume-snapshot-controller successful < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:02:40.405 (59ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:02:40.405 Jan 29 13:02:40.405: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:02:40.454 (49ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:02:40.454 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:02:40.454 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:02:40.454 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:02:40.455 STEP: Collecting events from namespace "reboot-3740". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:02:40.455 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 13:02:40.497 Jan 29 13:02:40.543: INFO: POD NODE PHASE GRACE CONDITIONS Jan 29 13:02:40.543: INFO: Jan 29 13:02:40.595: INFO: Logging node info for node bootstrap-e2e-master Jan 29 13:02:40.638: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 8e1b3b00-0184-4954-a6b8-395bd0b41aaa 1340 0 2023-01-29 12:55:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:56:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 13:02:17 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858370560 0} {<nil>} 3767940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596226560 0} {<nil>} 3511940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 13:02:17 +0000 UTC,LastTransitionTime:2023-01-29 12:56:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.145.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:52758f7247e2e803f500fb807091093a,SystemUUID:52758f72-47e2-e803-f500-fb807091093a,BootID:aa737e34-48fe-4c27-ab0d-8516bcd13e33,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:135952851,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:125275449,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:57552184,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.640: INFO: Logging kubelet events for node bootstrap-e2e-master Jan 29 13:02:40.686: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jan 29 13:02:40.730: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-master: error trying to reach service: No agent available Jan 29 13:02:40.730: INFO: Logging node info for node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.773: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-ct19 f4d8d037-c618-4a0b-805c-3939ff7d9269 1350 0 2023-01-29 12:56:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-ct19 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:56:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status} {node-problem-detector Update v1 2023-01-29 13:02:22 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-ct19,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 13:02:22 +0000 UTC,LastTransitionTime:2023-01-29 13:02:21 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:59:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.193.65,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c09e7c28f8d7857f29cb4179c2f98be7,SystemUUID:c09e7c28-f8d7-857f-29cb-4179c2f98be7,BootID:b3323607-88f0-4ec2-b469-f4fa57b9d5c7,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.774: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.819: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-ct19 Jan 29 13:02:40.864: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-ct19: error trying to reach service: No agent available Jan 29 13:02:40.864: INFO: Logging node info for node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.909: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-cws9 975cbf5d-1092-4142-b7a6-525e693a3596 1164 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-cws9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-cws9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.233.152.110,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38e91f781481e79e6df55f28f4c94137,SystemUUID:38e91f78-1481-e79e-6df5-5f28f4c94137,BootID:73270c8a-15fd-4f7b-837c-5c9d3cee5808,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:40.910: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:40.967: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-cws9 Jan 29 13:02:41.033: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-cws9: error trying to reach service: No agent available Jan 29 13:02:41.033: INFO: Logging node info for node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.077: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f6wf 00e5297f-551b-409a-9b31-4d98cdcfa0a7 1182 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f6wf kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-f6wf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.79.46,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:13420fb7de7e4ce4474f14dd79c7f5bf,SystemUUID:13420fb7-de7e-4ce4-474f-14dd79c7f5bf,BootID:6f6ab58d-72b2-4a3a-8d22-d00bd1cb98b9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:02:41.079: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.124: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f6wf Jan 29 13:02:41.168: INFO: Unable to retrieve kubelet pods for node bootstrap-e2e-minion-group-f6wf: error trying to reach service: No agent available END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:02:41.168 (713ms) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:02:41.168 (713ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:02:41.168 STEP: Destroying namespace "reboot-3740" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:02:41.168 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:02:41.213 (45ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:02:41.214 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:02:41.214 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sordering\sunclean\sreboot\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:00:07.055from ginkgo_report.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 12:58:04.363 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 12:58:04.363 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 12:58:04.363 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 12:58:04.363 Jan 29 12:58:04.363: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 12:58:04.365 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 12:58:04.49 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 12:58:04.572 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 12:58:04.652 (289ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 12:58:04.652 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 12:58:04.652 (0s) > Enter [It] each node by ordering unclean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:103 @ 01/29/23 12:58:04.652 Jan 29 12:58:04.798: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 12:58:04.798: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 12:58:04.799: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 12:58:04.842: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 12:58:04.843: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 12:58:04.843: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 12:58:04.884: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.884: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.884: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.885: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.885: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.886: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.886: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.886: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.887: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.926: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 41.476533ms Jan 29 12:58:04.926: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 46.165343ms Jan 29 12:58:04.931: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 46.057216ms Jan 29 12:58:04.931: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.931: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 12:58:04.931: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 12:58:04.932: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 45.150263ms Jan 29 12:58:04.932: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.932: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 45.059442ms Jan 29 12:58:04.932: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.932: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.932: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 12:58:04.932: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 12:58:04.932: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 44.189573ms Jan 29 12:58:04.932: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 45.534479ms Jan 29 12:58:04.934: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 45.588091ms Jan 29 12:58:04.934: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.934: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 12:58:04.934: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 12:58:05.450: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 12:58:05.454: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 12:58:05.461: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 12:58:05.492: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:05.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:05.504: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.534: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.538: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.547: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.578: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.581: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.590: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.644: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.645: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.645: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:15.728: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:15.728: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:15.729: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:17.771: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:17.772: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:17.772: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:19.811: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:19.812: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:19.812: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:27.972: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:27.972: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:27.973: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.524: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.524: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.525: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.571: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.571: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.572: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.710: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.851: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.853: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.853: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.048: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.050: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.050: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.093: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.094: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.135: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.178: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.226: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.226: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.227: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:44.590: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:44.590: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 12:59:44.591: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 12:59:44.652: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:44.654: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: KubeletNotReady, message: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 12:59:46.664: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:46.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: KubeletNotReady, message: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 12:59:46.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:48.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:48.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:48.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:50.752: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:50.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:50.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:52.795: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:52.831: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:52.831: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:54.839: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:59:54.874: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 42.305083ms Jan 29 12:59:54.917: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 42.371604ms Jan 29 12:59:54.917: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:59:54.917: INFO: Reboot successful on node bootstrap-e2e-minion-group-cws9 Jan 29 12:59:56.882: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:56.917: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:58.925: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:59.004: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 43.351549ms Jan 29 12:59:59.004: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 44.511432ms Jan 29 12:59:59.005: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 44.706196ms Jan 29 12:59:59.005: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:59:59.005: INFO: Reboot successful on node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:00.969: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:03.012: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:05.054: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:07.054: INFO: Node bootstrap-e2e-minion-group-ct19 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:00:07.054: INFO: Node bootstrap-e2e-minion-group-ct19 failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:00:07.055 < Exit [It] each node by ordering unclean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:103 @ 01/29/23 13:00:07.055 (2m2.403s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:00:07.055 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:00:07.055 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-ffllt to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.720961531s (1.72098729s including waiting) Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-qhqpd to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.418759668s (1.418773861s including waiting) Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "http://10.64.1.3:8181/ready": dial tcp 10.64.1.3:8181: connect: connection refused Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "config-volume" : object "kube-system"/"coredns" not registered Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } FailedCreate: Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-ffllt Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-qhqpd Jan 29 13:00:07.107: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 1 Jan 29 13:00:07.107: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 2 from 1 Jan 29 13:00:07.107: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_7982b became leader Jan 29 13:00:07.107: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_cb5e8 became leader Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-6hmkl to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.423530478s (1.423541743s including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-rptqg to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 653.623539ms (653.637202ms including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-w22sq to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.058743675s (1.058777973s including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-6hmkl Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-w22sq Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-rptqg Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6" already present on machine Jan 29 13:00:07.107: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Readiness probe failed: Get "https://127.0.0.1:443/readyz": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:00:07.108: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-apiserver Jan 29 13:00:07.108: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Liveness probe failed: Get "https://127.0.0.1:443/livez?exclude=etcd&exclude=kms-provider-0&exclude=kms-provider-1": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-controller-manager Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-controller-manager Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-controller-manager in pod kube-controller-manager-bootstrap-e2e-master_kube-system(a9901ac1fc908c01cd17c25062859343) Jan 29 13:00:07.108: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_71d2bb23-05b2-4ff0-abb2-d62d30500b82 became leader Jan 29 13:00:07.108: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_9be65189-f395-43ec-8127-df007406fb1b became leader Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } Scheduled: Successfully assigned kube-system/kube-dns-autoscaler-5f6455f985-j7ht7 to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" in 1.617088921s (1.617098535s including waiting) Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" already present on machine Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-" is forbidden: error looking up service account kube-system/kube-dns-autoscaler: serviceaccount "kube-dns-autoscaler" not found Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } SuccessfulCreate: Created pod: kube-dns-autoscaler-5f6455f985-j7ht7 Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler: {deployment-controller } ScalingReplicaSet: Scaled up replica set kube-dns-autoscaler-5f6455f985 to 1 Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-scheduler in pod kube-scheduler-bootstrap-e2e-master_kube-system(b286b0d19b475d76fb3eba5bf7889986) Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_e3e642b1-3c7d-4170-854d-206e3a5570f0 became leader Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_86ac1391-6ab5-43be-a725-fd2ce30379f7 became leader Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_63f7c13b-3d96-4b28-be84-6ca74aeeac0f became leader Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } Scheduled: Successfully assigned kube-system/l7-default-backend-8549d69d99-wk944 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" in 1.216619885s (1.216627078s including waiting) Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" already present on machine Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/l7-default-backend-8549d69d99-wk944 Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99: {replicaset-controller } SuccessfulCreate: Created pod: l7-default-backend-8549d69d99-wk944 Jan 29 13:00:07.108: INFO: event for l7-default-backend: {deployment-controller } ScalingReplicaSet: Scaled up replica set l7-default-backend-8549d69d99 to 1 Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1" already present on machine Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container l7-lb-controller in pod l7-lb-controller-bootstrap-e2e-master_kube-system(f922c87738da4b787ed79e8be7ae0573) Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-5cfjp to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 803.71872ms (803.737128ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.686824679s (1.68683837s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-mfrhp to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 732.917974ms (732.927763ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.939728202s (2.939751821s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-qkvrv to bootstrap-e2e-master Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 982.356767ms (982.364932ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.852484558s (1.852526362s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-rsxdm to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 773.200901ms (773.212801ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.956595063s (1.956613123s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-qkvrv Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-5cfjp Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-mfrhp Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-rsxdm Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-6764bf875c-ll7k6 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 2.537965673s (2.537975481s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 2.961132536s (2.961140218s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: Get "https://10.64.2.7:10250/readyz": dial tcp 10.64.2.7:10250: connect: connection refused Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulDelete: Deleted pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-867b8754b9-gl5gs to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 1.725742909s (1.725762024s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 965.045186ms (965.056623ms including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": dial tcp 10.64.1.4:10250: connect: connection refused Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.4:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.5:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "metrics-server-config-volume" : object "kube-system"/"metrics-server-config" not registered Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.8:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-867b8754b9-gl5gs Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-6764bf875c to 1 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-867b8754b9 to 1 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled down replica set metrics-server-v0.5.2-6764bf875c to 0 from 1 Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } Scheduled: Successfully assigned kube-system/volume-snapshot-controller-0 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" in 2.27992334s (2.279930738s including waiting) Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/volume-snapshot-controller-0 Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller: {statefulset-controller } SuccessfulCreate: create Pod volume-snapshot-controller-0 in StatefulSet volume-snapshot-controller successful < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:00:07.108 (53ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:00:07.108 Jan 29 13:00:07.108: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:00:07.153 (45ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:00:07.153 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:00:07.153 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:00:07.153 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:00:07.153 STEP: Collecting events from namespace "reboot-7736". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:00:07.153 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 13:00:07.194 Jan 29 13:00:07.235: INFO: POD NODE PHASE GRACE CONDITIONS Jan 29 13:00:07.235: INFO: Jan 29 13:00:07.280: INFO: Logging node info for node bootstrap-e2e-master Jan 29 13:00:07.321: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 8e1b3b00-0184-4954-a6b8-395bd0b41aaa 711 0 2023-01-29 12:55:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:56:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 12:56:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858370560 0} {<nil>} 3767940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596226560 0} {<nil>} 3511940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:56:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.145.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:52758f7247e2e803f500fb807091093a,SystemUUID:52758f72-47e2-e803-f500-fb807091093a,BootID:aa737e34-48fe-4c27-ab0d-8516bcd13e33,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:135952851,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:125275449,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:57552184,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:07.322: INFO: Logging kubelet events for node bootstrap-e2e-master Jan 29 13:00:07.365: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jan 29 13:00:07.503: INFO: kube-controller-manager-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 29 13:00:07.503: INFO: l7-lb-controller-bootstrap-e2e-master started at 2023-01-29 12:55:29 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container l7-lb-controller ready: true, restart count 3 Jan 29 13:00:07.503: INFO: metadata-proxy-v0.1-qkvrv started at 2023-01-29 12:56:23 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:07.503: INFO: Container metadata-proxy ready: true, restart count 0 Jan 29 13:00:07.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 29 13:00:07.503: INFO: etcd-server-events-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container etcd-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: etcd-server-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container etcd-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: kube-apiserver-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-apiserver ready: true, restart count 1 Jan 29 13:00:07.503: INFO: konnectivity-server-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container konnectivity-server-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: kube-scheduler-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-scheduler ready: true, restart count 2 Jan 29 13:00:07.503: INFO: kube-addon-manager-bootstrap-e2e-master started at 2023-01-29 12:55:29 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-addon-manager ready: true, restart count 1 Jan 29 13:00:07.710: INFO: Latency metrics for node bootstrap-e2e-master Jan 29 13:00:07.710: INFO: Logging node info for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.752: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-ct19 f4d8d037-c618-4a0b-805c-3939ff7d9269 1070 0 2023-01-29 12:56:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-ct19 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:56:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-ct19,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:59:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.193.65,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c09e7c28f8d7857f29cb4179c2f98be7,SystemUUID:c09e7c28-f8d7-857f-29cb-4179c2f98be7,BootID:b3323607-88f0-4ec2-b469-f4fa57b9d5c7,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:07.752: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.796: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.912: INFO: kube-dns-autoscaler-5f6455f985-j7ht7 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container autoscaler ready: true, restart count 1 Jan 29 13:00:07.912: INFO: coredns-6846b5b5f-ffllt started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container coredns ready: true, restart count 1 Jan 29 13:00:07.912: INFO: metadata-proxy-v0.1-rsxdm started at 2023-01-29 12:56:01 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:07.912: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:07.912: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:07.912: INFO: konnectivity-agent-w22sq started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container konnectivity-agent ready: true, restart count 2 Jan 29 13:00:07.912: INFO: kube-proxy-bootstrap-e2e-minion-group-ct19 started at 2023-01-29 12:56:00 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container kube-proxy ready: true, restart count 2 Jan 29 13:00:08.094: INFO: Latency metrics for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:08.094: INFO: Logging node info for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.136: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-cws9 975cbf5d-1092-4142-b7a6-525e693a3596 1164 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-cws9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-cws9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.233.152.110,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38e91f781481e79e6df55f28f4c94137,SystemUUID:38e91f78-1481-e79e-6df5-5f28f4c94137,BootID:73270c8a-15fd-4f7b-837c-5c9d3cee5808,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:08.136: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.181: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.245: INFO: konnectivity-agent-rptqg started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container konnectivity-agent ready: true, restart count 1 Jan 29 13:00:08.245: INFO: coredns-6846b5b5f-qhqpd started at 2023-01-29 12:56:20 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container coredns ready: true, restart count 1 Jan 29 13:00:08.245: INFO: metrics-server-v0.5.2-867b8754b9-gl5gs started at 2023-01-29 12:56:35 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.245: INFO: Container metrics-server ready: false, restart count 2 Jan 29 13:00:08.245: INFO: Container metrics-server-nanny ready: true, restart count 2 Jan 29 13:00:08.245: INFO: kube-proxy-bootstrap-e2e-minion-group-cws9 started at 2023-01-29 12:55:58 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container kube-proxy ready: true, restart count 2 Jan 29 13:00:08.245: INFO: metadata-proxy-v0.1-5cfjp started at 2023-01-29 12:55:59 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.245: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:08.245: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:08.416: INFO: Latency metrics for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.416: INFO: Logging node info for node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.467: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f6wf 00e5297f-551b-409a-9b31-4d98cdcfa0a7 1182 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f6wf kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-f6wf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.79.46,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:13420fb7de7e4ce4474f14dd79c7f5bf,SystemUUID:13420fb7-de7e-4ce4-474f-14dd79c7f5bf,BootID:6f6ab58d-72b2-4a3a-8d22-d00bd1cb98b9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:08.467: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.521: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.581: INFO: l7-default-backend-8549d69d99-wk944 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container default-http-backend ready: false, restart count 0 Jan 29 13:00:08.581: INFO: volume-snapshot-controller-0 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container volume-snapshot-controller ready: true, restart count 3 Jan 29 13:00:08.581: INFO: metadata-proxy-v0.1-mfrhp started at 2023-01-29 12:55:59 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.581: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:08.581: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:08.581: INFO: konnectivity-agent-6hmkl started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container konnectivity-agent ready: false, restart count 1 Jan 29 13:00:08.581: INFO: kube-proxy-bootstrap-e2e-minion-group-f6wf started at 2023-01-29 12:55:58 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container kube-proxy ready: true, restart count 3 Jan 29 13:00:28.898: INFO: Latency metrics for node bootstrap-e2e-minion-group-f6wf END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:00:28.898 (21.745s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:00:28.898 (21.745s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:00:28.898 STEP: Destroying namespace "reboot-7736" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:00:28.898 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:00:28.942 (44ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:00:28.942 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:00:28.942 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sordering\sunclean\sreboot\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:00:07.055from junit_01.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 12:58:04.363 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 12:58:04.363 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 12:58:04.363 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 12:58:04.363 Jan 29 12:58:04.363: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 12:58:04.365 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 12:58:04.49 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 12:58:04.572 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 12:58:04.652 (289ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 12:58:04.652 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 12:58:04.652 (0s) > Enter [It] each node by ordering unclean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:103 @ 01/29/23 12:58:04.652 Jan 29 12:58:04.798: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 12:58:04.798: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 12:58:04.799: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 12:58:04.842: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 12:58:04.843: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 12:58:04.843: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 12:58:04.884: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.884: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.884: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.885: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.885: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.886: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.886: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.886: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.887: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.888: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:58:04.926: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 41.476533ms Jan 29 12:58:04.926: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 46.165343ms Jan 29 12:58:04.931: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 46.057216ms Jan 29 12:58:04.931: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.931: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-rsxdm kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19] Jan 29 12:58:04.931: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 12:58:04.931: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 12:58:04.932: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 45.150263ms Jan 29 12:58:04.932: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.932: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 45.059442ms Jan 29 12:58:04.932: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.932: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:58:04.932: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 12:58:04.932: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 12:58:04.932: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 44.189573ms Jan 29 12:58:04.932: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 45.534479ms Jan 29 12:58:04.934: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 45.588091ms Jan 29 12:58:04.934: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 12:58:04.934: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:58:04.934: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 12:58:04.934: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 12:58:05.450: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 12:58:05.450: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 12:58:05.454: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 12:58:05.454: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo b | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 12:58:05.461: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 12:58:05.461: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 12:58:05.492: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:05.496: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:05.504: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.534: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.538: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:07.547: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.578: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.581: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:09.590: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.644: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.645: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:11.645: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:13.687: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:15.728: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:15.728: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:15.729: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:17.771: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:17.772: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:17.772: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:19.811: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:19.812: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:19.812: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:21.852: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:23.891: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:25.932: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:27.972: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:27.972: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:27.973: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:30.013: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:32.059: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:34.099: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:36.139: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:38.179: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:40.219: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:42.260: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-ct19 Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-f6wf Jan 29 12:58:44.300: INFO: Couldn't get node bootstrap-e2e-minion-group-cws9 Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:49.249: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:51.295: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:53.343: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:55.388: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:57.433: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.524: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.524: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:58:59.525: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.571: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.571: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:01.572: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:03.617: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:05.663: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:07.710: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:09.757: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:11.805: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.851: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.853: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:13.853: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:15.896: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:17.955: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:20.000: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.048: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.050: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:22.050: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.093: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:24.094: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.135: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:26.137: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.178: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:28.180: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.226: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.226: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:30.227: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:32.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:34.326: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:36.372: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:38.417: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:40.464: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:42.511: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:44.590: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:44.590: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 12:59:44.591: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 12:59:44.652: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:44.654: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: KubeletNotReady, message: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 12:59:46.664: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:46.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: KubeletNotReady, message: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 12:59:46.700: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:48.709: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:48.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:48.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:50.752: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:50.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:50.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:52.795: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:52.831: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: KubeletNotReady, message: [PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized] Jan 29 12:59:52.831: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoSchedule 2023-01-29 12:59:43 +0000 UTC} {node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:54.839: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:59:54.874: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:54.874: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 42.305083ms Jan 29 12:59:54.917: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 42.371604ms Jan 29 12:59:54.917: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 12:59:54.917: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 12:59:54.917: INFO: Reboot successful on node bootstrap-e2e-minion-group-cws9 Jan 29 12:59:56.882: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:56.917: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true, but Node is tainted by NodeController with [{node.kubernetes.io/not-ready NoExecute 2023-01-29 12:59:48 +0000 UTC}]. Failure Jan 29 12:59:58.925: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:58.960: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 12:59:59.004: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 43.351549ms Jan 29 12:59:59.004: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 44.511432ms Jan 29 12:59:59.005: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 44.706196ms Jan 29 12:59:59.005: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 12:59:59.005: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0 kube-proxy-bootstrap-e2e-minion-group-f6wf] Jan 29 12:59:59.005: INFO: Reboot successful on node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:00.969: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:03.012: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:05.054: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:00:07.054: INFO: Node bootstrap-e2e-minion-group-ct19 didn't reach desired Ready condition status (false) within 2m0s Jan 29 13:00:07.054: INFO: Node bootstrap-e2e-minion-group-ct19 failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:00:07.055 < Exit [It] each node by ordering unclean reboot and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:103 @ 01/29/23 13:00:07.055 (2m2.403s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:00:07.055 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:00:07.055 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-ffllt to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.720961531s (1.72098729s including waiting) Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-ffllt: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: { } Scheduled: Successfully assigned kube-system/coredns-6846b5b5f-qhqpd to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/coredns/coredns:v1.10.0" Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/coredns/coredns:v1.10.0" in 1.418759668s (1.418773861s including waiting) Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "http://10.64.1.3:8181/ready": dial tcp 10.64.1.3:8181: connect: connection refused Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "config-volume" : object "kube-system"/"coredns" not registered Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/coredns/coredns:v1.10.0" already present on machine Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f-qhqpd: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container coredns Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } FailedCreate: Error creating: insufficient quota to match these scopes: [{PriorityClass In [system-node-critical system-cluster-critical]}] Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-ffllt Jan 29 13:00:07.107: INFO: event for coredns-6846b5b5f: {replicaset-controller } SuccessfulCreate: Created pod: coredns-6846b5b5f-qhqpd Jan 29 13:00:07.107: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 1 Jan 29 13:00:07.107: INFO: event for coredns: {deployment-controller } ScalingReplicaSet: Scaled up replica set coredns-6846b5b5f to 2 from 1 Jan 29 13:00:07.107: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_7982b became leader Jan 29 13:00:07.107: INFO: event for ingress-gce-lock: {loadbalancer-controller } LeaderElection: bootstrap-e2e-master_cb5e8 became leader Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-6hmkl to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.423530478s (1.423541743s including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for konnectivity-agent-6hmkl: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-rptqg to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 653.623539ms (653.637202ms including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-rptqg: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: { } Scheduled: Successfully assigned kube-system/konnectivity-agent-w22sq to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" in 1.058743675s (1.058777973s including waiting) Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1" already present on machine Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent-w22sq: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container konnectivity-agent Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-6hmkl Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-w22sq Jan 29 13:00:07.107: INFO: event for konnectivity-agent: {daemonset-controller } SuccessfulCreate: Created pod: konnectivity-agent-rptqg Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-addon-manager Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.107: INFO: event for kube-addon-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6" already present on machine Jan 29 13:00:07.107: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Readiness probe failed: Get "https://127.0.0.1:443/readyz": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:00:07.108: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-apiserver Jan 29 13:00:07.108: INFO: event for kube-apiserver-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Unhealthy: Liveness probe failed: Get "https://127.0.0.1:443/livez?exclude=etcd&exclude=kms-provider-0&exclude=kms-provider-1": dial tcp 127.0.0.1:443: connect: connection refused Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-controller-manager Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-controller-manager Jan 29 13:00:07.108: INFO: event for kube-controller-manager-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-controller-manager in pod kube-controller-manager-bootstrap-e2e-master_kube-system(a9901ac1fc908c01cd17c25062859343) Jan 29 13:00:07.108: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_71d2bb23-05b2-4ff0-abb2-d62d30500b82 became leader Jan 29 13:00:07.108: INFO: event for kube-controller-manager: {kube-controller-manager } LeaderElection: bootstrap-e2e-master_9be65189-f395-43ec-8127-df007406fb1b became leader Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: { } Scheduled: Successfully assigned kube-system/kube-dns-autoscaler-5f6455f985-j7ht7 to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" in 1.617088921s (1.617098535s including waiting) Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4" already present on machine Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985-j7ht7: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container autoscaler Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } FailedCreate: Error creating: pods "kube-dns-autoscaler-5f6455f985-" is forbidden: error looking up service account kube-system/kube-dns-autoscaler: serviceaccount "kube-dns-autoscaler" not found Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler-5f6455f985: {replicaset-controller } SuccessfulCreate: Created pod: kube-dns-autoscaler-5f6455f985-j7ht7 Jan 29 13:00:07.108: INFO: event for kube-dns-autoscaler: {deployment-controller } ScalingReplicaSet: Scaled up replica set kube-dns-autoscaler-5f6455f985 to 1 Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-ct19: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-cws9: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container kube-proxy in pod kube-proxy-bootstrap-e2e-minion-group-f6wf_kube-system(aa9dd3cb3427848d107cb003c88ec4d5) Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-proxy-bootstrap-e2e-minion-group-f6wf: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container kube-proxy Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2" already present on machine Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container kube-scheduler Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for kube-scheduler-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container kube-scheduler in pod kube-scheduler-bootstrap-e2e-master_kube-system(b286b0d19b475d76fb3eba5bf7889986) Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_e3e642b1-3c7d-4170-854d-206e3a5570f0 became leader Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_86ac1391-6ab5-43be-a725-fd2ce30379f7 became leader Jan 29 13:00:07.108: INFO: event for kube-scheduler: {default-scheduler } LeaderElection: bootstrap-e2e-master_63f7c13b-3d96-4b28-be84-6ca74aeeac0f became leader Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: { } Scheduled: Successfully assigned kube-system/l7-default-backend-8549d69d99-wk944 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" in 1.216619885s (1.216627078s including waiting) Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11" already present on machine Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container default-http-backend Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99-wk944: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/l7-default-backend-8549d69d99-wk944 Jan 29 13:00:07.108: INFO: event for l7-default-backend-8549d69d99: {replicaset-controller } SuccessfulCreate: Created pod: l7-default-backend-8549d69d99-wk944 Jan 29 13:00:07.108: INFO: event for l7-default-backend: {deployment-controller } ScalingReplicaSet: Scaled up replica set l7-default-backend-8549d69d99 to 1 Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Created: Created container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Started: Started container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Pulled: Container image "gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1" already present on machine Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} BackOff: Back-off restarting failed container l7-lb-controller in pod l7-lb-controller-bootstrap-e2e-master_kube-system(f922c87738da4b787ed79e8be7ae0573) Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} Killing: Stopping container l7-lb-controller Jan 29 13:00:07.108: INFO: event for l7-lb-controller-bootstrap-e2e-master: {kubelet bootstrap-e2e-master} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-5cfjp to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 803.71872ms (803.737128ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.686824679s (1.68683837s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-5cfjp: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-mfrhp to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 732.917974ms (732.927763ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 2.939728202s (2.939751821s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-mfrhp: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-qkvrv to bootstrap-e2e-master Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 982.356767ms (982.364932ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.852484558s (1.852526362s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-qkvrv: {kubelet bootstrap-e2e-master} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: { } Scheduled: Successfully assigned kube-system/metadata-proxy-v0.1-rsxdm to bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "registry.k8s.io/metadata-proxy:v0.1.12" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "registry.k8s.io/metadata-proxy:v0.1.12" in 773.200901ms (773.212801ms including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulling: Pulling image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Successfully pulled image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" in 1.956595063s (1.956613123s including waiting) Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "registry.k8s.io/metadata-proxy:v0.1.12" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container metadata-proxy Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Pulled: Container image "gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1" already present on machine Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Created: Created container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1-rsxdm: {kubelet bootstrap-e2e-minion-group-ct19} Started: Started container prometheus-to-sd-exporter Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-qkvrv Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-5cfjp Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-mfrhp Jan 29 13:00:07.108: INFO: event for metadata-proxy-v0.1: {daemonset-controller } SuccessfulCreate: Created pod: metadata-proxy-v0.1-rsxdm Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } FailedScheduling: 0/3 nodes are available: 1 node(s) were unschedulable, 2 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-6764bf875c-ll7k6 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 2.537965673s (2.537975481s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 2.961132536s (2.961140218s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 500 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c-ll7k6: {kubelet bootstrap-e2e-minion-group-f6wf} Unhealthy: Readiness probe failed: Get "https://10.64.2.7:10250/readyz": dial tcp 10.64.2.7:10250: connect: connection refused Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-6764bf875c: {replicaset-controller } SuccessfulDelete: Deleted pod: metrics-server-v0.5.2-6764bf875c-ll7k6 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: { } Scheduled: Successfully assigned kube-system/metrics-server-v0.5.2-867b8754b9-gl5gs to bootstrap-e2e-minion-group-cws9 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" in 1.725742909s (1.725762024s including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulling: Pulling image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Successfully pulled image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" in 965.045186ms (965.056623ms including waiting) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": dial tcp 10.64.1.4:10250: connect: connection refused Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": context deadline exceeded (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Liveness probe failed: Get "https://10.64.1.4:10250/livez": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.4:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Killing: Stopping container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.5:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} FailedMount: MountVolume.SetUp failed for volume "metrics-server-config-volume" : object "kube-system"/"metrics-server-config" not registered Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/metrics-server/metrics-server:v0.5.2" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Pulled: Container image "registry.k8s.io/autoscaling/addon-resizer:1.8.14" already present on machine Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Created: Created container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Started: Started container metrics-server-nanny Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9-gl5gs: {kubelet bootstrap-e2e-minion-group-cws9} Unhealthy: Readiness probe failed: Get "https://10.64.1.8:10250/readyz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2-867b8754b9: {replicaset-controller } SuccessfulCreate: Created pod: metrics-server-v0.5.2-867b8754b9-gl5gs Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-6764bf875c to 1 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled up replica set metrics-server-v0.5.2-867b8754b9 to 1 Jan 29 13:00:07.108: INFO: event for metrics-server-v0.5.2: {deployment-controller } ScalingReplicaSet: Scaled down replica set metrics-server-v0.5.2-6764bf875c to 0 from 1 Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: no nodes available to schedule pods Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } FailedScheduling: 0/3 nodes are available: 1 node(s) had untolerated taint {node.kubernetes.io/network-unavailable: }, 1 node(s) had untolerated taint {node.kubernetes.io/not-ready: }, 1 node(s) were unschedulable. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling.. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: { } Scheduled: Successfully assigned kube-system/volume-snapshot-controller-0 to bootstrap-e2e-minion-group-f6wf Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulling: Pulling image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Successfully pulled image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" in 2.27992334s (2.279930738s including waiting) Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} BackOff: Back-off restarting failed container volume-snapshot-controller in pod volume-snapshot-controller-0_kube-system(4916b993-cd81-4e1e-b648-c4686847cac6) Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} NetworkNotReady: network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} SandboxChanged: Pod sandbox changed, it will be killed and re-created. Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Pulled: Container image "registry.k8s.io/sig-storage/snapshot-controller:v6.1.0" already present on machine Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Created: Created container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Started: Started container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {kubelet bootstrap-e2e-minion-group-f6wf} Killing: Stopping container volume-snapshot-controller Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller-0: {taint-controller } TaintManagerEviction: Cancelling deletion of Pod kube-system/volume-snapshot-controller-0 Jan 29 13:00:07.108: INFO: event for volume-snapshot-controller: {statefulset-controller } SuccessfulCreate: create Pod volume-snapshot-controller-0 in StatefulSet volume-snapshot-controller successful < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:00:07.108 (53ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:00:07.108 Jan 29 13:00:07.108: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:00:07.153 (45ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:00:07.153 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:00:07.153 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:00:07.153 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:00:07.153 STEP: Collecting events from namespace "reboot-7736". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:00:07.153 STEP: Found 0 events. - test/e2e/framework/debug/dump.go:46 @ 01/29/23 13:00:07.194 Jan 29 13:00:07.235: INFO: POD NODE PHASE GRACE CONDITIONS Jan 29 13:00:07.235: INFO: Jan 29 13:00:07.280: INFO: Logging node info for node bootstrap-e2e-master Jan 29 13:00:07.321: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-master 8e1b3b00-0184-4954-a6b8-395bd0b41aaa 711 0 2023-01-29 12:55:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-1 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-master kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-1 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:unschedulable":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:56:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-29 12:56:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:10.64.0.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-master,Unschedulable:true,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/master,Value:,Effect:NoSchedule,TimeAdded:<nil>,},Taint{Key:node.kubernetes.io/unschedulable,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[10.64.0.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{16656896000 0} {<nil>} 16266500Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3858370560 0} {<nil>} 3767940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{1 0} {<nil>} 1 DecimalSI},ephemeral-storage: {{14991206376 0} {<nil>} 14991206376 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3596226560 0} {<nil>} 3511940Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:55:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:56:48 +0000 UTC,LastTransitionTime:2023-01-29 12:56:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.2,},NodeAddress{Type:ExternalIP,Address:35.227.145.153,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-master.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:52758f7247e2e803f500fb807091093a,SystemUUID:52758f72-47e2-e803-f500-fb807091093a,BootID:aa737e34-48fe-4c27-ab0d-8516bcd13e33,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:135952851,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:125275449,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:51eae8381dcb1078289fa7b4f3df2630cdc18d09fb56f8e56b41c40e191d6c83 registry.k8s.io/etcd:3.5.7-0],SizeBytes:101639218,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:57552184,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64@sha256:5db27383add6d9f4ebdf0286409ac31f7f5d273690204b341a4e37998917693b gcr.io/k8s-ingress-image-push/ingress-gce-glbc-amd64:v1.20.1],SizeBytes:36598135,},ContainerImage{Names:[registry.k8s.io/addon-manager/kube-addon-manager@sha256:49cc4e6e4a3745b427ce14b0141476ab339bb65c6bc05033019e046c8727dcb0 registry.k8s.io/addon-manager/kube-addon-manager:v9.1.6],SizeBytes:30464183,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-server@sha256:b1389e7014425a1752aac55f5043ef4c52edaef0e223bf4d48ed1324e298087c registry.k8s.io/kas-network-proxy/proxy-server:v0.1.1],SizeBytes:21875112,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:07.322: INFO: Logging kubelet events for node bootstrap-e2e-master Jan 29 13:00:07.365: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-master Jan 29 13:00:07.503: INFO: kube-controller-manager-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-controller-manager ready: true, restart count 3 Jan 29 13:00:07.503: INFO: l7-lb-controller-bootstrap-e2e-master started at 2023-01-29 12:55:29 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container l7-lb-controller ready: true, restart count 3 Jan 29 13:00:07.503: INFO: metadata-proxy-v0.1-qkvrv started at 2023-01-29 12:56:23 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:07.503: INFO: Container metadata-proxy ready: true, restart count 0 Jan 29 13:00:07.503: INFO: Container prometheus-to-sd-exporter ready: true, restart count 0 Jan 29 13:00:07.503: INFO: etcd-server-events-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container etcd-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: etcd-server-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container etcd-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: kube-apiserver-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-apiserver ready: true, restart count 1 Jan 29 13:00:07.503: INFO: konnectivity-server-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container konnectivity-server-container ready: true, restart count 0 Jan 29 13:00:07.503: INFO: kube-scheduler-bootstrap-e2e-master started at 2023-01-29 12:55:11 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-scheduler ready: true, restart count 2 Jan 29 13:00:07.503: INFO: kube-addon-manager-bootstrap-e2e-master started at 2023-01-29 12:55:29 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.503: INFO: Container kube-addon-manager ready: true, restart count 1 Jan 29 13:00:07.710: INFO: Latency metrics for node bootstrap-e2e-master Jan 29 13:00:07.710: INFO: Logging node info for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.752: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-ct19 f4d8d037-c618-4a0b-805c-3939ff7d9269 1070 0 2023-01-29 12:56:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-ct19 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:56:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:28 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.3.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-ct19,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.3.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815430144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553286144 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:28 +0000 UTC,LastTransitionTime:2023-01-29 12:59:27 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:56:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:43 +0000 UTC,LastTransitionTime:2023-01-29 12:59:43 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.4,},NodeAddress{Type:ExternalIP,Address:34.83.193.65,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-ct19.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c09e7c28f8d7857f29cb4179c2f98be7,SystemUUID:c09e7c28-f8d7-857f-29cb-4179c2f98be7,BootID:b3323607-88f0-4ec2-b469-f4fa57b9d5c7,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:fd636b33485c7826fb20ef0688a83ee0910317dbb6c0c6f3ad14661c1db25def registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.4],SizeBytes:15209393,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:07.752: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.796: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:07.912: INFO: kube-dns-autoscaler-5f6455f985-j7ht7 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container autoscaler ready: true, restart count 1 Jan 29 13:00:07.912: INFO: coredns-6846b5b5f-ffllt started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container coredns ready: true, restart count 1 Jan 29 13:00:07.912: INFO: metadata-proxy-v0.1-rsxdm started at 2023-01-29 12:56:01 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:07.912: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:07.912: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:07.912: INFO: konnectivity-agent-w22sq started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container konnectivity-agent ready: true, restart count 2 Jan 29 13:00:07.912: INFO: kube-proxy-bootstrap-e2e-minion-group-ct19 started at 2023-01-29 12:56:00 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:07.912: INFO: Container kube-proxy ready: true, restart count 2 Jan 29 13:00:08.094: INFO: Latency metrics for node bootstrap-e2e-minion-group-ct19 Jan 29 13:00:08.094: INFO: Logging node info for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.136: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-cws9 975cbf5d-1092-4142-b7a6-525e693a3596 1164 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-cws9 kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:24 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:allocatable":{"f:memory":{}},"f:capacity":{"f:memory":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.1.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-cws9,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.1.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:24 +0000 UTC,LastTransitionTime:2023-01-29 12:59:23 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.3,},NodeAddress{Type:ExternalIP,Address:35.233.152.110,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-cws9.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:38e91f781481e79e6df55f28f4c94137,SystemUUID:38e91f78-1481-e79e-6df5-5f28f4c94137,BootID:73270c8a-15fd-4f7b-837c-5c9d3cee5808,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:08.136: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.181: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.245: INFO: konnectivity-agent-rptqg started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container konnectivity-agent ready: true, restart count 1 Jan 29 13:00:08.245: INFO: coredns-6846b5b5f-qhqpd started at 2023-01-29 12:56:20 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container coredns ready: true, restart count 1 Jan 29 13:00:08.245: INFO: metrics-server-v0.5.2-867b8754b9-gl5gs started at 2023-01-29 12:56:35 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.245: INFO: Container metrics-server ready: false, restart count 2 Jan 29 13:00:08.245: INFO: Container metrics-server-nanny ready: true, restart count 2 Jan 29 13:00:08.245: INFO: kube-proxy-bootstrap-e2e-minion-group-cws9 started at 2023-01-29 12:55:58 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.245: INFO: Container kube-proxy ready: true, restart count 2 Jan 29 13:00:08.245: INFO: metadata-proxy-v0.1-5cfjp started at 2023-01-29 12:55:59 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.245: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:08.245: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:08.416: INFO: Latency metrics for node bootstrap-e2e-minion-group-cws9 Jan 29 13:00:08.416: INFO: Logging node info for node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.467: INFO: Node Info: &Node{ObjectMeta:{bootstrap-e2e-minion-group-f6wf 00e5297f-551b-409a-9b31-4d98cdcfa0a7 1182 0 2023-01-29 12:55:58 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:n1-standard-2 beta.kubernetes.io/os:linux cloud.google.com/metadata-proxy-ready:true failure-domain.beta.kubernetes.io/region:us-west1 failure-domain.beta.kubernetes.io/zone:us-west1-b kubernetes.io/arch:amd64 kubernetes.io/hostname:bootstrap-e2e-minion-group-f6wf kubernetes.io/os:linux node.kubernetes.io/instance-type:n1-standard-2 topology.kubernetes.io/region:us-west1 topology.kubernetes.io/zone:us-west1-b] map[node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-29 12:55:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/instance-type":{},"f:beta.kubernetes.io/os":{},"f:cloud.google.com/metadata-proxy-ready":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {kube-controller-manager Update v1 2023-01-29 12:56:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"NetworkUnavailable\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}}}} status} {node-problem-detector Update v1 2023-01-29 12:59:25 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"CorruptDockerOverlay2\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentContainerdRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentDockerRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentKubeletRestart\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"FrequentUnregisterNetDevice\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"KernelDeadlock\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"ReadonlyFilesystem\"}":{".":{},"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"10.64.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-29 12:59:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:nodeInfo":{"f:bootID":{}}}} status}]},Spec:NodeSpec{PodCIDR:10.64.2.0/24,DoNotUseExternalID:,ProviderID:gce://k8s-jkns-gce-1-4/us-west1-b/bootstrap-e2e-minion-group-f6wf,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[10.64.2.0/24],},Status:NodeStatus{Capacity:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{101203873792 0} {<nil>} 98831908Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7815438336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{attachable-volumes-gce-pd: {{127 0} {<nil>} 127 DecimalSI},cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{91083486262 0} {<nil>} 91083486262 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{7553294336 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:KernelDeadlock,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:KernelHasNoDeadlock,Message:kernel has no deadlock,},NodeCondition{Type:ReadonlyFilesystem,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:FilesystemIsNotReadOnly,Message:Filesystem is not read-only,},NodeCondition{Type:FrequentUnregisterNetDevice,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentUnregisterNetDevice,Message:node is functioning properly,},NodeCondition{Type:FrequentKubeletRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentKubeletRestart,Message:kubelet is functioning properly,},NodeCondition{Type:FrequentDockerRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentDockerRestart,Message:docker is functioning properly,},NodeCondition{Type:FrequentContainerdRestart,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoFrequentContainerdRestart,Message:containerd is functioning properly,},NodeCondition{Type:CorruptDockerOverlay2,Status:False,LastHeartbeatTime:2023-01-29 12:59:25 +0000 UTC,LastTransitionTime:2023-01-29 12:59:24 +0000 UTC,Reason:NoCorruptDockerOverlay2,Message:docker overlay2 is functioning properly,},NodeCondition{Type:NetworkUnavailable,Status:False,LastHeartbeatTime:2023-01-29 12:56:15 +0000 UTC,LastTransitionTime:2023-01-29 12:56:15 +0000 UTC,Reason:RouteCreated,Message:RouteController created a route,},NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:55:58 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-29 12:59:54 +0000 UTC,LastTransitionTime:2023-01-29 12:59:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:10.138.0.5,},NodeAddress{Type:ExternalIP,Address:34.82.79.46,},NodeAddress{Type:InternalDNS,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},NodeAddress{Type:Hostname,Address:bootstrap-e2e-minion-group-f6wf.c.k8s-jkns-gce-1-4.internal,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:13420fb7de7e4ce4474f14dd79c7f5bf,SystemUUID:13420fb7-de7e-4ce4-474f-14dd79c7f5bf,BootID:6f6ab58d-72b2-4a3a-8d22-d00bd1cb98b9,KernelVersion:5.10.123+,OSImage:Container-Optimized OS from Google,ContainerRuntimeVersion:containerd://1.7.0-beta.3-7-gaef75c418,KubeletVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,KubeProxyVersion:v1.27.0-alpha.1.73+8e642d3d0deab2,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.27.0-alpha.1.73_8e642d3d0deab2],SizeBytes:66989256,},ContainerImage{Names:[gke.gcr.io/prometheus-to-sd@sha256:e739643c3939ba0b161425f45a1989eedfc4a3b166db9a7100863296b4c70510 gke.gcr.io/prometheus-to-sd:v0.11.1-gke.1],SizeBytes:48742566,},ContainerImage{Names:[registry.k8s.io/metrics-server/metrics-server@sha256:6385aec64bb97040a5e692947107b81e178555c7a5b71caa90d733e4130efc10 registry.k8s.io/metrics-server/metrics-server:v0.5.2],SizeBytes:26023008,},ContainerImage{Names:[registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 registry.k8s.io/sig-storage/snapshot-controller:v6.1.0],SizeBytes:22620891,},ContainerImage{Names:[registry.k8s.io/autoscaling/addon-resizer@sha256:43f129b81d28f0fdd54de6d8e7eacd5728030782e03db16087fc241ad747d3d6 registry.k8s.io/autoscaling/addon-resizer:1.8.14],SizeBytes:10153852,},ContainerImage{Names:[registry.k8s.io/kas-network-proxy/proxy-agent@sha256:939c42e815e6b6af3181f074652c0d18fe429fcee9b49c1392aee7e92887cfef registry.k8s.io/kas-network-proxy/proxy-agent:v0.1.1],SizeBytes:8364694,},ContainerImage{Names:[registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64@sha256:7eb7b3cee4d33c10c49893ad3c386232b86d4067de5251294d4c620d6e072b93 registry.k8s.io/networking/ingress-gce-404-server-with-metrics-amd64:v1.10.11],SizeBytes:6463068,},ContainerImage{Names:[registry.k8s.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a registry.k8s.io/metadata-proxy:v0.1.12],SizeBytes:5301657,},ContainerImage{Names:[registry.k8s.io/pause@sha256:9001185023633d17a2f98ff69b6ff2615b8ea02a825adffa40422f51dfdcde9d registry.k8s.io/pause:3.8],SizeBytes:311286,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 29 13:00:08.467: INFO: Logging kubelet events for node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.521: INFO: Logging pods the kubelet thinks is on node bootstrap-e2e-minion-group-f6wf Jan 29 13:00:08.581: INFO: l7-default-backend-8549d69d99-wk944 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container default-http-backend ready: false, restart count 0 Jan 29 13:00:08.581: INFO: volume-snapshot-controller-0 started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container volume-snapshot-controller ready: true, restart count 3 Jan 29 13:00:08.581: INFO: metadata-proxy-v0.1-mfrhp started at 2023-01-29 12:55:59 +0000 UTC (0+2 container statuses recorded) Jan 29 13:00:08.581: INFO: Container metadata-proxy ready: true, restart count 1 Jan 29 13:00:08.581: INFO: Container prometheus-to-sd-exporter ready: true, restart count 1 Jan 29 13:00:08.581: INFO: konnectivity-agent-6hmkl started at 2023-01-29 12:56:16 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container konnectivity-agent ready: false, restart count 1 Jan 29 13:00:08.581: INFO: kube-proxy-bootstrap-e2e-minion-group-f6wf started at 2023-01-29 12:55:58 +0000 UTC (0+1 container statuses recorded) Jan 29 13:00:08.581: INFO: Container kube-proxy ready: true, restart count 3 Jan 29 13:00:28.898: INFO: Latency metrics for node bootstrap-e2e-minion-group-f6wf END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:00:28.898 (21.745s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:00:28.898 (21.745s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:00:28.898 STEP: Destroying namespace "reboot-7736" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:00:28.898 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:00:28.942 (44ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:00:28.942 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:00:28.942 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sswitching\soff\sthe\snetwork\sinterface\sand\sensure\sthey\sfunction\supon\sswitch\son$'
[FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:35.618 There were additional failures detected after the initial failure. These are visible in the timelinefrom ginkgo_report.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:11:05.497 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:11:05.497 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:05.497 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:11:05.497 Jan 29 13:11:05.497: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:11:05.499 Jan 29 13:11:05.538: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:07.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:09.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:11.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:13.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:15.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:17.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:19.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:21.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:23.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:25.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:27.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:29.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:31.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:33.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.617: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.617: INFO: Unexpected error: <*errors.errorString | 0xc0000d1ca0>: { s: "timed out waiting for the condition", } [FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:35.618 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:35.618 (30.12s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:35.618 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:11:35.618 Jan 29 13:11:35.657: INFO: Unexpected error: <*url.Error | 0xc0046ac210>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc001564640>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0046ac1e0>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc001562a40>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:11:35.657 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:35.657 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:35.658 Jan 29 13:11:35.658: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:35.697 (40ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:35.697 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:35.697 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:35.697 (0s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:35.697 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:35.697 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:35.697 (0s) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:35.697 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:35.697 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\sswitching\soff\sthe\snetwork\sinterface\sand\sensure\sthey\sfunction\supon\sswitch\son$'
[FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:35.618 There were additional failures detected after the initial failure. These are visible in the timelinefrom junit_01.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:11:05.497 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:11:05.497 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:05.497 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:11:05.497 Jan 29 13:11:05.497: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:11:05.499 Jan 29 13:11:05.538: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:07.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:09.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:11.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:13.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:15.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:17.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:19.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:21.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:23.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:25.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:27.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:29.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:31.579: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:33.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.578: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.617: INFO: Unexpected error while creating namespace: Post "https://35.227.145.153/api/v1/namespaces": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:11:35.617: INFO: Unexpected error: <*errors.errorString | 0xc0000d1ca0>: { s: "timed out waiting for the condition", } [FAILED] timed out waiting for the condition In [BeforeEach] at: test/e2e/framework/framework.go:251 @ 01/29/23 13:11:35.618 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:11:35.618 (30.12s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:35.618 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:11:35.618 Jan 29 13:11:35.657: INFO: Unexpected error: <*url.Error | 0xc0046ac210>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc001564640>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0046ac1e0>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc001562a40>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:11:35.657 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:11:35.657 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:35.658 Jan 29 13:11:35.658: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:11:35.697 (40ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:35.697 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:35.697 END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:11:35.697 (0s) < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:11:35.697 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:35.697 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:11:35.697 (0s) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:35.697 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:11:35.697 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\striggering\skernel\spanic\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:10:35.054 There were additional failures detected after the initial failure. These are visible in the timelinefrom ginkgo_report.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:06:39.831 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:06:39.831 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:06:39.831 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:06:39.831 Jan 29 13:06:39.831: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:06:39.833 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 13:06:39.961 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 13:06:40.041 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:06:40.122 (291ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:06:40.122 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:06:40.122 (0s) > Enter [It] each node by triggering kernel panic and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:109 @ 01/29/23 13:06:40.122 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 13:06:40.260: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:06:40.288: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:06:40.288: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:06:40.302: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.302: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.302: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.303: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.303: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.331: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.331: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.345: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 42.171663ms Jan 29 13:06:40.345: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 45.355863ms Jan 29 13:06:40.348: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 45.038789ms Jan 29 13:06:40.348: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.348: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 13:06:40.348: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 13:06:40.377: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 46.750394ms Jan 29 13:06:40.377: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 47.080059ms Jan 29 13:06:40.378: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 47.239684ms Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.378: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 13:06:40.378: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 47.637471ms Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 47.919372ms Jan 29 13:06:40.378: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.378: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 13:06:40.378: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 13:06:40.872: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 13:06:40.888: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 13:06:40.896: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 13:06:40.914: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:40.930: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:40.937: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.959: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.973: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.980: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.016: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.023: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.044: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.060: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.065: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.086: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.103: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.108: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.129: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.145: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.149: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.188: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.192: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.215: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.234: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.239: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.277: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.298: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.320: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.324: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.341: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.362: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.366: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.384: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.405: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.408: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.425: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.449: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.450: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.467: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.494: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.494: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.523: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.539: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.539: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.572: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.583: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.583: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.615: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.627: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.627: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.658: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.670: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.670: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.702: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.714: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.714: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.759: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.760: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.804: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.804: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.830: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.847: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.847: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.873: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.917: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.935: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.935: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:29.961: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:07:29.980: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:07:29.980: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:30.002: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:30.022: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:32.023: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:32.049: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:32.065: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:34.083: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:07:34.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:34.108: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:34.125: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:36.134: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:36.151: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:36.168: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:38.177: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:38.193: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:38.210: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:40.219: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:40.237: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:40.254: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:42.263: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:42.278: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:42.296: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:44.307: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:44.321: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:44.338: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:46.350: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:46.364: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:46.380: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:48.393: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:48.406: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:48.423: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:50.437: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:50.450: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:50.466: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:52.479: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:52.492: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:52.509: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:54.527: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:54.536: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:54.552: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:56.570: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:56.578: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:56.595: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:58.613: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:58.621: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:58.638: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:00.658: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:00.664: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:00.682: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:02.701: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:02.706: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:02.727: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:04.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:04.750: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:04.770: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:06.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:06.794: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:06.812: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:08.829: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:08.836: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:08.855: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:10.873: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:10.881: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:10.942: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 44.007954ms Jan 29 13:08:10.942: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=false. Elapsed: 43.971671ms Jan 29 13:08:10.942: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'metadata-proxy-v0.1-5cfjp' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:01 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:10.942: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:31 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.919: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.973: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 43.17659ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:12.974: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=false. Elapsed: 43.069279ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-f6wf' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.974: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=false. Elapsed: 43.242918ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'metadata-proxy-v0.1-mfrhp' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:00 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.985: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 2.087000372s Jan 29 13:08:12.985: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:08:12.985: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 2.087155938s Jan 29 13:08:12.985: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:08:12.985: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:08:12.985: INFO: Reboot successful on node bootstrap-e2e-minion-group-cws9 Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:15.003: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 42.138795ms Jan 29 13:08:15.003: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 43.312708ms Jan 29 13:08:15.004: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 43.281879ms Jan 29 13:08:15.004: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:08:15.004: INFO: Reboot successful on node bootstrap-e2e-minion-group-ct19 Jan 29 13:08:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.086536462s Jan 29 13:08:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:15.017: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 2.086441303s Jan 29 13:08:15.017: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 2.086593105s Jan 29 13:08:15.017: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.017: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:08:17.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086646359s Jan 29 13:08:17.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:19.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 6.084802435s Jan 29 13:08:19.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:21.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 8.084779066s Jan 29 13:08:21.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:23.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 10.08532499s Jan 29 13:08:23.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:25.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 12.085622517s Jan 29 13:08:25.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:27.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 14.085302678s Jan 29 13:08:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 16.084632588s Jan 29 13:08:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:31.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 18.084810025s Jan 29 13:08:31.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:33.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 20.084766576s Jan 29 13:08:33.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:35.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 22.085143392s Jan 29 13:08:35.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:37.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 24.086421909s Jan 29 13:08:37.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:39.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 26.085050313s Jan 29 13:08:39.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:41.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 28.085548629s Jan 29 13:08:41.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:43.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 30.085379795s Jan 29 13:08:43.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:45.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 32.084812309s Jan 29 13:08:45.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:47.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 34.084554665s Jan 29 13:08:47.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:49.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 36.085006186s Jan 29 13:08:49.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:51.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 38.084764802s Jan 29 13:08:51.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:53.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 40.08494536s Jan 29 13:08:53.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:55.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 42.08647454s Jan 29 13:08:55.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:57.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 44.085474139s Jan 29 13:08:57.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:59.056: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 46.125869142s Jan 29 13:08:59.056: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:01.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 48.085668988s Jan 29 13:09:01.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:03.018: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 50.087315613s Jan 29 13:09:03.018: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:05.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 52.086314045s Jan 29 13:09:05.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:07.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 54.086429075s Jan 29 13:09:07.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:09.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 56.084843903s Jan 29 13:09:09.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:11.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 58.086116467s Jan 29 13:09:11.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:13.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.084840523s Jan 29 13:09:13.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.086348355s Jan 29 13:09:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:17.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.084884199s Jan 29 13:09:17.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:19.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.085936754s Jan 29 13:09:19.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:21.019: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.088416704s Jan 29 13:09:21.019: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:23.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.08533839s Jan 29 13:09:23.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:25.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.085771848s Jan 29 13:09:25.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:27.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.085180539s Jan 29 13:09:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.084362775s Jan 29 13:09:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:31.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.085438385s Jan 29 13:09:31.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:33.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.084975637s Jan 29 13:09:33.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:35.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.086149246s Jan 29 13:09:35.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:37.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.084668935s Jan 29 13:09:37.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:39.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.084537749s Jan 29 13:09:39.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:41.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.086079566s Jan 29 13:09:41.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:43.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.085225956s Jan 29 13:09:43.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:45.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.086483203s Jan 29 13:09:45.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:47.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.084819499s Jan 29 13:09:47.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:49.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.085373823s Jan 29 13:09:49.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:51.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.084389108s Jan 29 13:09:51.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:53.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.085520886s Jan 29 13:09:53.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:55.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.084605788s Jan 29 13:09:55.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:57.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.084768206s Jan 29 13:09:57.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:59.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.087168786s Jan 29 13:09:59.018: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:01.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.085978767s Jan 29 13:10:01.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:03.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.085436547s Jan 29 13:10:03.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:05.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.085568567s Jan 29 13:10:05.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:07.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.0855607s Jan 29 13:10:07.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:09.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.084563417s Jan 29 13:10:09.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:11.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.085939711s Jan 29 13:10:11.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:13.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.085378909s Jan 29 13:10:13.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.086445951s Jan 29 13:10:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:17.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.085489926s Jan 29 13:10:17.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:19.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.084315435s Jan 29 13:10:19.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:21.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.086316009s Jan 29 13:10:21.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:23.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.085148644s Jan 29 13:10:23.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:25.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.086413374s Jan 29 13:10:25.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:27.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.085725479s Jan 29 13:10:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.084628643s Jan 29 13:10:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:31.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.085566904s Jan 29 13:10:31.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:33.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.085396813s Jan 29 13:10:33.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:35.014: INFO: Encountered non-retryable error while getting pod kube-system/volume-snapshot-controller-0: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:35.014: INFO: Pod volume-snapshot-controller-0 failed to be running and ready, or succeeded. Jan 29 13:10:35.014: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: false. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:10:35.014: INFO: Status for not ready pod kube-system/volume-snapshot-controller-0: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 12:56:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 13:07:28 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-snapshot-controller]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 13:08:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-snapshot-controller]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 12:56:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.138.0.5 PodIP: PodIPs:[] StartTime:2023-01-29 12:56:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-snapshot-controller State:{Waiting:&ContainerStateWaiting{Reason:,Message:,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:7 Image:registry.k8s.io/sig-storage/snapshot-controller:v6.1.0 ImageID:registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 ContainerID:containerd://47724bf8c9f924334c76352af083757a035f12146ef79f91ca1ddad55967ff70 Started:0xc003d2228a}] QOSClass:BestEffort EphemeralContainerStatuses:[]} Jan 29 13:10:35.053: INFO: Retrieving log for container kube-system/volume-snapshot-controller-0/volume-snapshot-controller, err: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0/log?container=volume-snapshot-controller&previous=false": dial tcp 35.227.145.153:443: connect: connection refused: Jan 29 13:10:35.053: INFO: Retrieving log for the last terminated container kube-system/volume-snapshot-controller-0/volume-snapshot-controller, err: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0/log?container=volume-snapshot-controller&previous=false": dial tcp 35.227.145.153:443: connect: connection refused: Jan 29 13:10:35.053: INFO: Node bootstrap-e2e-minion-group-f6wf failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:10:35.054 < Exit [It] each node by triggering kernel panic and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:109 @ 01/29/23 13:10:35.054 (3m54.932s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:10:35.054 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:10:35.054 Jan 29 13:10:35.093: INFO: Unexpected error: <*url.Error | 0xc001b045d0>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc004370230>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0024e2a50>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc00524e120>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:10:35.093 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:10:35.093 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:10:35.093 Jan 29 13:10:35.093: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:10:35.133 (39ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:10:35.133 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:10:35.133 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:10:35.133 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:10:35.133 STEP: Collecting events from namespace "reboot-7883". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:10:35.133 Jan 29 13:10:35.172: INFO: Unexpected error: failed to list events in namespace "reboot-7883": <*url.Error | 0xc0024e2a80>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/reboot-7883/events", Err: <*net.OpError | 0xc003d1e370>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0015a3080>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc0014643c0>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:10:35.173 (40ms) [FAILED] failed to list events in namespace "reboot-7883": Get "https://35.227.145.153/api/v1/namespaces/reboot-7883/events": dial tcp 35.227.145.153:443: connect: connection refused In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44 @ 01/29/23 13:10:35.173 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:10:35.173 (40ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:10:35.173 STEP: Destroying namespace "reboot-7883" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:10:35.173 [FAILED] Couldn't delete ns: "reboot-7883": Delete "https://35.227.145.153/api/v1/namespaces/reboot-7883": dial tcp 35.227.145.153:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.227.145.153/api/v1/namespaces/reboot-7883", Err:(*net.OpError)(0xc004370460)}) In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:383 @ 01/29/23 13:10:35.213 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:10:35.213 (40ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:10:35.213 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:10:35.213 (0s)
Filter through log files
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cloud\-provider\-gcp\]\sReboot\s\[Disruptive\]\s\[Feature\:Reboot\]\seach\snode\sby\striggering\skernel\spanic\sand\sensure\sthey\sfunction\supon\srestart$'
[FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:10:35.054 There were additional failures detected after the initial failure. These are visible in the timelinefrom junit_01.xml
> Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:06:39.831 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:60 @ 01/29/23 13:06:39.831 (0s) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:06:39.831 STEP: Creating a kubernetes client - test/e2e/framework/framework.go:208 @ 01/29/23 13:06:39.831 Jan 29 13:06:39.831: INFO: >>> kubeConfig: /workspace/.kube/config STEP: Building a namespace api object, basename reboot - test/e2e/framework/framework.go:247 @ 01/29/23 13:06:39.833 STEP: Waiting for a default service account to be provisioned in namespace - test/e2e/framework/framework.go:256 @ 01/29/23 13:06:39.961 STEP: Waiting for kube-root-ca.crt to be provisioned in namespace - test/e2e/framework/framework.go:259 @ 01/29/23 13:06:40.041 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - set up framework | framework.go:188 @ 01/29/23 13:06:40.122 (291ms) > Enter [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:06:40.122 < Exit [BeforeEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:33 @ 01/29/23 13:06:40.122 (0s) > Enter [It] each node by triggering kernel panic and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:109 @ 01/29/23 13:06:40.122 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-ct19 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-cws9 Jan 29 13:06:40.217: INFO: Getting bootstrap-e2e-minion-group-f6wf Jan 29 13:06:40.260: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:06:40.288: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:06:40.288: INFO: Waiting up to 20s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:06:40.302: INFO: Node bootstrap-e2e-minion-group-ct19 has 3 assigned pods with no liveness probes: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.302: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.302: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.303: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.303: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Node bootstrap-e2e-minion-group-cws9 has 2 assigned pods with no liveness probes: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Node bootstrap-e2e-minion-group-f6wf has 3 assigned pods with no liveness probes: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.330: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.331: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.331: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:06:40.345: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 42.171663ms Jan 29 13:06:40.345: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 45.355863ms Jan 29 13:06:40.348: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 45.038789ms Jan 29 13:06:40.348: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.348: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:06:40.348: INFO: Getting external IP address for bootstrap-e2e-minion-group-ct19 Jan 29 13:06:40.348: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-ct19(34.83.193.65:22) Jan 29 13:06:40.377: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 46.750394ms Jan 29 13:06:40.377: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 47.080059ms Jan 29 13:06:40.378: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 47.239684ms Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:06:40.378: INFO: Getting external IP address for bootstrap-e2e-minion-group-cws9 Jan 29 13:06:40.378: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-cws9(35.233.152.110:22) Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 47.637471ms Jan 29 13:06:40.378: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Pod "volume-snapshot-controller-0": Phase="Running", Reason="", readiness=true. Elapsed: 47.919372ms Jan 29 13:06:40.378: INFO: Pod "volume-snapshot-controller-0" satisfied condition "running and ready, or succeeded" Jan 29 13:06:40.378: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:06:40.378: INFO: Getting external IP address for bootstrap-e2e-minion-group-f6wf Jan 29 13:06:40.378: INFO: SSH "nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 &" on bootstrap-e2e-minion-group-f6wf(34.82.79.46:22) Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: stdout: "" Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: stderr: "" Jan 29 13:06:40.872: INFO: ssh prow@34.83.193.65:22: exit code: 0 Jan 29 13:06:40.872: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be false Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: stdout: "" Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: stderr: "" Jan 29 13:06:40.888: INFO: ssh prow@34.82.79.46:22: exit code: 0 Jan 29 13:06:40.888: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be false Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: command: nohup sh -c 'echo 1 | sudo tee /proc/sys/kernel/sysrq && sleep 10 && echo c | sudo tee /proc/sysrq-trigger' >/dev/null 2>&1 & Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: stdout: "" Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: stderr: "" Jan 29 13:06:40.896: INFO: ssh prow@35.233.152.110:22: exit code: 0 Jan 29 13:06:40.896: INFO: Waiting up to 2m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be false Jan 29 13:06:40.914: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:40.930: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:40.937: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.959: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.973: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:42.980: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.001: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.016: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:45.023: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.044: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.060: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:47.065: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.086: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.103: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:49.108: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.129: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.145: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:51.149: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.172: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.188: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:53.192: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.215: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.234: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:55.239: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.257: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.277: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:57.281: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.298: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.320: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:06:59.324: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.341: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.362: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:01.366: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.384: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.405: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:03.408: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.425: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.449: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:05.450: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.467: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.494: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:07.494: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.523: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.539: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:09.539: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.572: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.583: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:11.583: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.615: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.627: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:13.627: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.658: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.670: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:15.670: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.702: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.714: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:17.714: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.759: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:19.760: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.804: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:21.804: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.830: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.847: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:23.847: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.873: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:25.892: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.917: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.935: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:27.935: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:29.961: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-ct19 condition Ready to be true Jan 29 13:07:29.980: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-f6wf condition Ready to be true Jan 29 13:07:29.980: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:30.002: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:30.022: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:32.023: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is true instead of false. Reason: KubeletReady, message: kubelet is posting ready status. AppArmor enabled Jan 29 13:07:32.049: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:32.065: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:34.083: INFO: Waiting up to 5m0s for node bootstrap-e2e-minion-group-cws9 condition Ready to be true Jan 29 13:07:34.091: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:34.108: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:34.125: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:36.134: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:36.151: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:36.168: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:38.177: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:38.193: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:38.210: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:40.219: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:40.237: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:40.254: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:42.263: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:42.278: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:42.296: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:44.307: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:44.321: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:44.338: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:46.350: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:46.364: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:46.380: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:48.393: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:48.406: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:48.423: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:50.437: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:50.450: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:50.466: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:52.479: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:52.492: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:52.509: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:54.527: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:54.536: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:54.552: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:56.570: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:56.578: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:56.595: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:58.613: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:07:58.621: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:07:58.638: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:00.658: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:00.664: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:00.682: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:02.701: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:02.706: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:02.727: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:04.745: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:04.750: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:04.770: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:06.788: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:06.794: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:06.812: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:08.829: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is false, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoSchedule 2023-01-29 13:07:28 +0000 UTC} {node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:08.836: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:08.855: INFO: Condition Ready of node bootstrap-e2e-minion-group-cws9 is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:10.873: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:10.881: INFO: Condition Ready of node bootstrap-e2e-minion-group-f6wf is false instead of true. Reason: NodeStatusUnknown, message: Kubelet stopped posting node status. Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for 2 pods to be running and ready, or succeeded: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-cws9" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:10.898: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-5cfjp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:10.942: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=false. Elapsed: 44.007954ms Jan 29 13:08:10.942: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=false. Elapsed: 43.971671ms Jan 29 13:08:10.942: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'metadata-proxy-v0.1-5cfjp' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:01 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:10.942: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-cws9' on 'bootstrap-e2e-minion-group-cws9' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:33 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:00:31 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.919: INFO: Condition Ready of node bootstrap-e2e-minion-group-ct19 is true, but Node is tainted by NodeController with [{node.kubernetes.io/unreachable NoExecute 2023-01-29 13:07:33 +0000 UTC}]. Failure Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "volume-snapshot-controller-0" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-mfrhp" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.930: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:12.973: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 43.17659ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:12.974: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=false. Elapsed: 43.069279ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'kube-proxy-bootstrap-e2e-minion-group-f6wf' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:44 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.974: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=false. Elapsed: 43.242918ms Jan 29 13:08:12.974: INFO: Error evaluating pod condition running and ready, or succeeded: pod 'metadata-proxy-v0.1-mfrhp' on 'bootstrap-e2e-minion-group-f6wf' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:59 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:07:28 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 13:04:00 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-29 12:55:58 +0000 UTC }] Jan 29 13:08:12.985: INFO: Pod "metadata-proxy-v0.1-5cfjp": Phase="Running", Reason="", readiness=true. Elapsed: 2.087000372s Jan 29 13:08:12.985: INFO: Pod "metadata-proxy-v0.1-5cfjp" satisfied condition "running and ready, or succeeded" Jan 29 13:08:12.985: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9": Phase="Running", Reason="", readiness=true. Elapsed: 2.087155938s Jan 29 13:08:12.985: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-cws9" satisfied condition "running and ready, or succeeded" Jan 29 13:08:12.985: INFO: Wanted all 2 pods to be running and ready, or succeeded. Result: true. Pods: [metadata-proxy-v0.1-5cfjp kube-proxy-bootstrap-e2e-minion-group-cws9] Jan 29 13:08:12.985: INFO: Reboot successful on node bootstrap-e2e-minion-group-cws9 Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for 3 pods to be running and ready, or succeeded: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "metadata-proxy-v0.1-rsxdm" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "kube-dns-autoscaler-5f6455f985-j7ht7" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:14.961: INFO: Waiting up to 5m0s for pod "kube-proxy-bootstrap-e2e-minion-group-ct19" in namespace "kube-system" to be "running and ready, or succeeded" Jan 29 13:08:15.003: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7": Phase="Running", Reason="", readiness=true. Elapsed: 42.138795ms Jan 29 13:08:15.003: INFO: Pod "kube-dns-autoscaler-5f6455f985-j7ht7" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Pod "metadata-proxy-v0.1-rsxdm": Phase="Running", Reason="", readiness=true. Elapsed: 43.312708ms Jan 29 13:08:15.004: INFO: Pod "metadata-proxy-v0.1-rsxdm" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19": Phase="Running", Reason="", readiness=true. Elapsed: 43.281879ms Jan 29 13:08:15.004: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-ct19" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.004: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: true. Pods: [kube-dns-autoscaler-5f6455f985-j7ht7 kube-proxy-bootstrap-e2e-minion-group-ct19 metadata-proxy-v0.1-rsxdm] Jan 29 13:08:15.004: INFO: Reboot successful on node bootstrap-e2e-minion-group-ct19 Jan 29 13:08:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2.086536462s Jan 29 13:08:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:15.017: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf": Phase="Running", Reason="", readiness=true. Elapsed: 2.086441303s Jan 29 13:08:15.017: INFO: Pod "metadata-proxy-v0.1-mfrhp": Phase="Running", Reason="", readiness=true. Elapsed: 2.086593105s Jan 29 13:08:15.017: INFO: Pod "kube-proxy-bootstrap-e2e-minion-group-f6wf" satisfied condition "running and ready, or succeeded" Jan 29 13:08:15.017: INFO: Pod "metadata-proxy-v0.1-mfrhp" satisfied condition "running and ready, or succeeded" Jan 29 13:08:17.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 4.086646359s Jan 29 13:08:17.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:19.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 6.084802435s Jan 29 13:08:19.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:21.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 8.084779066s Jan 29 13:08:21.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:23.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 10.08532499s Jan 29 13:08:23.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:25.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 12.085622517s Jan 29 13:08:25.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:27.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 14.085302678s Jan 29 13:08:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 16.084632588s Jan 29 13:08:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:31.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 18.084810025s Jan 29 13:08:31.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:33.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 20.084766576s Jan 29 13:08:33.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:35.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 22.085143392s Jan 29 13:08:35.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:37.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 24.086421909s Jan 29 13:08:37.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:39.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 26.085050313s Jan 29 13:08:39.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:41.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 28.085548629s Jan 29 13:08:41.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:43.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 30.085379795s Jan 29 13:08:43.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:45.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 32.084812309s Jan 29 13:08:45.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:47.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 34.084554665s Jan 29 13:08:47.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:49.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 36.085006186s Jan 29 13:08:49.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:51.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 38.084764802s Jan 29 13:08:51.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:53.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 40.08494536s Jan 29 13:08:53.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:55.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 42.08647454s Jan 29 13:08:55.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:57.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 44.085474139s Jan 29 13:08:57.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:08:59.056: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 46.125869142s Jan 29 13:08:59.056: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:01.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 48.085668988s Jan 29 13:09:01.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:03.018: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 50.087315613s Jan 29 13:09:03.018: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:05.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 52.086314045s Jan 29 13:09:05.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:07.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 54.086429075s Jan 29 13:09:07.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:09.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 56.084843903s Jan 29 13:09:09.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:11.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 58.086116467s Jan 29 13:09:11.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:13.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.084840523s Jan 29 13:09:13.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.086348355s Jan 29 13:09:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:17.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.084884199s Jan 29 13:09:17.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:19.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.085936754s Jan 29 13:09:19.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:21.019: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.088416704s Jan 29 13:09:21.019: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:23.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.08533839s Jan 29 13:09:23.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:25.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.085771848s Jan 29 13:09:25.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:27.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.085180539s Jan 29 13:09:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.084362775s Jan 29 13:09:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:31.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.085438385s Jan 29 13:09:31.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:33.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.084975637s Jan 29 13:09:33.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:35.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.086149246s Jan 29 13:09:35.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:37.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.084668935s Jan 29 13:09:37.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:39.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.084537749s Jan 29 13:09:39.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:41.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.086079566s Jan 29 13:09:41.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:43.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.085225956s Jan 29 13:09:43.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:45.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.086483203s Jan 29 13:09:45.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:47.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.084819499s Jan 29 13:09:47.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:49.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.085373823s Jan 29 13:09:49.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:51.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.084389108s Jan 29 13:09:51.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:53.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.085520886s Jan 29 13:09:53.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:55.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.084605788s Jan 29 13:09:55.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:57.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.084768206s Jan 29 13:09:57.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:09:59.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.087168786s Jan 29 13:09:59.018: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:01.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.085978767s Jan 29 13:10:01.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:03.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.085436547s Jan 29 13:10:03.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:05.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.085568567s Jan 29 13:10:05.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:07.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.0855607s Jan 29 13:10:07.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:09.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.084563417s Jan 29 13:10:09.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:11.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.085939711s Jan 29 13:10:11.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:13.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.085378909s Jan 29 13:10:13.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:15.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.086445951s Jan 29 13:10:15.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:17.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.085489926s Jan 29 13:10:17.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:19.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.084315435s Jan 29 13:10:19.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:21.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.086316009s Jan 29 13:10:21.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:23.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.085148644s Jan 29 13:10:23.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:25.017: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.086413374s Jan 29 13:10:25.017: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:27.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.085725479s Jan 29 13:10:27.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:29.015: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.084628643s Jan 29 13:10:29.015: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:31.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.085566904s Jan 29 13:10:31.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:33.016: INFO: Pod "volume-snapshot-controller-0": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.085396813s Jan 29 13:10:33.016: INFO: Error evaluating pod condition running and ready, or succeeded: want pod 'volume-snapshot-controller-0' on 'bootstrap-e2e-minion-group-f6wf' to be 'Running' but was 'Pending' Jan 29 13:10:35.014: INFO: Encountered non-retryable error while getting pod kube-system/volume-snapshot-controller-0: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0": dial tcp 35.227.145.153:443: connect: connection refused Jan 29 13:10:35.014: INFO: Pod volume-snapshot-controller-0 failed to be running and ready, or succeeded. Jan 29 13:10:35.014: INFO: Wanted all 3 pods to be running and ready, or succeeded. Result: false. Pods: [kube-proxy-bootstrap-e2e-minion-group-f6wf metadata-proxy-v0.1-mfrhp volume-snapshot-controller-0] Jan 29 13:10:35.014: INFO: Status for not ready pod kube-system/volume-snapshot-controller-0: {Phase:Pending Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 12:56:16 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 13:07:28 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-snapshot-controller]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 13:08:11 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [volume-snapshot-controller]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-29 12:56:16 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:10.138.0.5 PodIP: PodIPs:[] StartTime:2023-01-29 12:56:16 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:volume-snapshot-controller State:{Waiting:&ContainerStateWaiting{Reason:,Message:,} Running:nil Terminated:nil} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:7 Image:registry.k8s.io/sig-storage/snapshot-controller:v6.1.0 ImageID:registry.k8s.io/sig-storage/snapshot-controller@sha256:823c75d0c45d1427f6d850070956d9ca657140a7bbf828381541d1d808475280 ContainerID:containerd://47724bf8c9f924334c76352af083757a035f12146ef79f91ca1ddad55967ff70 Started:0xc003d2228a}] QOSClass:BestEffort EphemeralContainerStatuses:[]} Jan 29 13:10:35.053: INFO: Retrieving log for container kube-system/volume-snapshot-controller-0/volume-snapshot-controller, err: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0/log?container=volume-snapshot-controller&previous=false": dial tcp 35.227.145.153:443: connect: connection refused: Jan 29 13:10:35.053: INFO: Retrieving log for the last terminated container kube-system/volume-snapshot-controller-0/volume-snapshot-controller, err: Get "https://35.227.145.153/api/v1/namespaces/kube-system/pods/volume-snapshot-controller-0/log?container=volume-snapshot-controller&previous=false": dial tcp 35.227.145.153:443: connect: connection refused: Jan 29 13:10:35.053: INFO: Node bootstrap-e2e-minion-group-f6wf failed reboot test. [FAILED] Test failed; at least one node failed to reboot in the time given. In [It] at: test/e2e/cloud/gcp/reboot.go:190 @ 01/29/23 13:10:35.054 < Exit [It] each node by triggering kernel panic and ensure they function upon restart - test/e2e/cloud/gcp/reboot.go:109 @ 01/29/23 13:10:35.054 (3m54.932s) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:10:35.054 STEP: Collecting events from namespace "kube-system". - test/e2e/cloud/gcp/reboot.go:73 @ 01/29/23 13:10:35.054 Jan 29 13:10:35.093: INFO: Unexpected error: <*url.Error | 0xc001b045d0>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/kube-system/events", Err: <*net.OpError | 0xc004370230>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0024e2a50>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc00524e120>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } [FAILED] Get "https://35.227.145.153/api/v1/namespaces/kube-system/events": dial tcp 35.227.145.153:443: connect: connection refused In [AfterEach] at: test/e2e/cloud/gcp/reboot.go:75 @ 01/29/23 13:10:35.093 < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/cloud/gcp/reboot.go:68 @ 01/29/23 13:10:35.093 (40ms) > Enter [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:10:35.093 Jan 29 13:10:35.093: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready < Exit [AfterEach] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/node/init/init.go:33 @ 01/29/23 13:10:35.133 (39ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:10:35.133 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - test/e2e/framework/metrics/init/init.go:35 @ 01/29/23 13:10:35.133 (0s) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:10:35.133 STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:10:35.133 STEP: Collecting events from namespace "reboot-7883". - test/e2e/framework/debug/dump.go:42 @ 01/29/23 13:10:35.133 Jan 29 13:10:35.172: INFO: Unexpected error: failed to list events in namespace "reboot-7883": <*url.Error | 0xc0024e2a80>: { Op: "Get", URL: "https://35.227.145.153/api/v1/namespaces/reboot-7883/events", Err: <*net.OpError | 0xc003d1e370>{ Op: "dial", Net: "tcp", Source: nil, Addr: <*net.TCPAddr | 0xc0015a3080>{ IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 227, 145, 153], Port: 443, Zone: "", }, Err: <*os.SyscallError | 0xc0014643c0>{ Syscall: "connect", Err: <syscall.Errno>0x6f, }, }, } END STEP: dump namespace information after failure - test/e2e/framework/framework.go:284 @ 01/29/23 13:10:35.173 (40ms) [FAILED] failed to list events in namespace "reboot-7883": Get "https://35.227.145.153/api/v1/namespaces/reboot-7883/events": dial tcp 35.227.145.153:443: connect: connection refused In [DeferCleanup (Each)] at: test/e2e/framework/debug/dump.go:44 @ 01/29/23 13:10:35.173 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - dump namespaces | framework.go:206 @ 01/29/23 13:10:35.173 (40ms) > Enter [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:10:35.173 STEP: Destroying namespace "reboot-7883" for this suite. - test/e2e/framework/framework.go:347 @ 01/29/23 13:10:35.173 [FAILED] Couldn't delete ns: "reboot-7883": Delete "https://35.227.145.153/api/v1/namespaces/reboot-7883": dial tcp 35.227.145.153:443: connect: connection refused (&url.Error{Op:"Delete", URL:"https://35.227.145.153/api/v1/namespaces/reboot-7883", Err:(*net.OpError)(0xc004370460)}) In [DeferCleanup (Each)] at: test/e2e/framework/framework.go:383 @ 01/29/23 13:10:35.213 < Exit [DeferCleanup (Each)] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] - tear down framework | framework.go:203 @ 01/29/23 13:10:35.213 (40ms) > Enter [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:10:35.213 < Exit [ReportAfterEach] TOP-LEVEL - test/e2e/e2e_test.go:144 @ 01/29/23 13:10:35.213 (0s)
Filter through log files
error during ./hack/ginkgo-e2e.sh --ginkgo.focus=\[Feature:Reboot\] --minStartupPods=8 --report-dir=/workspace/_artifacts --disable-log-dump=true: exit status 1
from junit_runner.xml
Filter through log files
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] each node by dropping all outbound packets for a while and ensure they function afterwards
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Reboot [Disruptive] [Feature:Reboot] each node by dropping all outbound packets for a while and ensure they function afterwards
Kubernetes e2e suite [ReportAfterSuite] Kubernetes e2e JUnit report
Kubernetes e2e suite [ReportAfterSuite] Kubernetes e2e suite report
Kubernetes e2e suite [ReportAfterSuite] Kubernetes e2e suite report
Kubernetes e2e suite [ReportBeforeSuite]
Kubernetes e2e suite [ReportBeforeSuite]
Kubernetes e2e suite [SynchronizedAfterSuite]
Kubernetes e2e suite [SynchronizedAfterSuite]
Kubernetes e2e suite [SynchronizedBeforeSuite]
Kubernetes e2e suite [SynchronizedBeforeSuite]
kubetest Check APIReachability
kubetest Deferred TearDown
kubetest DumpClusterLogs
kubetest Extract
kubetest GetDeployer
kubetest IsUp
kubetest Prepare
kubetest TearDown
kubetest TearDown Previous
kubetest Timeout
kubetest Up
kubetest diffResources
kubetest kubectl version
kubetest list nodes
kubetest listResources After
kubetest listResources Before
kubetest listResources Down
kubetest listResources Up
kubetest test setup
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can be classified by adding FlowSchema and PriorityLevelConfiguration
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can be classified by adding FlowSchema and PriorityLevelConfiguration
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can't be drowned out (fairness)
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can't be drowned out (fairness)
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can't be drowned out (priority)
Kubernetes e2e suite [It] [sig-api-machinery] API priority and fairness should ensure that requests can't be drowned out (priority)
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing mutating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] listing validating webhooks should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a mutating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] patching/updating a validating webhook should work [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny attaching pod [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny custom resource creation, update and deletion [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should be able to deny pod and configmap creation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should deny crd creation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should honor timeout [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should include webhook resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate configmap [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with different stored version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate custom resource with pruning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should mutate pod and apply defaults after mutation [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should not be able to mutate or prevent deletion of webhook configuration objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin] should unconditionally reject operations on fail closed webhook [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Aggregator Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert from CR v1 to CR v2 [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition Watch [Privileged:ClusterAdmin] CustomResourceDefinition Watch watch on custom resource definition objects [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition creating/deleting custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition getting/updating/patching custom resource definition status sub-resource works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] Simple CustomResourceDefinition listing custom resource definition objects works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] custom resource defaulting for requests and from storage works [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceDefinition resources [Privileged:ClusterAdmin] should include custom resource definition resources in discovery documents [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] [Flaky] kubectl explain works for CR with the same resource name as built-in object.
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] [Flaky] kubectl explain works for CR with the same resource name as built-in object.
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] removes definition from spec when one version gets changed to not be served [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] updates the published spec when one version gets renamed [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields at the schema root [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields at the schema root [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD preserving unknown fields in an embedded object [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD with validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD with validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD without validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for CRD without validation schema [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of different groups [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group and version but different kinds [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group but different versions [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourcePublishOpenAPI [Privileged:ClusterAdmin] works for multiple CRDs of same group but different versions [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST NOT fail validation for create of a custom resource that satisfies the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST NOT fail validation for create of a custom resource that satisfies the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains a x-kubernetes-validations rule that refers to a property that do not exist
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains a x-kubernetes-validations rule that refers to a property that do not exist
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that contains a syntax error
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that contains a syntax error
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that exceeds the estimated cost limit
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource definition that contains an x-kubernetes-validations rule that exceeds the estimated cost limit
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource that exceeds the runtime cost limit for x-kubernetes-validations rule execution
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail create of a custom resource that exceeds the runtime cost limit for x-kubernetes-validations rule execution
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail update of a custom resource that does not satisfy a x-kubernetes-validations transition rule
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail update of a custom resource that does not satisfy a x-kubernetes-validations transition rule
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail validation for create of a custom resource that does not satisfy the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceValidationRules [Privileged:ClusterAdmin] MUST fail validation for create of a custom resource that does not satisfy the x-kubernetes-validations rules
Kubernetes e2e suite [It] [sig-api-machinery] Discovery Custom resource should have storage version hash
Kubernetes e2e suite [It] [sig-api-machinery] Discovery Custom resource should have storage version hash
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should accurately determine present and missing resources
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should accurately determine present and missing resources
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Discovery should validate PreferredVersion for each APIGroup [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Etcd failure [Disruptive] should recover from SIGKILL
Kubernetes e2e suite [It] [sig-api-machinery] Etcd failure [Disruptive] should recover from SIGKILL
Kubernetes e2e suite [It] [sig-api-machinery] Etcd failure [Disruptive] should recover from network partition with master
Kubernetes e2e suite [It] [sig-api-machinery] Etcd failure [Disruptive] should recover from network partition with master
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply an invalid CR with extra properties for CRD with validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should create/apply an invalid CR with extra properties for CRD with validation schema
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect duplicates in a CR when preserving unknown fields
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect duplicates in a CR when preserving unknown fields
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown and duplicate fields of a typed object
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown and duplicate fields of a typed object
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [It] [sig-api-machinery] FieldValidation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete RS created by deployment when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete jobs and pods created by cronjob
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should delete pods created by rc when not orphaning [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should keep the rc around until all its pods are deleted if the deleteOptions says so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not be blocked by dependency circle [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should not delete dependents that have both valid owner and owner that's waiting for dependents to be deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan RS created by deployment when deleteOptions.PropagationPolicy is Orphan [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if delete options say so [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should orphan pods created by rc if deleteOptions.OrphanDependents is nil
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support cascading deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support cascading deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support orphan deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Garbage collector should support orphan deletion of custom resources
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create v1 cronJobs, delete cronJobs, watch cronJobs
Kubernetes e2e suite [It] [sig-api-machinery] Generated clientset should create v1 cronJobs, delete cronJobs, watch cronJobs
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should always delete fast (ALL of 100 namespaces in 150 seconds) [Feature:ComprehensiveNamespaceDraining]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should always delete fast (ALL of 100 namespaces in 150 seconds) [Feature:ComprehensiveNamespaceDraining]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply a finalizer to a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply a finalizer to a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply an update to a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply an update to a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply changes to a namespace status [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should apply changes to a namespace status [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should delete fast enough (90 percent of 100 namespaces in 150 seconds)
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should delete fast enough (90 percent of 100 namespaces in 150 seconds)
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should ensure that all pods are removed when a namespace is deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should ensure that all pods are removed when a namespace is deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should ensure that all services are removed when a namespace is deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should ensure that all services are removed when a namespace is deleted [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should patch a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Namespaces [Serial] should patch a Namespace [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's multiple priority class scope (quota set to pod count: 2) against 2 pods with same priority classes.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's multiple priority class scope (quota set to pod count: 2) against 2 pods with same priority classes.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (cpu, memory quota set) against a pod with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (cpu, memory quota set) against a pod with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against 2 pods with different priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against 2 pods with different priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against 2 pods with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against 2 pods with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with different priority class (ScopeSelectorOpExists).
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with different priority class (ScopeSelectorOpExists).
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with different priority class (ScopeSelectorOpNotIn).
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with different priority class (ScopeSelectorOpNotIn).
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:PodPriority] should verify ResourceQuota's priority class scope (quota set to pod count: 1) against a pod with same priority class.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with best effort scope using scope-selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with best effort scope using scope-selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with terminating scopes through scope selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota [Feature:ScopeSelectors] should verify ResourceQuota with terminating scopes through scope selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should apply changes to a resourcequota status [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should apply changes to a resourcequota status [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should be able to update and delete ResourceQuota. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a configMap. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a custom resource.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a custom resource.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a persistent volume claim with a storage class
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a pod. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replica set. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a replication controller. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a secret. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a service. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and capture the life of a service. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and ensure its status is promptly calculated. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should create a ResourceQuota and ensure its status is promptly calculated. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should manage the lifecycle of a ResourceQuota [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should manage the lifecycle of a ResourceQuota [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with best effort scope. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with cross namespace pod affinity scope using scope-selectors.
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] ResourceQuota should verify ResourceQuota with terminating scopes. [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout default timeout should be used if the specified timeout in the request URL is 0s
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout default timeout should be used if the specified timeout in the request URL is 0s
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout should return HTTP status code 400 if the user specifies an invalid timeout in the request URL
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed
Kubernetes e2e suite [It] [sig-api-machinery] Server request timeout the request should be served with a default timeout if the specified timeout in the request URL exceeds maximum allowed
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should create an applied object if it does not already exist
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should create an applied object if it does not already exist
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should give up ownership of a field if forced applied by a controller
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should give up ownership of a field if forced applied by a controller
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should ignore conflict errors if force apply is used
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should ignore conflict errors if force apply is used
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should not remove a field if an owner unsets the field but other managers still have ownership of the field
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should not remove a field if an owner unsets the field but other managers still have ownership of the field
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should remove a field if it is owned but removed in the apply request
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for CRDs
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for CRDs
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for subresources
Kubernetes e2e suite [It] [sig-api-machinery] ServerSideApply should work for subresources
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for API chunking should return chunks of results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for API chunking should return chunks of results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for API chunking should support continue listing from the last key if the original version has been compacted away, though the list is inconsistent [Slow]
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for API chunking should support continue listing from the last key if the original version has been compacted away, though the list is inconsistent [Slow]
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return a 406 for a backend which does not implement metadata [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return chunks of table results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return chunks of table results for list calls
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return generic metadata details across all namespaces for nodes
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return generic metadata details across all namespaces for nodes
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return pod details
Kubernetes e2e suite [It] [sig-api-machinery] Servers with support for Table transformation should return pod details
Kubernetes e2e suite [It] [sig-api-machinery] StorageVersion resources [Feature:StorageVersionAPI] storage version with non-existing id should be GC'ed
Kubernetes e2e suite [It] [sig-api-machinery] StorageVersion resources [Feature:StorageVersionAPI] storage version with non-existing id should be GC'ed
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to restart watching from the last resource version observed by the previous watch [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should be able to start watching from a specific resource version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe add, update, and delete watch notifications on configmaps [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe add, update, and delete watch notifications on configmaps [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should observe an object deletion if it stops meeting the requirements of the selector [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] Watchers should receive events on concurrent watches in same order [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json,application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/json,application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf,application/json"
Kubernetes e2e suite [It] [sig-api-machinery] client-go should negotiate watch and report errors with accept "application/vnd.kubernetes.protobuf,application/json"
Kubernetes e2e suite [It] [sig-api-machinery] health handlers should contain necessary checks
Kubernetes e2e suite [It] [sig-api-machinery] health handlers should contain necessary checks
Kubernetes e2e suite [It] [sig-api-machinery] kube-apiserver identity [Feature:APIServerIdentity] kube-apiserver identity should persist after restart [Disruptive]
Kubernetes e2e suite [It] [sig-api-machinery] kube-apiserver identity [Feature:APIServerIdentity] kube-apiserver identity should persist after restart [Disruptive]
Kubernetes e2e suite [It] [sig-api-machinery] server version should find the server version [Conformance]
Kubernetes e2e suite [It] [sig-api-machinery] server version should find the server version [Conformance]
Kubernetes e2e suite [It] [sig-apps] ControllerRevision [Serial] should manage the lifecycle of a ControllerRevision [Conformance]
Kubernetes e2e suite [It] [sig-apps] ControllerRevision [Serial] should manage the lifecycle of a ControllerRevision [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should be able to schedule after more than 100 missed schedule
Kubernetes e2e suite [It] [sig-apps] CronJob should be able to schedule after more than 100 missed schedule
Kubernetes e2e suite [It] [sig-apps] CronJob should delete failed finished jobs with limit of one job
Kubernetes e2e suite [It] [sig-apps] CronJob should delete failed finished jobs with limit of one job
Kubernetes e2e suite [It] [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [It] [sig-apps] CronJob should delete successful finished jobs with limit of one successful job
Kubernetes e2e suite [It] [sig-apps] CronJob should not emit unexpected warnings
Kubernetes e2e suite [It] [sig-apps] CronJob should not emit unexpected warnings
Kubernetes e2e suite [It] [sig-apps] CronJob should not schedule jobs when suspended [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should not schedule jobs when suspended [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should not schedule new jobs when ForbidConcurrent [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should not schedule new jobs when ForbidConcurrent [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should remove from active list jobs that have been deleted
Kubernetes e2e suite [It] [sig-apps] CronJob should remove from active list jobs that have been deleted
Kubernetes e2e suite [It] [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should replace jobs when ReplaceConcurrent [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should schedule multiple jobs concurrently [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should schedule multiple jobs concurrently [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should support CronJob API operations [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should support CronJob API operations [Conformance]
Kubernetes e2e suite [It] [sig-apps] CronJob should support timezone
Kubernetes e2e suite [It] [sig-apps] CronJob should support timezone
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should list and delete a collection of DaemonSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should list and delete a collection of DaemonSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should not update pod when spec was updated and update strategy is OnDelete
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should not update pod when spec was updated and update strategy is OnDelete
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should retry creating failed daemon pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should retry creating failed daemon pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop complex daemon [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop complex daemon [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop complex daemon with node affinity
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop complex daemon with node affinity
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop simple daemon [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should run and stop simple daemon [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should surge pods onto nodes when spec was updated and update strategy is RollingUpdate
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should surge pods onto nodes when spec was updated and update strategy is RollingUpdate
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should update pod when spec was updated and update strategy is RollingUpdate [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should verify changes to a daemon set status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Daemon set [Serial] should verify changes to a daemon set status [Conformance]
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Controller Manager should not create/delete replicas across restart
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Controller Manager should not create/delete replicas across restart
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Kube-proxy should recover after being killed accidentally
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Kube-proxy should recover after being killed accidentally
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Kubelet should not restart containers across restart
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Kubelet should not restart containers across restart
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Scheduler should continue assigning pods to nodes across restart
Kubernetes e2e suite [It] [sig-apps] DaemonRestart [Disruptive] Scheduler should continue assigning pods to nodes across restart
Kubernetes e2e suite [It] [sig-apps] Deployment Deployment should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment Deployment should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RecreateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment RollingUpdateDeployment should delete old pods and create new ones [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods
Kubernetes e2e suite [It] [sig-apps] Deployment deployment reaping should cascade to its replica sets and pods
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should delete old replica sets [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should delete old replica sets [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support proportional scaling [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support proportional scaling [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support rollover [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment deployment should support rollover [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment iterative rollouts should eventually progress
Kubernetes e2e suite [It] [sig-apps] Deployment iterative rollouts should eventually progress
Kubernetes e2e suite [It] [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout
Kubernetes e2e suite [It] [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout
Kubernetes e2e suite [It] [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment should run the lifecycle of a Deployment [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment should validate Deployment Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment should validate Deployment Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] Deployment test Deployment ReplicaSet orphaning and adoption regarding controllerRef
Kubernetes e2e suite [It] [sig-apps] Deployment test Deployment ReplicaSet orphaning and adoption regarding controllerRef
Kubernetes e2e suite [It] [sig-apps] DisruptionController Listing PodDisruptionBudgets for all namespaces should list and delete a collection of PodDisruptionBudgets [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController Listing PodDisruptionBudgets for all namespaces should list and delete a collection of PodDisruptionBudgets [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, absolute => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, absolute => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, replicaSet, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: enough pods, replicaSet, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: maxUnavailable allow single eviction, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: maxUnavailable allow single eviction, percentage => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: maxUnavailable deny evictions, integer => should not allow an eviction [Serial]
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: maxUnavailable deny evictions, integer => should not allow an eviction [Serial]
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: no PDB => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: no PDB => should allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: too few pods, absolute => should not allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: too few pods, absolute => should not allow an eviction
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: too few pods, replicaSet, percentage => should not allow an eviction [Serial]
Kubernetes e2e suite [It] [sig-apps] DisruptionController evictions: too few pods, replicaSet, percentage => should not allow an eviction [Serial]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should block an eviction until the PDB is updated to allow it [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should create a PodDisruptionBudget [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe PodDisruptionBudget status updated [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods
Kubernetes e2e suite [It] [sig-apps] DisruptionController should observe that the PodDisruptionBudget status is not updated for unmanaged pods
Kubernetes e2e suite [It] [sig-apps] DisruptionController should update/patch PodDisruptionBudget status [Conformance]
Kubernetes e2e suite [It] [sig-apps] DisruptionController should update/patch PodDisruptionBudget status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job Using a pod failure policy to not count some failures towards the backoffLimit Ignore DisruptionTarget condition
Kubernetes e2e suite [It] [sig-apps] Job Using a pod failure policy to not count some failures towards the backoffLimit Ignore DisruptionTarget condition
Kubernetes e2e suite [It] [sig-apps] Job Using a pod failure policy to not count some failures towards the backoffLimit Ignore exit code 137
Kubernetes e2e suite [It] [sig-apps] Job Using a pod failure policy to not count some failures towards the backoffLimit Ignore exit code 137
Kubernetes e2e suite [It] [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should adopt matching orphans and release non-matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should allow to use the pod failure policy on exit code to fail the job early
Kubernetes e2e suite [It] [sig-apps] Job should allow to use the pod failure policy on exit code to fail the job early
Kubernetes e2e suite [It] [sig-apps] Job should allow to use the pod failure policy to not count the failure towards the backoffLimit
Kubernetes e2e suite [It] [sig-apps] Job should allow to use the pod failure policy to not count the failure towards the backoffLimit
Kubernetes e2e suite [It] [sig-apps] Job should apply changes to a job status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should apply changes to a job status [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should create pods for an Indexed job with completion indexes and specified hostname [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should create pods for an Indexed job with completion indexes and specified hostname [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should delete a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should delete a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should delete pods when suspended
Kubernetes e2e suite [It] [sig-apps] Job should delete pods when suspended
Kubernetes e2e suite [It] [sig-apps] Job should fail to exceed backoffLimit
Kubernetes e2e suite [It] [sig-apps] Job should fail to exceed backoffLimit
Kubernetes e2e suite [It] [sig-apps] Job should fail when exceeds active deadline
Kubernetes e2e suite [It] [sig-apps] Job should fail when exceeds active deadline
Kubernetes e2e suite [It] [sig-apps] Job should manage the lifecycle of a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should manage the lifecycle of a job [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should not create pods when created in suspend state
Kubernetes e2e suite [It] [sig-apps] Job should not create pods when created in suspend state
Kubernetes e2e suite [It] [sig-apps] Job should remove pods when job is deleted
Kubernetes e2e suite [It] [sig-apps] Job should remove pods when job is deleted
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are locally restarted [Conformance]
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks sometimes fail and are not locally restarted
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks succeed
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion when tasks succeed
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion with CPU requests [Serial]
Kubernetes e2e suite [It] [sig-apps] Job should run a job to completion with CPU requests [Serial]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replace and Patch tests [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replace and Patch tests [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replicaset should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet Replicaset should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should adopt matching pods on creation and release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should serve a basic image on each replica with a private image
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should serve a basic image on each replica with a private image
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should surface a failure condition on a common issue like exceeded quota
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should surface a failure condition on a common issue like exceeded quota
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicaSet should validate Replicaset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should adopt matching pods on creation [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should get and update a ReplicationController scale [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should get and update a ReplicationController scale [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should release no longer matching pods [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a private image
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a private image
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should surface a failure condition on a common issue like exceeded quota [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should surface a failure condition on a common issue like exceeded quota [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should test the lifecycle of a ReplicationController [Conformance]
Kubernetes e2e suite [It] [sig-apps] ReplicationController should test the lifecycle of a ReplicationController [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet AvailableReplicas should get updated accordingly when MinReadySeconds is enabled
Kubernetes e2e suite [It] [sig-apps] StatefulSet AvailableReplicas should get updated accordingly when MinReadySeconds is enabled
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Burst scaling should run to completion even with unhealthy pods [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Scaling should happen in predictable order and halt if any stateful pod is unhealthy [Slow] [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] Should recreate evicted statefulset [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should adopt matching orphans and release non-matching pods
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should adopt matching orphans and release non-matching pods
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should have a working scale subresource [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should list, patch and delete a collection of StatefulSets [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should not deadlock when a pod's predecessor fails
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should not deadlock when a pod's predecessor fails
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform canary updates and phased rolling updates of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications with PVCs
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should perform rolling updates and roll backs of template modifications with PVCs
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should provide basic identity
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should provide basic identity
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should validate Statefulset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should validate Statefulset Status endpoints [Conformance]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working CockroachDB cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working CockroachDB cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working mysql cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working mysql cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working redis cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working redis cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working zookeeper cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet Deploy clustered applications [Feature:StatefulSet] [Slow] should creating a working zookeeper cluster
Kubernetes e2e suite [It] [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [It] [sig-apps] StatefulSet MinReadySeconds should be honored when enabled
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs after adopting pod (WhenDeleted)
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs after adopting pod (WhenDeleted)
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs after adopting pod (WhenScaled) [Feature:StatefulSetAutoDeletePVC]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs after adopting pod (WhenScaled) [Feature:StatefulSetAutoDeletePVC]
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a OnScaledown policy
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a OnScaledown policy
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a WhenDeleted policy
Kubernetes e2e suite [It] [sig-apps] StatefulSet Non-retain StatefulSetPersistentVolumeClaimPolicy [Feature:StatefulSetAutoDeletePVC] should delete PVCs with a WhenDeleted policy
Kubernetes e2e suite [It] [sig-apps] TTLAfterFinished job should be deleted once it finishes after TTL seconds
Kubernetes e2e suite [It] [sig-apps] TTLAfterFinished job should be deleted once it finishes after TTL seconds
Kubernetes e2e suite [It] [sig-apps] stateful Upgrade [Feature:StatefulUpgrade] stateful upgrade should maintain a functioning cluster
Kubernetes e2e suite [It] [sig-apps] stateful Upgrade [Feature:StatefulUpgrade] stateful upgrade should maintain a functioning cluster
Kubernetes e2e suite [It] [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
Kubernetes e2e suite [It] [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support CSR API operations [Conformance]
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support building a client with a CSR
Kubernetes e2e suite [It] [sig-auth] Certificates API [Privileged:ClusterAdmin] should support building a client with a CSR
Kubernetes e2e suite [It] [sig-auth] SelfSubjectReview [Feature:APISelfSubjectReview] should support SelfSubjectReview API operations
Kubernetes e2e suite [It] [sig-auth] SelfSubjectReview [Feature:APISelfSubjectReview] should support SelfSubjectReview API operations
Kubernetes e2e suite [It] [sig-auth] ServiceAccount admission controller migration [Feature:BoundServiceAccountTokenVolume] master upgrade should maintain a functioning cluster
Kubernetes e2e suite [It] [sig-auth] ServiceAccount admission controller migration [Feature:BoundServiceAccountTokenVolume] master upgrade should maintain a functioning cluster
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts ServiceAccountIssuerDiscovery should support OIDC discovery of service account issuer [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts no secret-based service account token should be auto-generated
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts no secret-based service account token should be auto-generated
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should allow opting out of API token automount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should allow opting out of API token automount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should guarantee kube-root-ca.crt exist in any namespace [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount an API token into pods [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should mount projected service account token [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should run through the lifecycle of a ServiceAccount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should set ownership and permission when RunAsUser or FsGroup is present [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should set ownership and permission when RunAsUser or FsGroup is present [LinuxOnly] [NodeFeature:FSGroup]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should support InClusterConfig with token rotation [Slow]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should support InClusterConfig with token rotation [Slow]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should update a ServiceAccount [Conformance]
Kubernetes e2e suite [It] [sig-auth] ServiceAccounts should update a ServiceAccount [Conformance]
Kubernetes e2e suite [It] [sig-auth] SubjectReview should support SubjectReview API operations [Conformance]
Kubernetes e2e suite [It] [sig-auth] SubjectReview should support SubjectReview API operations [Conformance]
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthenticator] The kubelet can delegate ServiceAccount tokens to the API server
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthenticator] The kubelet can delegate ServiceAccount tokens to the API server
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthenticator] The kubelet's main port 10250 should reject requests with no credentials
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthenticator] The kubelet's main port 10250 should reject requests with no credentials
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] A node shouldn't be able to create another node
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] A node shouldn't be able to create another node
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] A node shouldn't be able to delete another node
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] A node shouldn't be able to delete another node
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a non-existent configmap should exit with the Forbidden error, not a NotFound error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a non-existent configmap should exit with the Forbidden error, not a NotFound error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a non-existent secret should exit with the Forbidden error, not a NotFound error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a non-existent secret should exit with the Forbidden error, not a NotFound error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a secret for a workload the node has access to should succeed
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting a secret for a workload the node has access to should succeed
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting an existing configmap should exit with the Forbidden error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting an existing configmap should exit with the Forbidden error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting an existing secret should exit with the Forbidden error
Kubernetes e2e suite [It] [sig-auth] [Feature:NodeAuthorizer] Getting an existing secret should exit with the Forbidden error
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] CA ignores unschedulable pods while scheduling schedulable pods [Feature:ClusterAutoscalerScalability6]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] CA ignores unschedulable pods while scheduling schedulable pods [Feature:ClusterAutoscalerScalability6]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale down empty nodes [Feature:ClusterAutoscalerScalability3]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale down empty nodes [Feature:ClusterAutoscalerScalability3]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale down underutilized nodes [Feature:ClusterAutoscalerScalability4]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale down underutilized nodes [Feature:ClusterAutoscalerScalability4]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale up at all [Feature:ClusterAutoscalerScalability1]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale up at all [Feature:ClusterAutoscalerScalability1]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale up twice [Feature:ClusterAutoscalerScalability2]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] should scale up twice [Feature:ClusterAutoscalerScalability2]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] shouldn't scale down with underutilized nodes due to host port conflicts [Feature:ClusterAutoscalerScalability5]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaler scalability [Slow] shouldn't scale down with underutilized nodes due to host port conflicts [Feature:ClusterAutoscalerScalability5]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group down to 0[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group down to 0[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group up from 0[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should be able to scale a node group up from 0[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should not scale GPU pool up if pod does not require GPUs [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should not scale GPU pool up if pod does not require GPUs [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale down GPU pool from 1 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale down GPU pool from 1 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale up GPU pool from 0 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale up GPU pool from 0 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale up GPU pool from 1 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Should scale up GPU pool from 1 [GpuType:] [Feature:ClusterSizeAutoscalingGpu]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Shouldn't perform scale up operation and should list unhealthy status if most of the cluster is broken[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] Shouldn't perform scale up operation and should list unhealthy status if most of the cluster is broken[Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should add node to the particular mig [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should add node to the particular mig [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining multiple pods one by one as dictated by pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining multiple pods one by one as dictated by pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining system pods with pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down by draining system pods with pdb[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down when rescheduling a pod is required and pdb allows for it[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should be able to scale down when rescheduling a pod is required and pdb allows for it[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed and one node is broken [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed and one node is broken [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed when there is non autoscaled pool[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should correctly scale down after a node is not needed when there is non autoscaled pool[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should disable node pool autoscaling [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should disable node pool autoscaling [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small and one node is broken [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small and one node is broken [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small and there is another node pool that is not autoscaled [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pending pods are small and there is another node pool that is not autoscaled [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting EmptyDir volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting EmptyDir volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pod requesting volume is pending [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pods are pending due to host port conflict [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pods are pending due to host port conflict [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pods are pending due to pod anti-affinity [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should increase cluster size if pods are pending due to pod anti-affinity [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale down when expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale down when expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale up correct target pool [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale up correct target pool [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale up when non expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] should scale up when non expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't be able to scale down when rescheduling a pod is required, but pdb doesn't allow drain[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't be able to scale down when rescheduling a pod is required, but pdb doesn't allow drain[Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't increase cluster size if pending pod is too large [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't increase cluster size if pending pod is too large [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale down when non expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale down when non expendable pod is running [Feature:ClusterSizeAutoscalingScaleDown]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is created [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is preempted [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't scale up when expendable pod is preempted [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't trigger additional scale-ups during processing scale-up [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] Cluster size autoscaling [Slow] shouldn't trigger additional scale-ups during processing scale-up [Feature:ClusterSizeAutoscalingScaleUp]
Kubernetes e2e suite [It] [sig-autoscaling] DNS horizontal autoscaling [Serial] [Slow] kube-dns-autoscaler should scale kube-dns pods when cluster size changed
Kubernetes e2e suite [It] [sig-autoscaling] DNS horizontal autoscaling [Serial] [Slow] kube-dns-autoscaler should scale kube-dns pods when cluster size changed
Kubernetes e2e suite [It] [sig-autoscaling] DNS horizontal autoscaling kube-dns-autoscaler should scale kube-dns pods in both nonfaulty and faulty scenarios
Kubernetes e2e suite [It] [sig-autoscaling] DNS horizontal autoscaling kube-dns-autoscaler should scale kube-dns pods in both nonfaulty and faulty scenarios
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:ClusterSizeAutoscalingScaleUp] [Slow] Autoscaling Autoscaling a service from 1 pod and 3 nodes to 8 pods and >=4 nodes takes less than 15 minutes
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:ClusterSizeAutoscalingScaleUp] [Slow] Autoscaling Autoscaling a service from 1 pod and 3 nodes to 8 pods and >=4 nodes takes less than 15 minutes
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) CustomResourceDefinition Should scale with a CRD targetRef
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) CustomResourceDefinition Should scale with a CRD targetRef
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) ReplicationController light Should scale from 1 pod to 2 pods
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) ReplicationController light Should scale from 1 pod to 2 pods
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) ReplicationController light [Slow] Should scale from 2 pods to 1 pod
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) ReplicationController light [Slow] Should scale from 2 pods to 1 pod
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] Deployment (Pod Resource) Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet with idle sidecar (ContainerResource use case) Should not scale up on a busy sidecar with an idle application
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet with idle sidecar (ContainerResource use case) Should not scale up on a busy sidecar with an idle application
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet with idle sidecar (ContainerResource use case) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods on a busy application with an idle sidecar container
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicaSet with idle sidecar (ContainerResource use case) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods on a busy application with an idle sidecar container
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods and verify decision stability
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods and verify decision stability
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod and verify decision stability
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: CPU) [Serial] [Slow] ReplicationController Should scale from 5 pods to 3 pods and then from 3 pods to 1 pod and verify decision stability
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Container Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Utilization for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] Horizontal pod autoscaling (scale resource: Memory) [Serial] [Slow] Deployment (Pod Resource) Should scale from 1 pod to 3 pods and then from 3 pods to 5 pods using Average Value for aggregation
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with autoscaling disabled shouldn't scale down
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with autoscaling disabled shouldn't scale down
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with autoscaling disabled shouldn't scale up
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with autoscaling disabled shouldn't scale up
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with both scale up and down controls configured should keep recommendation within the range over two stabilization windows
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with both scale up and down controls configured should keep recommendation within the range over two stabilization windows
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with both scale up and down controls configured should keep recommendation within the range with stabilization window and pod limit rate
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with both scale up and down controls configured should keep recommendation within the range with stabilization window and pod limit rate
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with long upscale stabilization window should scale up only after the stabilization period
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with long upscale stabilization window should scale up only after the stabilization period
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by number of Pods rate should scale down no more than given number of Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by number of Pods rate should scale down no more than given number of Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by number of Pods rate should scale up no more than given number of Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by number of Pods rate should scale up no more than given number of Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by percentage should scale down no more than given percentage of current Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by percentage should scale down no more than given percentage of current Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by percentage should scale up no more than given percentage of current Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with scale limited by percentage should scale up no more than given percentage of current Pods per minute
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with short downscale stabilization window should scale down soon after the stabilization period
Kubernetes e2e suite [It] [sig-autoscaling] [Feature:HPA] [Serial] [Slow] Horizontal pod autoscaling (non-default behavior) with short downscale stabilization window should scale down soon after the stabilization period
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Object from Stackdriver should scale down
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Object from Stackdriver should scale down
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Object from Stackdriver should scale down to 0
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Object from Stackdriver should scale down to 0
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale down
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale down
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale down with Prometheus
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale down with Prometheus
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale up with two metrics
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with Custom Metric of type Pod from Stackdriver should scale up with two metrics
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale down with target average value
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale down with target average value
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale down with target value
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale down with target value
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale up with two metrics
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with External Metric from Stackdriver should scale up with two metrics
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should not scale down when one metric is missing (Container Resource and External Metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should not scale down when one metric is missing (Container Resource and External Metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should not scale down when one metric is missing (Pod and Object Metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should not scale down when one metric is missing (Pod and Object Metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should scale up when one metric is missing (Pod and External metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should scale up when one metric is missing (Pod and External metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should scale up when one metric is missing (Resource and Object metrics)
Kubernetes e2e suite [It] [sig-autoscaling] [HPA] [Feature:CustomMetricsAutoscaling] Horizontal pod autoscaling (scale resource: Custom Metrics from Stackdriver) with multiple metrics of different types should scale up when one metric is missing (Resource and Object metrics)
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on 0.0.0.0 that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost should support forwarding over websockets
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects NO client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl Port forwarding With a server listening on localhost that expects a client request should support a client that connects, sends NO DATA, and disconnects
Kubernetes e2e suite [It] [sig-cli] Kubectl client Guestbook application should create and stop a working application [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Guestbook application should create and stop a working application [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl api-versions should check if v1 is in available api versions [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply apply set/view last-applied
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply apply set/view last-applied
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should apply a new configuration to an existing RC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should apply a new configuration to an existing RC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl apply should reuse port when apply to an existing SVC
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info dump should check if cluster-info dump succeeds
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info dump should check if cluster-info dump succeeds
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl cluster-info should check if Kubernetes control plane services is included in cluster-info [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl copy should copy a file from a running Pod
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl copy should copy a file from a running Pod
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota with scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota without scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should create a quota without scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should reject quota with invalid scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl create quota should reject quota with invalid scopes
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for cronjob
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for cronjob
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl describe should check if kubectl describe prints relevant information for rc and pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl diff should check if kubectl diff finds a difference for Deployments [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl events should show event when pod is created
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl events should show event when pod is created
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl expose should create services for rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl expose should create services for rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl get componentstatuses should get componentstatuses
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl label should update the label on a resource [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl patch should add annotations for pods in rc [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl replace should update a single-container pod's image [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl run pod should create a pod from an image when restart is Never [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl server-side dry-run should check if kubectl can dry-run update Pods [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl taint [Serial] should remove all the taints with the same key off a node
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl taint [Serial] should remove all the taints with the same key off a node
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl taint [Serial] should update the taint on a node
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl taint [Serial] should update the taint on a node
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a CR with unknown fields for CRD with no validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply a valid CR for CRD with validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply an invalid/valid CR with arbitrary-extra properties for CRD with partially-specified validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should create/apply an invalid/valid CR with arbitrary-extra properties for CRD with partially-specified validation schema
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields in both the root and embedded object of a CR
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl validation should detect unknown metadata fields of a typed object
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl version should check is all data is printed [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support --unix-socket=/path [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support proxy with --port 0 [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Proxy server should support proxy with --port 0 [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command with --leave-stdin-open
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command with --leave-stdin-open
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command without --restart=Never
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command without --restart=Never
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command without --restart=Never, but with --rm
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run [Slow] running a failing command without --restart=Never, but with --rm
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run running a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run running a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run running a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod Kubectl run running a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should contain last line of the log
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should contain last line of the log
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a successful command
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes should handle in-cluster config
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes should handle in-cluster config
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes should support port-forward
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes should support port-forward
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through an HTTP proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through kubectl proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec through kubectl proxy
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec using resource/name
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support exec using resource/name
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support inline execution and attach
Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should support inline execution and attach
Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should create and stop a replication controller [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client Update Demo should scale a replication controller [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl client kubectl wait should ignore not found error with --for=delete
Kubernetes e2e suite [It] [sig-cli] Kubectl client kubectl wait should ignore not found error with --for=delete
Kubernetes e2e suite [It] [sig-cli] Kubectl logs default container logs the second container is the default-container by annotation should log default container if not specified
Kubernetes e2e suite [It] [sig-cli] Kubectl logs default container logs the second container is the default-container by annotation should log default container if not specified
Kubernetes e2e suite [It] [sig-cli] Kubectl logs logs should be able to retrieve and filter logs [Conformance]
Kubernetes e2e suite [It] [sig-cli] Kubectl logs logs should be able to retrieve and filter logs [Conformance]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Addon update should propagate add-on file changes [Slow]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Addon update should propagate add-on file changes [Slow]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Downgrade [Feature:Downgrade] cluster downgrade should maintain a functioning cluster [Feature:ClusterDowngrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Downgrade [Feature:Downgrade] cluster downgrade should maintain a functioning cluster [Feature:ClusterDowngrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] GKE node pools [Feature:GKENodePool] should create a cluster with multiple node pools [Feature:GKENodePool]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] GKE node pools [Feature:GKENodePool] should create a cluster with multiple node pools [Feature:GKENodePool]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas different zones [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas different zones [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas multizone workers [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas multizone workers [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas same zone [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] HA-master [Feature:HAMaster] survive addition/removal replicas same zone [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Nodes [Disruptive] Resize [Slow] should be able to add nodes
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Nodes [Disruptive] Resize [Slow] should be able to add nodes
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Nodes [Disruptive] Resize [Slow] should be able to delete nodes
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Nodes [Disruptive] Resize [Slow] should be able to delete nodes
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not be able to proxy to cadvisor port 4194 using proxy subresource
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not be able to proxy to cadvisor port 4194 using proxy subresource
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not be able to proxy to the readonly kubelet port 10255 using proxy subresource
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not be able to proxy to the readonly kubelet port 10255 using proxy subresource
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not have port 10255 open on its all public IP addresses
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not have port 10255 open on its all public IP addresses
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not have port 4194 open on its all public IP addresses
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Ports Security Check [Feature:KubeletSecurity] should not have port 4194 open on its all public IP addresses
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Recreate [Feature:Recreate] recreate nodes and ensure they function upon restart
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Recreate [Feature:Recreate] recreate nodes and ensure they function upon restart
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Restart [Disruptive] should restart all nodes and ensure all nodes and pods recover
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] cluster upgrade should maintain a functioning cluster [Feature:ClusterUpgrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade]
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] [Disruptive]NodeLease NodeLease deletion node lease should be deleted when corresponding node is deleted
Kubernetes e2e suite [It] [sig-cloud-provider-gcp] [Disruptive]NodeLease NodeLease deletion node lease should be deleted when corresponding node is deleted
Kubernetes e2e suite [It] [sig-cloud-provider] [Feature:CloudProvider][Disruptive] Nodes should be deleted on API server if it doesn't exist in the cloud provider
Kubernetes e2e suite [It] [sig-cloud-provider] [Feature:CloudProvider][Disruptive] Nodes should be deleted on API server if it doesn't exist in the cloud provider
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the signed bootstrap tokens from clusterInfo ConfigMap when bootstrap token is deleted
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the signed bootstrap tokens from clusterInfo ConfigMap when bootstrap token is deleted
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the token secret when the secret expired
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should delete the token secret when the secret expired
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should not delete the token secret when the secret is not expired
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should not delete the token secret when the secret is not expired
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should resign the bootstrap tokens when the clusterInfo ConfigMap updated [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should resign the bootstrap tokens when the clusterInfo ConfigMap updated [Serial][Disruptive]
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should sign the new added bootstrap tokens
Kubernetes e2e suite [It] [sig-cluster-lifecycle] [Feature:BootstrapTokens] should sign the new added bootstrap tokens
Kubernetes e2e suite [It] [sig-instrumentation] Events API should delete a collection of events [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events API should delete a collection of events [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events API should ensure that an event can be fetched, patched, deleted, and listed [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events API should ensure that an event can be fetched, patched, deleted, and listed [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events should delete a collection of events [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events should delete a collection of events [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events should manage the lifecycle of an event [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Events should manage the lifecycle of an event [Conformance]
Kubernetes e2e suite [It] [sig-instrumentation] Logging soak [Performance] [Slow] [Disruptive] should survive logging 1KB every 1s seconds, for a duration of 2m0s
Kubernetes e2e suite [It] [sig-instrumentation] Logging soak [Performance] [Slow] [Disruptive] should survive logging 1KB every 1s seconds, for a duration of 2m0s
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from API server.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from API server.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a ControllerManager.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a ControllerManager.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a Kubelet.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a Scheduler.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics from a Scheduler.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics slis from API server.
Kubernetes e2e suite [It] [sig-instrumentation] MetricsGrabber should grab all metrics slis from API server.
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should have accelerator metrics [Feature:StackdriverAcceleratorMonitoring]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should have accelerator metrics [Feature:StackdriverAcceleratorMonitoring]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should have cluster metrics [Feature:StackdriverMonitoring]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should have cluster metrics [Feature:StackdriverMonitoring]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for external metrics [Feature:StackdriverExternalMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for external metrics [Feature:StackdriverExternalMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for new resource model [Feature:StackdriverCustomMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for new resource model [Feature:StackdriverCustomMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for old resource model [Feature:StackdriverCustomMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Custom Metrics - Stackdriver Adapter for old resource model [Feature:StackdriverCustomMetrics]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Stackdriver Metadata Agent [Feature:StackdriverMetadataAgent]
Kubernetes e2e suite [It] [sig-instrumentation] Stackdriver Monitoring should run Stackdriver Metadata Agent [Feature:StackdriverMetadataAgent]
Kubernetes e2e suite [It] [sig-network] CVE-2021-29923 IPv4 Service Type ClusterIP with leading zeros should work interpreted as decimal
Kubernetes e2e suite [It] [sig-network] CVE-2021-29923 IPv4 Service Type ClusterIP with leading zeros should work interpreted as decimal
Kubernetes e2e suite [It] [sig-network] ClusterDns [Feature:Example] should create pod that uses dns
Kubernetes e2e suite [It] [sig-network] ClusterDns [Feature:Example] should create pod that uses dns
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when initial unready endpoints get ready
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when initial unready endpoints get ready
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a ClusterIP service
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a ClusterIP service
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a NodePort service
Kubernetes e2e suite [It] [sig-network] Conntrack should be able to preserve UDP traffic when server pod cycles for a NodePort service
Kubernetes e2e suite [It] [sig-network] Conntrack should drop INVALID conntrack entries [Privileged]
Kubernetes e2e suite [It] [sig-network] Conntrack should drop INVALID conntrack entries [Privileged]
Kubernetes e2e suite [It] [sig-network] DNS HostNetwork should resolve DNS of partial qualified names for services on hostNetwork pods with dnsPolicy: ClusterFirstWithHostNet [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] DNS HostNetwork should resolve DNS of partial qualified names for services on hostNetwork pods with dnsPolicy: ClusterFirstWithHostNet [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Change stubDomain should be able to change stubDomain configuration [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Change stubDomain should be able to change stubDomain configuration [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Forward PTR lookup should forward PTR records lookup to upstream nameserver [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Forward PTR lookup should forward PTR records lookup to upstream nameserver [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Forward external name lookup should forward externalname lookup to upstream nameserver [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS configMap nameserver Forward external name lookup should forward externalname lookup to upstream nameserver [Slow][Serial]
Kubernetes e2e suite [It] [sig-network] DNS should provide /etc/hosts entries for the cluster [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide /etc/hosts entries for the cluster [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for ExternalName services [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for ExternalName services [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Hostname [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Hostname [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Subdomain [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for pods for Subdomain [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for services [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for services [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for the cluster [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for the cluster [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for the cluster [Provider:GCE]
Kubernetes e2e suite [It] [sig-network] DNS should provide DNS for the cluster [Provider:GCE]
Kubernetes e2e suite [It] [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should resolve DNS of partial qualified names for services [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] DNS should resolve DNS of partial qualified names for the cluster [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] DNS should support configurable pod DNS nameservers [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should support configurable pod DNS nameservers [Conformance]
Kubernetes e2e suite [It] [sig-network] DNS should support configurable pod resolv.conf
Kubernetes e2e suite [It] [sig-network] DNS should support configurable pod resolv.conf
Kubernetes e2e suite [It] [sig-network] DNS should work with the pod containing more than 6 DNS search paths and longer than 256 search list characters
Kubernetes e2e suite [It] [sig-network] DNS should work with the pod containing more than 6 DNS search paths and longer than 256 search list characters
Kubernetes e2e suite [It] [sig-network] EndpointSlice should create Endpoints and EndpointSlices for Pods matching a Service [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should create Endpoints and EndpointSlices for Pods matching a Service [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should create and delete Endpoints and EndpointSlices for a Service with a selector specified [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should create and delete Endpoints and EndpointSlices for a Service with a selector specified [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should have Endpoints and EndpointSlices pointing to API Server [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should have Endpoints and EndpointSlices pointing to API Server [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should support creating EndpointSlice API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSlice should support creating EndpointSlice API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSliceMirroring should mirror a custom Endpoint with multiple subsets and same IP address
Kubernetes e2e suite [It] [sig-network] EndpointSliceMirroring should mirror a custom Endpoint with multiple subsets and same IP address
Kubernetes e2e suite [It] [sig-network] EndpointSliceMirroring should mirror a custom Endpoints resource through create update and delete [Conformance]
Kubernetes e2e suite [It] [sig-network] EndpointSliceMirroring should mirror a custom Endpoints resource through create update and delete [Conformance]
Kubernetes e2e suite [It] [sig-network] Firewall rule [Slow] [Serial] should create valid firewall rules for LoadBalancer type service
Kubernetes e2e suite [It] [sig-network] Firewall rule [Slow] [Serial] should create valid firewall rules for LoadBalancer type service
Kubernetes e2e suite [It] [sig-network] Firewall rule control plane should not expose well-known ports
Kubernetes e2e suite [It] [sig-network] Firewall rule control plane should not expose well-known ports
Kubernetes e2e suite [It] [sig-network] Firewall rule should have correct firewall rules for e2e cluster
Kubernetes e2e suite [It] [sig-network] Firewall rule should have correct firewall rules for e2e cluster
Kubernetes e2e suite [It] [sig-network] HostPort validates that there is no conflict between pods with same hostPort but different hostIP and protocol [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] HostPort validates that there is no conflict between pods with same hostPort but different hostIP and protocol [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Ingress API should support creating Ingress API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] Ingress API should support creating Ingress API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] IngressClass API should support creating IngressClass API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] IngressClass API should support creating IngressClass API operations [Conformance]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should allow IngressClass to have Namespace-scoped parameters [Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should allow IngressClass to have Namespace-scoped parameters [Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should choose the one with the later CreationTimestamp, if equal the one with the lower name when two ingressClasses are marked as default[Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should choose the one with the later CreationTimestamp, if equal the one with the lower name when two ingressClasses are marked as default[Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should not set default value if no default IngressClass [Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should not set default value if no default IngressClass [Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should set default value on new IngressClass [Serial]
Kubernetes e2e suite [It] [sig-network] IngressClass [Feature:Ingress] should set default value on new IngressClass [Serial]
Kubernetes e2e suite [It] [sig-network] KubeProxy should set TCP CLOSE_WAIT timeout [Privileged]
Kubernetes e2e suite [It] [sig-network] KubeProxy should set TCP CLOSE_WAIT timeout [Privileged]
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should handle updates to ExternalTrafficPolicy field
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should handle updates to ExternalTrafficPolicy field
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should only target nodes with endpoints
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should only target nodes with endpoints
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work for type=LoadBalancer
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work for type=LoadBalancer
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work for type=NodePort
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work for type=NodePort
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work from pods
Kubernetes e2e suite [It] [sig-network] LoadBalancers ESIPP [Slow] should work from pods
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to change the type and ports of a TCP service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to change the type and ports of a TCP service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to change the type and ports of a UDP service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to change the type and ports of a UDP service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to create LoadBalancer Service without NodePort and change it [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to create LoadBalancer Service without NodePort and change it [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to create an internal type load balancer [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to create an internal type load balancer [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to preserve UDP traffic when server pod cycles for a LoadBalancer service on different nodes
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to preserve UDP traffic when server pod cycles for a LoadBalancer service on different nodes
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to preserve UDP traffic when server pod cycles for a LoadBalancer service on the same nodes
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to preserve UDP traffic when server pod cycles for a LoadBalancer service on the same nodes
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to switch session affinity for LoadBalancer service with ESIPP off [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to switch session affinity for LoadBalancer service with ESIPP off [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to switch session affinity for LoadBalancer service with ESIPP on [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should be able to switch session affinity for LoadBalancer service with ESIPP on [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should handle load balancer cleanup finalizer for service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should handle load balancer cleanup finalizer for service [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP off [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP off [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP on [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should have session affinity work for LoadBalancer service with ESIPP on [Slow] [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should not have connectivity disruption during rolling update with externalTrafficPolicy=Cluster [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should not have connectivity disruption during rolling update with externalTrafficPolicy=Cluster [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should not have connectivity disruption during rolling update with externalTrafficPolicy=Local [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should not have connectivity disruption during rolling update with externalTrafficPolicy=Local [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should only allow access from service loadbalancer source ranges [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should only allow access from service loadbalancer source ranges [Slow]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should reconcile LB health check interval [Slow][Serial][Disruptive]
Kubernetes e2e suite [It] [sig-network] LoadBalancers should reconcile LB health check interval [Slow][Serial][Disruptive]
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:Ingress] should conform to Ingress spec
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:Ingress] should conform to Ingress spec
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] rolling update backend pods should not cause service disruption
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] rolling update backend pods should not cause service disruption
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should be able to create a ClusterIP service
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should be able to create a ClusterIP service
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should be able to switch between IG and NEG modes
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should be able to switch between IG and NEG modes
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should conform to Ingress spec
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should conform to Ingress spec
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should create NEGs for all ports with the Ingress annotation, and NEGs for the standalone annotation otherwise
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should create NEGs for all ports with the Ingress annotation, and NEGs for the standalone annotation otherwise
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should sync endpoints for both Ingress-referenced NEG and standalone NEG
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should sync endpoints for both Ingress-referenced NEG and standalone NEG
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should sync endpoints to NEG
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 GCE [Slow] [Feature:NEG] should sync endpoints to NEG
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 Scalability GCE [Slow] [Serial] [Feature:IngressScale] Creating and updating ingresses should happen promptly with small/medium/large amount of ingresses
Kubernetes e2e suite [It] [sig-network] Loadbalancing: L7 Scalability GCE [Slow] [Serial] [Feature:IngressScale] Creating and updating ingresses should happen promptly with small/medium/large amount of ingresses
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy API operations
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy API operations
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy API with endport field
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy API with endport field
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy with Status subresource [Feature:NetworkPolicyStatus]
Kubernetes e2e suite [It] [sig-network] Netpol API should support creating NetworkPolicy with Status subresource [Feature:NetworkPolicyStatus]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow egress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow egress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from namespace on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from namespace on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from updated namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from updated namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access from updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should allow ingress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny egress from all pods in a namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny egress from all pods in a namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny egress from pods based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny egress from pods based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny ingress access to updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny ingress access to updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny ingress from pods on other namespaces [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should deny ingress from pods on other namespaces [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce egress policy allowing traffic to a server in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce egress policy allowing traffic to a server in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce except clause while egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce except clause while egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce ingress policy allowing any port traffic to a server on a specific protocol [Feature:NetworkPolicy] [Feature:UDP]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce ingress policy allowing any port traffic to a server on a specific protocol [Feature:NetworkPolicy] [Feature:UDP]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple egress policies with egress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple egress policies with egress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple, stacked policies with overlapping podSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce multiple, stacked policies with overlapping podSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policies to check ingress and egress policies can be controlled independently based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policies to check ingress and egress policies can be controlled independently based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on Multiple PodSelectors and NamespaceSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on Multiple PodSelectors and NamespaceSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on PodSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on any PodSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy based on any PodSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow ingress traffic for a target [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow ingress traffic for a target [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow ingress traffic from pods in all namespaces [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow ingress traffic from pods in all namespaces [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic based on NamespaceSelector with MatchLabels using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic based on NamespaceSelector with MatchLabels using default ns label [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic from pods within server namespace based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic from pods within server namespace based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic only from a different namespace, based on NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic only from a different namespace, based on NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should ensure an IP overlapping both IPBlock.CIDR and IPBlock.Except is allowed [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should ensure an IP overlapping both IPBlock.CIDR and IPBlock.Except is allowed [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should not allow access by TCP when a policy specifies only UDP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should not allow access by TCP when a policy specifies only UDP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should not mistakenly treat 'protocol: SCTP' as 'protocol: TCP', even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should not mistakenly treat 'protocol: SCTP' as 'protocol: TCP', even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should properly isolate pods that are selected by a policy allowing SCTP, even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should properly isolate pods that are selected by a policy allowing SCTP, even if the plugin doesn't support SCTP [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should stop enforcing policies after they are deleted [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should stop enforcing policies after they are deleted [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support allow-all policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support allow-all policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support denying of egress traffic on the client side (even if the server explicitly allows this traffic) [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should support denying of egress traffic on the client side (even if the server explicitly allows this traffic) [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should work with Ingress, Egress specified together [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol NetworkPolicy between server and client should work with Ingress, Egress specified together [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Netpol [LinuxOnly] NetworkPolicy between server and client using UDP should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy API should support creating NetworkPolicy API operations
Kubernetes e2e suite [It] [sig-network] NetworkPolicy API should support creating NetworkPolicy API operations
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should support a 'default-deny' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicy [Feature:SCTPConnectivity][LinuxOnly] NetworkPolicy between server and client using SCTP should support a 'default-deny' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow egress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow egress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from namespace on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from namespace on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from updated namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from updated namespace [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access from updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should allow ingress access on one named port [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should deny ingress access to updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should deny ingress access to updated pod [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce egress policy allowing traffic to a server in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce egress policy allowing traffic to a server in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce except clause while egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce except clause while egress access to server in CIDR block [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple egress policies with egress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple egress policies with egress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple ingress policies with ingress allow-all policy taking precedence [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple, stacked policies with overlapping podSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce multiple, stacked policies with overlapping podSelectors [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policies to check ingress and egress policies can be controlled independently based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policies to check ingress and egress policies can be controlled independently based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on NamespaceSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector or NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on PodSelector with MatchExpressions[Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy based on Ports [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic from pods within server namespace based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic from pods within server namespace based on PodSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a different namespace, based on NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a different namespace, based on NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce policy to allow traffic only from a pod in a different namespace based on PodSelector and NamespaceSelector [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should enforce updated policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should ensure an IP overlapping both IPBlock.CIDR and IPBlock.Except is allowed [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should ensure an IP overlapping both IPBlock.CIDR and IPBlock.Except is allowed [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should not allow access by TCP when a policy specifies only SCTP [Feature:NetworkPolicy] [Serial]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should not allow access by TCP when a policy specifies only SCTP [Feature:NetworkPolicy] [Serial]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should stop enforcing policies after they are deleted [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should stop enforcing policies after they are deleted [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-all' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support a 'default-deny-ingress' policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support allow-all policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should support allow-all policy [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should work with Ingress,Egress specified together [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] NetworkPolicyLegacy [LinuxOnly] NetworkPolicy between server and client should work with Ingress,Egress specified together [Feature:NetworkPolicy]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: http [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for intra-pod communication: udp [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: http [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: sctp [LinuxOnly][Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Pods should function for node-pod communication: udp [LinuxOnly] [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should be able to handle large requests: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should be able to handle large requests: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should be able to handle large requests: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should be able to handle large requests: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for endpoint-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for multiple endpoint-Services with same selector
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for multiple endpoint-Services with same selector
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for node-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for pod-Service: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for service endpoints using hostNetwork
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should function for service endpoints using hostNetwork
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should support basic nodePort: udp functionality
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should support basic nodePort: udp functionality
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update endpoints: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update endpoints: http
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update endpoints: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update endpoints: udp
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update nodePort: http [Slow]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update nodePort: http [Slow]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update nodePort: udp [Slow]
Kubernetes e2e suite [It] [sig-network] Networking Granular Checks: Services should update nodePort: udp [Slow]
Kubernetes e2e suite [It] [sig-network] Networking IPerf2 [Feature:Networking-Performance] should run iperf2
Kubernetes e2e suite [It] [sig-network] Networking IPerf2 [Feature:Networking-Performance] should run iperf2
Kubernetes e2e suite [It] [sig-network] Networking should allow creating a Pod with an SCTP HostPort [LinuxOnly] [Serial]
Kubernetes e2e suite [It] [sig-network] Networking should allow creating a Pod with an SCTP HostPort [LinuxOnly] [Serial]
Kubernetes e2e suite [It] [sig-network] Networking should check kube-proxy urls
Kubernetes e2e suite [It] [sig-network] Networking should check kube-proxy urls
Kubernetes e2e suite [It] [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv4]
Kubernetes e2e suite [It] [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv4]
Kubernetes e2e suite [It] [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv6][Experimental][LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking should provide Internet connection for containers [Feature:Networking-IPv6][Experimental][LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Networking should provide unchanging, static URL paths for kubernetes api services
Kubernetes e2e suite [It] [sig-network] Networking should provide unchanging, static URL paths for kubernetes api services
Kubernetes e2e suite [It] [sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]
Kubernetes e2e suite [It] [sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]
Kubernetes e2e suite [It] [sig-network] Networking should recreate its iptables rules if they are deleted [Disruptive]
Kubernetes e2e suite [It] [sig-network] Networking should recreate its iptables rules if they are deleted [Disruptive]
Kubernetes e2e suite [It] [sig-network] NoSNAT [Feature:NoSNAT] [Slow] Should be able to send traffic between Pods without SNAT
Kubernetes e2e suite [It] [sig-network] NoSNAT [Feature:NoSNAT] [Slow] Should be able to send traffic between Pods without SNAT
Kubernetes e2e suite [It] [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service Proxy [Conformance]
Kubernetes e2e suite [It] [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service Proxy [Conformance]
Kubernetes e2e suite [It] [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]
Kubernetes e2e suite [It] [sig-network] Proxy version v1 A set of valid responses are returned for both pod and service ProxyWithPath [Conformance]
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy logs on node using proxy subresource
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy logs on node using proxy subresource
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy logs on node with explicit kubelet port using proxy subresource
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy through a service and a pod [Conformance]
Kubernetes e2e suite [It] [sig-network] Proxy version v1 should proxy through a service and a pod [Conformance]
Kubernetes e2e suite [It] [sig-network] Service endpoints latency should not be very high [Conformance]
Kubernetes e2e suite [It] [sig-network] Service endpoints latency should not be very high [Conformance]
Kubernetes e2e suite [It] [sig-network] Services GCE [Slow] should be able to create and tear down a standard-tier load balancer [Slow]
Kubernetes e2e suite [It] [sig-network] Services GCE [Slow] should be able to create and tear down a standard-tier load balancer [Slow]
Kubernetes e2e suite [It] [sig-network] Services should allow creating a basic SCTP service with pod and endpoints [LinuxOnly] [Serial]
Kubernetes e2e suite [It] [sig-network] Services should allow creating a basic SCTP service with pod and endpoints [LinuxOnly] [Serial]
Kubernetes e2e suite [It] [sig-network] Services should allow pods to hairpin back to themselves through services
Kubernetes e2e suite [It] [sig-network] Services should allow pods to hairpin back to themselves through services
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ClusterIP to ExternalName [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ClusterIP to ExternalName [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ExternalName to ClusterIP [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ExternalName to ClusterIP [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from ExternalName to NodePort [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to change the type from NodePort to ExternalName [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is true
Kubernetes e2e suite [It] [sig-network] Services should be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is true
Kubernetes e2e suite [It] [sig-network] Services should be able to create a functioning NodePort service [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to create a functioning NodePort service [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should be able to up and down services
Kubernetes e2e suite [It] [sig-network] Services should be able to up and down services
Kubernetes e2e suite [It] [sig-network] Services should be able to update service type to NodePort listening on same port number but different protocols
Kubernetes e2e suite [It] [sig-network] Services should be able to update service type to NodePort listening on same port number but different protocols
Kubernetes e2e suite [It] [sig-network] Services should be possible to connect to a service via ExternalIP when the external IP is not assigned to a node
Kubernetes e2e suite [It] [sig-network] Services should be possible to connect to a service via ExternalIP when the external IP is not assigned to a node
Kubernetes e2e suite [It] [sig-network] Services should be rejected for evicted pods (no endpoints exist)
Kubernetes e2e suite [It] [sig-network] Services should be rejected for evicted pods (no endpoints exist)
Kubernetes e2e suite [It] [sig-network] Services should be rejected when no endpoints exist
Kubernetes e2e suite [It] [sig-network] Services should be rejected when no endpoints exist
Kubernetes e2e suite [It] [sig-network] Services should be updated after adding or deleting ports
Kubernetes e2e suite [It] [sig-network] Services should be updated after adding or deleting ports
Kubernetes e2e suite [It] [sig-network] Services should check NodePort out-of-range
Kubernetes e2e suite [It] [sig-network] Services should check NodePort out-of-range
Kubernetes e2e suite [It] [sig-network] Services should complete a service status lifecycle [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should complete a service status lifecycle [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should create endpoints for unready pods
Kubernetes e2e suite [It] [sig-network] Services should create endpoints for unready pods
Kubernetes e2e suite [It] [sig-network] Services should delete a collection of services [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should delete a collection of services [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should fail health check node port if there are only terminating endpoints [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fail health check node port if there are only terminating endpoints [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to local terminating endpoints when there are no ready endpoints with externalTrafficPolicy=Local [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to local terminating endpoints when there are no ready endpoints with externalTrafficPolicy=Local [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to local terminating endpoints when there are no ready endpoints with internalTrafficPolicy=Local [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to local terminating endpoints when there are no ready endpoints with internalTrafficPolicy=Local [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to terminating endpoints when there are no ready endpoints with externallTrafficPolicy=Cluster [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to terminating endpoints when there are no ready endpoints with externallTrafficPolicy=Cluster [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to terminating endpoints when there are no ready endpoints with internalTrafficPolicy=Cluster [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should fallback to terminating endpoints when there are no ready endpoints with internalTrafficPolicy=Cluster [Feature:ProxyTerminatingEndpoints]
Kubernetes e2e suite [It] [sig-network] Services should find a service from listing all namespaces [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should find a service from listing all namespaces [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity timeout work for NodePort service [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity timeout work for service with type clusterIP [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity timeout work for service with type clusterIP [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should implement service.kubernetes.io/headless
Kubernetes e2e suite [It] [sig-network] Services should implement service.kubernetes.io/headless
Kubernetes e2e suite [It] [sig-network] Services should implement service.kubernetes.io/service-proxy-name
Kubernetes e2e suite [It] [sig-network] Services should implement service.kubernetes.io/service-proxy-name
Kubernetes e2e suite [It] [sig-network] Services should not be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is false
Kubernetes e2e suite [It] [sig-network] Services should not be able to connect to terminating and unready endpoints if PublishNotReadyAddresses is false
Kubernetes e2e suite [It] [sig-network] Services should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should preserve source pod IP for traffic thru service cluster IP [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] Services should prevent NodePort collisions
Kubernetes e2e suite [It] [sig-network] Services should prevent NodePort collisions
Kubernetes e2e suite [It] [sig-network] Services should provide secure master service [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should provide secure master service [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should release NodePorts on delete
Kubernetes e2e suite [It] [sig-network] Services should release NodePorts on delete
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod (hostNetwork: true) to Pod [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod (hostNetwork: true) to Pod [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod and Node, to Pod (hostNetwork: true) [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod and Node, to Pod (hostNetwork: true) [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod to Pod [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should respect internalTrafficPolicy=Local Pod to Pod [Feature:ServiceInternalTrafficPolicy]
Kubernetes e2e suite [It] [sig-network] Services should serve a basic endpoint from pods [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should serve a basic endpoint from pods [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should serve endpoints on same port and different protocol for internal traffic on Type LoadBalancer
Kubernetes e2e suite [It] [sig-network] Services should serve endpoints on same port and different protocol for internal traffic on Type LoadBalancer
Kubernetes e2e suite [It] [sig-network] Services should serve multiport endpoints from pods [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should serve multiport endpoints from pods [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should test the lifecycle of an Endpoint [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should test the lifecycle of an Endpoint [Conformance]
Kubernetes e2e suite [It] [sig-network] Services should work after restarting apiserver [Disruptive]
Kubernetes e2e suite [It] [sig-network] Services should work after restarting apiserver [Disruptive]
Kubernetes e2e suite [It] [sig-network] Services should work after restarting kube-proxy [Disruptive]
Kubernetes e2e suite [It] [sig-network] Services should work after restarting kube-proxy [Disruptive]
Kubernetes e2e suite [It] [sig-network] Services should work after the service has been recreated
Kubernetes e2e suite [It] [sig-network] Services should work after the service has been recreated
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should be able to handle large requests: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should be able to handle large requests: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should be able to handle large requests: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should be able to handle large requests: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for client IP based session affinity: http [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for client IP based session affinity: udp [LinuxOnly]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for endpoint-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for endpoint-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for endpoint-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for endpoint-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for node-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: sctp [Feature:SCTPConnectivity]
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for pod-Service: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for service endpoints using hostNetwork
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for service endpoints using hostNetwork
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: http
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: udp
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should be able to reach pod on ipv4 and ipv6 ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should be able to reach pod on ipv4 and ipv6 ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create a single stack service with cluster ip from primary service range
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create a single stack service with cluster ip from primary service range
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create pod, add ipv6 and ipv4 ip to pod ips
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create pod, add ipv6 and ipv4 ip to pod ips
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv4 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv4 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv4,v6 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv4,v6 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv6 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv6 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv6,v4 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should create service with ipv6,v4 cluster ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should have ipv4 and ipv6 internal node ip
Kubernetes e2e suite [It] [sig-network] [Feature:IPv6DualStack] should have ipv4 and ipv6 internal node ip
Kubernetes e2e suite [It] [sig-network] [Feature:PerformanceDNS][Serial] Should answer DNS query for maximum number of services per cluster
Kubernetes e2e suite [It] [sig-network] [Feature:PerformanceDNS][Serial] Should answer DNS query for maximum number of services per cluster
Kubernetes e2e suite [It] [sig-network] [Feature:Topology Hints] should distribute endpoints evenly
Kubernetes e2e suite [It] [sig-network] [Feature:Topology Hints] should distribute endpoints evenly
Kubernetes e2e suite [It] [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Downgrade kube-proxy from a DaemonSet to static pods should maintain a functioning cluster [Feature:KubeProxyDaemonSetDowngrade]
Kubernetes e2e suite [It] [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Downgrade kube-proxy from a DaemonSet to static pods should maintain a functioning cluster [Feature:KubeProxyDaemonSetDowngrade]
Kubernetes e2e suite [It] [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Upgrade kube-proxy from static pods to a DaemonSet should maintain a functioning cluster [Feature:KubeProxyDaemonSetUpgrade]
Kubernetes e2e suite [It] [sig-network] kube-proxy migration [Feature:KubeProxyDaemonSetMigration] Upgrade kube-proxy from static pods to a DaemonSet should maintain a functioning cluster [Feature:KubeProxyDaemonSetUpgrade]
Kubernetes e2e suite [It] [sig-node] AppArmor load AppArmor profiles can disable an AppArmor profile, using unconfined
Kubernetes e2e suite [It] [sig-node] AppArmor load AppArmor profiles can disable an AppArmor profile, using unconfined
Kubernetes e2e suite [It] [sig-node] AppArmor load AppArmor profiles should enforce an AppArmor profile
Kubernetes e2e suite [It] [sig-node] AppArmor load AppArmor profiles should enforce an AppArmor profile
Kubernetes e2e suite [It] [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should be consumable via environment variable [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should be consumable via the environment [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should fail to create ConfigMap with empty key [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should run through a ConfigMap lifecycle [Conformance]
Kubernetes e2e suite [It] [sig-node] ConfigMap should update ConfigMap successfully
Kubernetes e2e suite [It] [sig-node] ConfigMap should update ConfigMap successfully
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute poststart https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop exec hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop http hook properly [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Lifecycle Hook when create a pod with lifecycle hook should execute prestop https hook properly [MinimumKubeletVersion:1.23] [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from file when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message from log output if TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test on terminated container should report termination message if TerminationMessagePath is set as non-root user and at a non-default path [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull from private registry with secret [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull image [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should be able to pull image [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull from private registry without secret [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull from private registry without secret [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull image from invalid registry [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when running a container with a new image should not be able to pull image from invalid registry [NodeConformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Container Runtime blackbox test when starting a container that exits should run with the expected status [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default arguments (container cmd) [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default command (container entrypoint) [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should be able to override the image's default command and arguments [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] Containers should use the image defaults if command and args are blank [NodeConformance] [Conformance]
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports external claim referenced by multiple containers of multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports external claim referenced by multiple containers of multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports external claim referenced by multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports external claim referenced by multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports init containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports init containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports inline claim referenced by multiple containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports inline claim referenced by multiple containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports simple pod referencing external resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports simple pod referencing external resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports simple pod referencing inline resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with delayed allocation supports simple pod referencing inline resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports external claim referenced by multiple containers of multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports external claim referenced by multiple containers of multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports external claim referenced by multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports external claim referenced by multiple pods
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports init containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports init containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports inline claim referenced by multiple containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports inline claim referenced by multiple containers
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports simple pod referencing external resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports simple pod referencing external resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports simple pod referencing inline resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] cluster with immediate allocation supports simple pod referencing inline resource claim
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] driver supports claim and class parameters
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] driver supports claim and class parameters
Kubernetes e2e suite [It] [sig-node] DRA [Feature:DynamicResourceAllocation] kubelet must not run a pod if a claim is not reserved for it
Kubernetes e2e s