This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 70 succeeded
Started2020-03-30 14:50
Elapsed19m13s
Revision
Builderac99d133-7295-11ea-a0b0-0e43f1618cf3
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/c7cd3401-e244-4c32-b17c-65cc545d92e6/targets/test'}}
resultstorehttps://source.cloud.google.com/results/invocations/c7cd3401-e244-4c32-b17c-65cc545d92e6/targets/test
infra-commit6bfe540c3
job-versionv1.16.9-beta.0.17+bb616cba1cc983
master_os_imagecos-73-11647-163-0
node_os_imagecos-73-11647-163-0
revisionv1.16.9-beta.0.17+bb616cba1cc983

Test Failures


diffResources 0.01s

Error: 2 leaked resources
+NAME                           MACHINE_TYPE   PREEMPTIBLE  CREATION_TIMESTAMP
+bootstrap-e2e-minion-template  n1-standard-2               2020-03-30T07:54:19.649-07:00
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 70 Passed Tests

Show 4678 Skipped Tests

Error lines from build-log.txt

... skipping 15 lines ...
I0330 14:50:24.203] process 49 exited with code 0 after 0.0m
I0330 14:50:24.203] Will upload results to gs://kubernetes-jenkins/logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I0330 14:50:24.203] Root: /workspace
I0330 14:50:24.204] cd to /workspace
I0330 14:50:24.204] Configure environment...
I0330 14:50:24.204] Call:  git show -s --format=format:%ct HEAD
W0330 14:50:24.208] fatal: not a git repository (or any of the parent directories): .git
I0330 14:50:24.209] process 63 exited with code 128 after 0.0m
W0330 14:50:24.209] Unable to print commit date for HEAD
I0330 14:50:24.209] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W0330 14:50:24.851] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I0330 14:50:25.018] process 64 exited with code 0 after 0.0m
I0330 14:50:25.018] Call:  gcloud config get-value account
... skipping 369 lines ...
W0330 14:54:56.215] NODE_NAMES=bootstrap-e2e-minion-group-6hxz bootstrap-e2e-minion-group-9k71 bootstrap-e2e-minion-group-pmlp
W0330 14:54:56.215] Trying to find master named 'bootstrap-e2e-master'
W0330 14:54:56.215] Looking for address 'bootstrap-e2e-master-ip'
I0330 14:54:57.979] Waiting up to 300 seconds for cluster initialization.
I0330 14:54:57.980] 
I0330 14:54:57.980]   This will continually check to see if the API for kubernetes is reachable.
I0330 14:54:57.980]   This may time out if there was some uncaught error during start up.
I0330 14:54:57.980] 
W0330 14:54:58.081] Using master: bootstrap-e2e-master (external IP: 34.82.74.177; internal IP: (not set))
I0330 14:55:58.198] .............Kubernetes cluster created.
I0330 14:55:58.515] Cluster "k8s-e2e-gce-scalability_bootstrap-e2e" set.
I0330 14:55:58.790] User "k8s-e2e-gce-scalability_bootstrap-e2e" set.
I0330 14:55:59.101] Context "k8s-e2e-gce-scalability_bootstrap-e2e" created.
... skipping 559 lines ...
I0330 14:57:56.541]   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:225
I0330 14:57:56.542] [It] should check if cluster-info dump succeeds
I0330 14:57:56.542]   /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/kubectl/kubectl.go:994
I0330 14:57:56.542] STEP: running cluster-info dump
I0330 14:57:56.542] Mar 30 14:57:40.215: INFO: Running '../../../../kubernetes_skew/cluster/kubectl.sh --server=https://34.82.74.177 --kubeconfig=/workspace/.kube/config cluster-info dump'
I0330 14:57:56.543] Mar 30 14:57:47.986: INFO: stderr: ""
I0330 14:57:58.882] Mar 30 14:57:47.988: INFO: stdout: "{\n    \"kind\": \"NodeList\",\n    \"apiVersion\": \"v1\",\n    \"metadata\": {\n        \"selfLink\": \"/api/v1/nodes\",\n        \"resourceVersion\": \"1047\"\n    },\n    \"items\": [\n        {\n            \"metadata\": {\n                \"name\": \"bootstrap-e2e-master\",\n                \"selfLink\": \"/api/v1/nodes/bootstrap-e2e-master\",\n                \"uid\": \"2ba48005-f173-4dc2-89a2-21034b304a66\",\n                \"resourceVersion\": \"799\",\n                \"creationTimestamp\": \"2020-03-30T14:56:24Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-1\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west1-b\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"bootstrap-e2e-master\",\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"10.64.3.0/24\",\n                \"podCIDRs\": [\n                    \"10.64.3.0/24\"\n                ],\n                \"providerID\": \"gce://k8s-e2e-gce-scalability/us-west1-b/bootstrap-e2e-master\",\n                \"unschedulable\": true,\n                \"taints\": [\n                    {\n                        \"key\": \"node-role.kubernetes.io/master\",\n                        \"effect\": \"NoSchedule\"\n                    },\n                    {\n                        \"key\": \"node.kubernetes.io/unschedulable\",\n                        \"effect\": \"NoSchedule\"\n                    }\n                ]\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"1\",\n                    \"ephemeral-storage\": \"16293736Ki\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3787516Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"1\",\n                    \"ephemeral-storage\": \"15016307073\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"3531516Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:38Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:38Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:05Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:24Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:05Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:24Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:05Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:24Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:05Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:24Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.138.0.2\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"34.82.74.177\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"bootstrap-e2e-master.c.k8s-e2e-gce-scalability.internal\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"bootstrap-e2e-master.c.k8s-e2e-gce-scalability.internal\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"2ab5b16277381b818ba3920dee587135\",\n                    \"systemUUID\": \"2AB5B162-7738-1B81-8BA3-920DEE587135\",\n                    \"bootID\": \"5684d39c-3725-477c-bc53-b76ff2bcaea7\",\n                    \"kernelVersion\": \"4.14.94+\",\n                    \"osImage\": \"Container-Optimized OS from Google\",\n                    \"containerRuntimeVersion\": \"docker://18.9.3\",\n                    \"kubeletVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"kubeProxyVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:6c8574a40816676cd908cfa89d16463002b56ca05fa76d0c912e116bc0ab867e\",\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.8\"\n                        ],\n                        \"sizeBytes\": 264721247\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcd@sha256:12c2c5e5731c3bcd56e6f1c05c0f9198b6f06793fa7fca2fb43aab9622dc4afa\",\n                            \"k8s.gcr.io/etcd:3.3.15-0\"\n                        ],\n                        \"sizeBytes\": 246640776\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-apiserver-amd64:v1.16.9-beta.0.17_bb616cba1cc983\"\n                        ],\n                        \"sizeBytes\": 200393484\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-controller-manager-amd64:v1.16.9-beta.0.17_bb616cba1cc983\"\n                        ],\n                        \"sizeBytes\": 191496669\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-scheduler-amd64:v1.16.9-beta.0.17_bb616cba1cc983\"\n                        ],\n                        \"sizeBytes\": 99218726\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-addon-manager@sha256:3e315022a842d782a28e729720f21091dde21f1efea28868d65ec595ad871616\",\n                            \"k8s.gcr.io/kube-addon-manager:v9.0.2\"\n                        ],\n                        \"sizeBytes\": 83076028\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/etcd-empty-dir-cleanup@sha256:c60552d15b383b88a75d552816041cfe963edc3e4d9e8e378d7c0aae20cfb3f7\",\n                            \"k8s.gcr.io/etcd-empty-dir-cleanup:3.3.15.0\"\n                        ],\n                        \"sizeBytes\": 78265220\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/ingress-gce-glbc-amd64@sha256:14f14351a03038b238232e60850a9cfa0dffbed0590321ef84216a432accc1ca\",\n                            \"k8s.gcr.io/ingress-gce-glbc-amd64:v1.2.3\"\n                        ],\n                        \"sizeBytes\": 71797285\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 41861013\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 11337839\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea\",\n                            \"k8s.gcr.io/pause:3.1\"\n                        ],\n                        \"sizeBytes\": 742472\n                    }\n                ],\n                \"config\": {}\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"bootstrap-e2e-minion-group-6hxz\",\n                \"selfLink\": \"/api/v1/nodes/bootstrap-e2e-minion-group-6hxz\",\n                \"uid\": \"0ead0de2-bb0f-4c56-8a57-35b4e27fa1b0\",\n                \"resourceVersion\": \"881\",\n                \"creationTimestamp\": \"2020-03-30T14:56:22Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west1-b\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"bootstrap-e2e-minion-group-6hxz\",\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"10.64.2.0/24\",\n                \"podCIDRs\": [\n                    \"10.64.2.0/24\"\n                ],\n                \"providerID\": \"gce://k8s-e2e-gce-scalability/us-west1-b/bootstrap-e2e-minion-group-6hxz\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"98868448Ki\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7658068Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"91117161526\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7402068Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"FrequentUnregisterNetDevice\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentUnregisterNetDevice\",\n                        \"message\": \"node is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentKubeletRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentKubeletRestart\",\n                        \"message\": \"kubelet is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentDockerRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentDockerRestart\",\n                        \"message\": \"docker is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentContainerdRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentContainerdRestart\",\n                        \"message\": \"containerd is functioning properly\"\n                    },\n                    {\n                        \"type\": \"KernelDeadlock\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"KernelHasNoDeadlock\",\n                        \"message\": \"kernel has no deadlock\"\n                    },\n                    {\n                        \"type\": \"ReadonlyFilesystem\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"FilesystemIsNotReadOnly\",\n                        \"message\": \"Filesystem is not read-only\"\n                    },\n                    {\n                        \"type\": \"CorruptDockerOverlay2\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoCorruptDockerOverlay2\",\n                        \"message\": \"docker overlay2 is functioning properly\"\n                    },\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:30Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:30Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:52Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:22Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:52Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:22Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:52Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:22Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:52Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:22Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.138.0.3\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.247.24.22\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"bootstrap-e2e-minion-group-6hxz.c.k8s-e2e-gce-scalability.internal\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"bootstrap-e2e-minion-group-6hxz.c.k8s-e2e-gce-scalability.internal\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"2a5d65a649cd881f2fbeab809a604745\",\n                    \"systemUUID\": \"2A5D65A6-49CD-881F-2FBE-AB809A604745\",\n                    \"bootID\": \"d4517359-3fe8-4e85-9a59-f78f198390b7\",\n                    \"kernelVersion\": \"4.14.94+\",\n                    \"osImage\": \"Container-Optimized OS from Google\",\n                    \"containerRuntimeVersion\": \"docker://18.9.3\",\n                    \"kubeletVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"kubeProxyVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:6c8574a40816676cd908cfa89d16463002b56ca05fa76d0c912e116bc0ab867e\",\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.8\"\n                        ],\n                        \"sizeBytes\": 264721247\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.16.9-beta.0.17_bb616cba1cc983\"\n                        ],\n                        \"sizeBytes\": 96741051\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/coredns@sha256:12eb885b8685b1b13a04ecf5c23bc809c2e57917252fd7b0be9e9c00644e8ee5\",\n                            \"k8s.gcr.io/coredns:1.6.2\"\n                        ],\n                        \"sizeBytes\": 44100963\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 41861013\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b\",\n                            \"k8s.gcr.io/metrics-server-amd64:v0.3.6\"\n                        ],\n                        \"sizeBytes\": 39944451\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/addon-resizer@sha256:30b3b12e471c534949e12d2da958fdf33848d153f2a0a88565bdef7ca999b5ad\",\n                            \"k8s.gcr.io/addon-resizer:1.8.7\"\n                        ],\n                        \"sizeBytes\": 37930718\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 11337839\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea\",\n                            \"k8s.gcr.io/pause:3.1\"\n                        ],\n                        \"sizeBytes\": 742472\n                    }\n                ],\n                \"config\": {}\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"bootstrap-e2e-minion-group-9k71\",\n                \"selfLink\": \"/api/v1/nodes/bootstrap-e2e-minion-group-9k71\",\n                \"uid\": \"9ec9ee26-84b2-42cc-9301-e7d5da3624f4\",\n                \"resourceVersion\": \"879\",\n                \"creationTimestamp\": \"2020-03-30T14:56:21Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west1-b\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"bootstrap-e2e-minion-group-9k71\",\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"10.64.1.0/24\",\n                \"podCIDRs\": [\n                    \"10.64.1.0/24\"\n                ],\n                \"providerID\": \"gce://k8s-e2e-gce-scalability/us-west1-b/bootstrap-e2e-minion-group-9k71\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"98868448Ki\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7658068Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"91117161526\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7402068Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"FrequentContainerdRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentContainerdRestart\",\n                        \"message\": \"containerd is functioning properly\"\n                    },\n                    {\n                        \"type\": \"KernelDeadlock\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"KernelHasNoDeadlock\",\n                        \"message\": \"kernel has no deadlock\"\n                    },\n                    {\n                        \"type\": \"ReadonlyFilesystem\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"FilesystemIsNotReadOnly\",\n                        \"message\": \"Filesystem is not read-only\"\n                    },\n                    {\n                        \"type\": \"CorruptDockerOverlay2\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoCorruptDockerOverlay2\",\n                        \"message\": \"docker overlay2 is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentUnregisterNetDevice\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentUnregisterNetDevice\",\n                        \"message\": \"node is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentKubeletRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentKubeletRestart\",\n                        \"message\": \"kubelet is functioning properly\"\n                    },\n                    {\n                        \"type\": \"FrequentDockerRestart\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:27Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:25Z\",\n                        \"reason\": \"NoFrequentDockerRestart\",\n                        \"message\": \"docker is functioning properly\"\n                    },\n                    {\n                        \"type\": \"NetworkUnavailable\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:56:30Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:30Z\",\n                        \"reason\": \"RouteCreated\",\n                        \"message\": \"RouteController created a route\"\n                    },\n                    {\n                        \"type\": \"MemoryPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:21Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:21Z\",\n                        \"reason\": \"KubeletHasSufficientMemory\",\n                        \"message\": \"kubelet has sufficient memory available\"\n                    },\n                    {\n                        \"type\": \"DiskPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:21Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:21Z\",\n                        \"reason\": \"KubeletHasNoDiskPressure\",\n                        \"message\": \"kubelet has no disk pressure\"\n                    },\n                    {\n                        \"type\": \"PIDPressure\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:21Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:21Z\",\n                        \"reason\": \"KubeletHasSufficientPID\",\n                        \"message\": \"kubelet has sufficient PID available\"\n                    },\n                    {\n                        \"type\": \"Ready\",\n                        \"status\": \"True\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:21Z\",\n                        \"lastTransitionTime\": \"2020-03-30T14:56:21Z\",\n                        \"reason\": \"KubeletReady\",\n                        \"message\": \"kubelet is posting ready status. AppArmor enabled\"\n                    }\n                ],\n                \"addresses\": [\n                    {\n                        \"type\": \"InternalIP\",\n                        \"address\": \"10.138.0.4\"\n                    },\n                    {\n                        \"type\": \"ExternalIP\",\n                        \"address\": \"35.185.239.166\"\n                    },\n                    {\n                        \"type\": \"InternalDNS\",\n                        \"address\": \"bootstrap-e2e-minion-group-9k71.c.k8s-e2e-gce-scalability.internal\"\n                    },\n                    {\n                        \"type\": \"Hostname\",\n                        \"address\": \"bootstrap-e2e-minion-group-9k71.c.k8s-e2e-gce-scalability.internal\"\n                    }\n                ],\n                \"daemonEndpoints\": {\n                    \"kubeletEndpoint\": {\n                        \"Port\": 10250\n                    }\n                },\n                \"nodeInfo\": {\n                    \"machineID\": \"c67ca3682c8651c74033c8b34c83ba83\",\n                    \"systemUUID\": \"C67CA368-2C86-51C7-4033-C8B34C83BA83\",\n                    \"bootID\": \"ce607320-656c-4259-a726-b6fe28d57e79\",\n                    \"kernelVersion\": \"4.14.94+\",\n                    \"osImage\": \"Container-Optimized OS from Google\",\n                    \"containerRuntimeVersion\": \"docker://18.9.3\",\n                    \"kubeletVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"kubeProxyVersion\": \"v1.16.9-beta.0.17+bb616cba1cc983\",\n                    \"operatingSystem\": \"linux\",\n                    \"architecture\": \"amd64\"\n                },\n                \"images\": [\n                    {\n                        \"names\": [\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent@sha256:6c8574a40816676cd908cfa89d16463002b56ca05fa76d0c912e116bc0ab867e\",\n                            \"gcr.io/stackdriver-agents/stackdriver-logging-agent:1.6.8\"\n                        ],\n                        \"sizeBytes\": 264721247\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/kube-proxy-amd64:v1.16.9-beta.0.17_bb616cba1cc983\"\n                        ],\n                        \"sizeBytes\": 96741051\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/heapster-amd64@sha256:9fae0af136ce0cf4f88393b3670f7139ffc464692060c374d2ae748e13144521\",\n                            \"k8s.gcr.io/heapster-amd64:v1.6.0-beta.1\"\n                        ],\n                        \"sizeBytes\": 76016169\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/prometheus-to-sd@sha256:14666989f40bb7c896c3e775a93c6873e2b791d65bc65579f58a078b7f9a764e\",\n                            \"k8s.gcr.io/prometheus-to-sd:v0.5.0\"\n                        ],\n                        \"sizeBytes\": 41861013\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/cluster-proportional-autoscaler-amd64@sha256:a2db01cfd2ae1a16f0feef274160c659c1ac5aa433e1c514de20e334cb66c674\",\n                            \"k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.7.1\"\n                        ],\n                        \"sizeBytes\": 40067731\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metrics-server-amd64@sha256:c9c4e95068b51d6b33a9dccc61875df07dc650abbf4ac1a19d58b4628f89288b\",\n                            \"k8s.gcr.io/metrics-server-amd64:v0.3.6\"\n                        ],\n                        \"sizeBytes\": 39944451\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/addon-resizer@sha256:30b3b12e471c534949e12d2da958fdf33848d153f2a0a88565bdef7ca999b5ad\",\n                            \"k8s.gcr.io/addon-resizer:1.8.7\"\n                        ],\n                        \"sizeBytes\": 37930718\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/metadata-proxy@sha256:e914645f22e946bce5165737e1b244e0a296ad1f0f81a9531adc57af2780978a\",\n                            \"k8s.gcr.io/metadata-proxy:v0.1.12\"\n                        ],\n                        \"sizeBytes\": 11337839\n                    },\n                    {\n                        \"names\": [\n                            \"k8s.gcr.io/pause@sha256:f78411e19d84a252e53bff71a4407a5686c46983a2c2eeed83929b888179acea\",\n                            \"k8s.gcr.io/pause:3.1\"\n                        ],\n                        \"sizeBytes\": 742472\n                    }\n                ],\n                \"config\": {}\n            }\n        },\n        {\n            \"metadata\": {\n                \"name\": \"bootstrap-e2e-minion-group-pmlp\",\n                \"selfLink\": \"/api/v1/nodes/bootstrap-e2e-minion-group-pmlp\",\n                \"uid\": \"0a70e03e-6f06-4a31-8129-7ab858d4a851\",\n                \"resourceVersion\": \"873\",\n                \"creationTimestamp\": \"2020-03-30T14:56:20Z\",\n                \"labels\": {\n                    \"beta.kubernetes.io/arch\": \"amd64\",\n                    \"beta.kubernetes.io/instance-type\": \"n1-standard-2\",\n                    \"beta.kubernetes.io/os\": \"linux\",\n                    \"cloud.google.com/metadata-proxy-ready\": \"true\",\n                    \"failure-domain.beta.kubernetes.io/region\": \"us-west1\",\n                    \"failure-domain.beta.kubernetes.io/zone\": \"us-west1-b\",\n                    \"kubernetes.io/arch\": \"amd64\",\n                    \"kubernetes.io/hostname\": \"bootstrap-e2e-minion-group-pmlp\",\n                    \"kubernetes.io/os\": \"linux\"\n                },\n                \"annotations\": {\n                    \"node.alpha.kubernetes.io/ttl\": \"0\",\n                    \"volumes.kubernetes.io/controller-managed-attach-detach\": \"true\"\n                }\n            },\n            \"spec\": {\n                \"podCIDR\": \"10.64.0.0/24\",\n                \"podCIDRs\": [\n                    \"10.64.0.0/24\"\n                ],\n                \"providerID\": \"gce://k8s-e2e-gce-scalability/us-west1-b/bootstrap-e2e-minion-group-pmlp\"\n            },\n            \"status\": {\n                \"capacity\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"98868448Ki\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7658060Ki\",\n                    \"pods\": \"110\"\n                },\n                \"allocatable\": {\n                    \"attachable-volumes-gce-pd\": \"127\",\n                    \"cpu\": \"2\",\n                    \"ephemeral-storage\": \"91117161526\",\n                    \"hugepages-2Mi\": \"0\",\n                    \"memory\": \"7402060Ki\",\n                    \"pods\": \"110\"\n                },\n                \"conditions\": [\n                    {\n                        \"type\": \"ReadonlyFilesystem\",\n                        \"status\": \"False\",\n                        \"lastHeartbeatTime\": \"2020-03-30T14:57:24Z\",\n                        \"lastTransition