This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 16 failed / 15 succeeded
Started2019-09-07 10:39
Elapsed53m3s
Revision
Buildergke-prow-ssd-pool-1a225945-xk3x
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/8b9d4305-51dd-486f-967e-0b900939de95/targets/test'}}
podc00cdb11-d15b-11e9-b9a4-9671c996ac62
resultstorehttps://source.cloud.google.com/results/invocations/8b9d4305-51dd-486f-967e-0b900939de95/targets/test
infra-commitd5d7ce3eb
job-versionv1.14.7-beta.0.24+f78564d9ba2908
master_os_image
node_os_imagecos-u-73-11647-267-0
podc00cdb11-d15b-11e9-b9a4-9671c996ac62
revisionv1.14.7-beta.0.24+f78564d9ba2908

Test Failures


IsUp 1m30s

error during kubectl get nodes --no-headers: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-cluster-lifecycle] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 36m50s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cluster\-lifecycle\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:91
Unexpected error:
    <*errors.errorString | 0xc002bdd510>: {
        s: "error running gcloud [container clusters --project=kube-gke-upg-1-2-1-3-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.30+d4ac850240563e --quiet]; got error exit status 1, stdout \"\", stderr \"Upgrading bootstrap-e2e...\\n.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\\n clusterConditions: []\\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.'\\n endTime: u'2019-09-07T11:06:22.499657654Z'\\n name: u'operation-1567853361019-b52a2fe5'\\n nodepoolConditions: []\\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/operations/operation-1567853361019-b52a2fe5'\\n startTime: u'2019-09-07T10:49:21.019209079Z'\\n status: StatusValueValuesEnum(DONE, 3)\\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.'\\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/clusters/bootstrap-e2e'\\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.\\n\"",
    }
    error running gcloud [container clusters --project=kube-gke-upg-1-2-1-3-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.30+d4ac850240563e --quiet]; got error exit status 1, stdout "", stderr "Upgrading bootstrap-e2e...\n.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\n clusterConditions: []\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.'\n endTime: u'2019-09-07T11:06:22.499657654Z'\n name: u'operation-1567853361019-b52a2fe5'\n nodepoolConditions: []\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/operations/operation-1567853361019-b52a2fe5'\n startTime: u'2019-09-07T10:49:21.019209079Z'\n status: StatusValueValuesEnum(DONE, 3)\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.'\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/clusters/bootstrap-e2e'\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] daemonset-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sdaemonset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc0029c2030>: {
        Op: "Get",
        URL: "https://35.239.50.112/api/v1/nodes",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/api/v1/nodes: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*DaemonSetUpgradeTest).validateRunningDaemonSet(0x7e9ddb8, 0xc000c2b400)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/daemonsets.go:114 +0xbe
k8s.io/kubernetes/test/e2e/upgrades/apps.(*DaemonSetUpgradeTest).Test(0x7e9ddb8, 0xc000c2b400, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/daemonsets.go:103 +0xa4
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc3c0, 0xc0010482c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc0010482c0, 0xc0035ba130)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] deployment-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sdeployment\-upgrade$'
Unexpected error:
    <*url.Error | 0xc002bca000>: {
        Op: "Get",
        URL: "https://35.239.50.112/apis/apps/v1/namespaces/sig-apps-deployment-upgrade-9148/deployments/dp",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/apis/apps/v1/namespaces/sig-apps-deployment-upgrade-9148/deployments/dp: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*DeploymentUpgradeTest).Test(0x7eaaa80, 0xc000be9e00, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/deployments.go:130 +0x259
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc240, 0xc0010481e0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc0010481e0, 0xc0035ba0e0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] job-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sjob\-upgrade$'
Unexpected error:
    <*url.Error | 0xc002970ae0>: {
        Op: "Get",
        URL: "https://35.239.50.112/api/v1/namespaces/sig-apps-job-upgrade-2765/pods?labelSelector=job%3Dfoo",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/api/v1/namespaces/sig-apps-job-upgrade-2765/pods?labelSelector=job%3Dfoo: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*JobUpgradeTest).Test(0x7ea6ad0, 0xc000c2a280, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/job.go:58 +0xe4
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc2c0, 0xc001048200)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048200, 0xc0035ba0f0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] replicaset-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sreplicaset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc002b42000>: {
        Op: "Get",
        URL: "https://35.239.50.112/apis/apps/v1/namespaces/sig-apps-replicaset-upgrade-6280/replicasets/rs",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/apis/apps/v1/namespaces/sig-apps-replicaset-upgrade-6280/replicasets/rs: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*ReplicaSetUpgradeTest).Test(0x7ea24d0, 0xc000be9540, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/replicasets.go:82 +0x275
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc180, 0xc001048180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048180, 0xc0035ba0c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] statefulset-upgrade 20m51s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sstatefulset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc0029c2930>: {
        Op: "Get",
        URL: "https://35.239.50.112/apis/apps/v1/namespaces/ss/statefulsets",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/apis/apps/v1/namespaces/ss/statefulsets: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.DeleteAllStatefulSets(0x4f77d60, 0xc001858780, 0x4617c61, 0x2)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:678 +0x1df
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).Teardown(0x7ea6ab0, 0xc000be9900)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:93 +0x53
panic(0x424a420, 0xc001c18680)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc001d0e000, 0x29f, 0x7d0790c, 0x6d, 0x10d, 0xc001730e00, 0x6fa)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc001d0e000, 0x29f, 0xc00246a190, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc001c18000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x0, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc001c18000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc002970000, 0x0, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).GetPodList(0xc00362c0d0, 0xc002a7f200, 0x40fb88)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:269 +0x1ed
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).ExecInStatefulPods(0xc00362c0d0, 0xc002a7f200, 0xc00246a5c0, 0xe, 0x1, 0xc001d4a980)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:135 +0x50
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).CheckMount(0xc00362c0d0, 0xc002a7f200, 0x461a029, 0x5, 0x0, 0xc003671eb0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:126 +0x3cb
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).verify(0x7ea6ab0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:98 +0x7a
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).Test(0x7ea6ab0, 0xc000be9900, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:88 +0x42
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc200, 0xc0010481c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc0010481c0, 0xc0035ba0d0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cluster-lifecycle] master-upgrade 17m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cluster\-lifecycle\]\smaster\-upgrade$'
Unexpected error:
    <*errors.errorString | 0xc002bdd510>: {
        s: "error running gcloud [container clusters --project=kube-gke-upg-1-2-1-3-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.30+d4ac850240563e --quiet]; got error exit status 1, stdout \"\", stderr \"Upgrading bootstrap-e2e...\\n.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\\n clusterConditions: []\\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.'\\n endTime: u'2019-09-07T11:06:22.499657654Z'\\n name: u'operation-1567853361019-b52a2fe5'\\n nodepoolConditions: []\\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/operations/operation-1567853361019-b52a2fe5'\\n startTime: u'2019-09-07T10:49:21.019209079Z'\\n status: StatusValueValuesEnum(DONE, 3)\\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.'\\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/clusters/bootstrap-e2e'\\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-354142721a247204ccc2-a88d\\\" is unhealthy.\\n\"",
    }
    error running gcloud [container clusters --project=kube-gke-upg-1-2-1-3-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.30+d4ac850240563e --quiet]; got error exit status 1, stdout "", stderr "Upgrading bootstrap-e2e...\n.......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\n clusterConditions: []\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.'\n endTime: u'2019-09-07T11:06:22.499657654Z'\n name: u'operation-1567853361019-b52a2fe5'\n nodepoolConditions: []\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/operations/operation-1567853361019-b52a2fe5'\n startTime: u'2019-09-07T10:49:21.019209079Z'\n status: StatusValueValuesEnum(DONE, 3)\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.'\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/192466456998/zones/us-central1-c/clusters/bootstrap-e2e'\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-354142721a247204ccc2-a88d\" is unhealthy.\n"
occurred

k8s.io/kubernetes/test/e2e/lifecycle.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:106 +0xfd
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc0019f5350)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x358
k8s.io/kubernetes/test/e2e/lifecycle.runUpgradeSuite(0xc000be8a00, 0x7d59460, 0xc, 0xc, 0xc000cc9140, 0xc002837d10, 0xc00352fb00, 0x0, 0xc002aad6a0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:483 +0x458
k8s.io/kubernetes/test/e2e/lifecycle.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:109 +0x227
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000248700)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:243 +0x237
k8s.io/kubernetes/test/e2e.TestE2E(0xc000248700)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:96 +0x2b
testing.tRunner(0xc000248700, 0x47cc2b0)
	/usr/local/go/src/testing/testing.go:865 +0xc0
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:916 +0x35a
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] [sig-api-machinery] configmap-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\s\[sig\-api\-machinery\]\sconfigmap\-upgrade$'
Error creating Pod
Unexpected error:
    <*url.Error | 0xc002bce1b0>: {
        Op: "Post",
        URL: "https://35.239.50.112/api/v1/namespaces/sig-storage-sig-api-machinery-configmap-upgrade-3590/pods",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Post https://35.239.50.112/api/v1/namespaces/sig-storage-sig-api-machinery-configmap-upgrade-3590/pods: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc00245ce40, 0xc002958700, 0x34)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000c2a780, 0xc002958700, 0x4655850, 0x15, 0xc001ddbe58, 0x2, 0x2, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000c2a780, 0x4667b0f, 0x18, 0xc002958700, 0x0, 0xc000bfee58, 0x2, 0x2, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades.(*ConfigMapUpgradeTest).testPod(0x7e9ddb0, 0xc000c2a780)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/configmaps.go:147 +0x9aa
k8s.io/kubernetes/test/e2e/upgrades.(*ConfigMapUpgradeTest).Test(0x7e9ddb0, 0xc000c2a780, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/configmaps.go:73 +0x76
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc300, 0xc001048220)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048220, 0xc0035ba100)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] [sig-api-machinery] secret-upgrade 20m21s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\s\[sig\-api\-machinery\]\ssecret\-upgrade$'
Error creating Pod
Unexpected error:
    <*url.Error | 0xc002b421b0>: {
        Op: "Post",
        URL: "https://35.239.50.112/api/v1/namespaces/sig-storage-sig-api-machinery-secret-upgrade-2627/pods",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Post https://35.239.50.112/api/v1/namespaces/sig-storage-sig-api-machinery-secret-upgrade-2627/pods: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc002392120, 0xc00071a380, 0x31)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000be9180, 0xc00071a380, 0x464715b, 0x12, 0xc001ddfe58, 0x2, 0x2, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000be9180, 0x465c69f, 0x16, 0xc00071a380, 0x0, 0xc000bfde58, 0x2, 0x2, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades.(*SecretUpgradeTest).testPod(0x7e9dda8, 0xc000be9180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/secrets.go:144 +0x9a7
k8s.io/kubernetes/test/e2e/upgrades.(*SecretUpgradeTest).Test(0x7e9dda8, 0xc000be9180, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/secrets.go:71 +0x76
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc140, 0xc001048160)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048160, 0xc0035ba0a0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] persistent-volume-upgrade 21m24s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\spersistent\-volume\-upgrade$'
Sep  7 11:07:59.313: Failed to delete 1 or more PVs/PVCs and/or the GCE volume. Errors: [failed to delete PVC "pvc-t2trr": PVC Delete API error: Delete https://35.239.50.112/api/v1/namespaces/sig-storage-persistent-volume-upgrade-1263/persistentvolumeclaims/pvc-t2trr: dial tcp 35.239.50.112:443: i/o timeout, failed to delete PV "pv-upgradez42s7": PV Delete API error: Delete https://35.239.50.112/api/v1/persistentvolumes/pv-upgradez42s7: dial tcp 35.239.50.112:443: i/o timeout]

k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).Teardown(0x7ea6af0, 0xc000c2b040)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:93 +0x19c
panic(0x424a420, 0xc0017a0780)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc0006ec280, 0x27c, 0x7d07d2b, 0x60, 0x50, 0xc002431000, 0x7ed)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc0006ec280, 0x27c, 0xc001e16260, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0017a00c0, 0x4e82e00, 0x7ecac68, 0x0, 0xc002b50010, 0x1, 0x1, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc0017a00c0, 0x4e82e00, 0x7ecac68, 0xc002b50010, 0x1, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc002bce030, 0xc002b50010, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc00203faa0, 0xc003792a80, 0x2a)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000c2b040, 0xc003792a80, 0x4624b63, 0x9, 0xc003507e98, 0x1, 0x1, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000c2b040, 0x46390b8, 0xf, 0xc003792a80, 0x0, 0xc000bffe98, 0x1, 0x1, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).testPod(0x7ea6af0, 0xc000c2b040, 0x4695ef2, 0x20)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:101 +0x118
k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).Test(0x7ea6af0, 0xc000c2b040, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:83 +0x8f
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc380, 0xc001048280)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048280, 0xc0035ba120)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade apparmor-upgrade 20m51s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\sapparmor\-upgrade$'
Should be able to get pod
Unexpected error:
    <*url.Error | 0xc002992060>: {
        Op: "Get",
        URL: "https://35.239.50.112/api/v1/namespaces/apparmor-upgrade-6288/pods/test-apparmor-wwkrq",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/api/v1/namespaces/apparmor-upgrade-6288/pods/test-apparmor-wwkrq: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades.(*AppArmorUpgradeTest).verifyPodStillUp(0x7e9ddc0, 0xc000c2b900)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apparmor.go:89 +0x159
k8s.io/kubernetes/test/e2e/upgrades.(*AppArmorUpgradeTest).Test(0x7e9ddc0, 0xc000c2b900, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apparmor.go:73 +0x94
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc400, 0xc001048300)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048300, 0xc0035ba140)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade hpa-upgrade 23m46s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\shpa\-upgrade$'
Unexpected error:
    <*url.Error | 0xc0029c2e40>: {
        Op: "Get",
        URL: "https://35.239.50.112/api/v1/namespaces/hpa-upgrade-820/replicationcontrollers/res-cons-upgrade",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 50, 112],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.50.112/api/v1/namespaces/hpa-upgrade-820/replicationcontrollers/res-cons-upgrade: dial tcp 35.239.50.112:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).CleanUp(0xc003680c30)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:433 +0x20b
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).Teardown(0x7ea24e0, 0xc000c2ab40)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:75 +0x55
panic(0x424a420, 0xc0013da540)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc000904000, 0x277, 0x7cf5db2, 0x6a, 0x151, 0xc00171e000, 0x8a6)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc000904000, 0x277, 0xc00091e450, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0013da140, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x0, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc0013da140, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc002b5c030, 0x0, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).GetReplicas(0xc003680c30, 0x40f2f9)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:337 +0x66c
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).WaitForReplicas.func1(0xc001432d38, 0x10ccbdd, 0x40433c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:369 +0x37
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.pollImmediateInternal(0xc0020200c0, 0xc0021c8040, 0xc0020200c0, 0xc0021c8040)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:330 +0x2b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x4a817c800, 0xd18c2e2800, 0xc0021c8040, 0x1, 0x26)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:326 +0x4d
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).WaitForReplicas(0xc003680c30, 0x1, 0xd18c2e2800)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:368 +0x81
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).test(0x7ea24e0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:85 +0x213
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).Test(0x7ea24e0, 0xc000c2ab40, 0xc0035e4060, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:68 +0x99
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc0035bc340, 0xc001048240)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc001048240, 0xc0035ba110)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


TearDown 30s

error deleting cluster: error during gcloud container clusters delete -q bootstrap-e2e --project=kube-gke-upg-1-2-1-3-ctl-skew --zone=us-central1-c: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 37m16s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-image=gci --upgrade-target=ci/k8s-stable1 --num-nodes=3 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


diffResources 0.00s

Error: 40 leaked resources
+NAME                                     MACHINE_TYPE   PREEMPTIBLE  CREATION_TIMESTAMP
+gke-bootstrap-e2e-default-pool-f191f1b4  n1-standard-2               2019-09-07T03:42:45.074-07:00
+NAME                                         LOCATION       SCOPE  NETWORK        MANAGED  INSTANCES
+gke-bootstrap-e2e-default-pool-f191f1b4-grp  us-central1-c  zone   bootstrap-e2e  Yes      3
+NAME                                          ZONE           MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP     STATUS
+gke-bootstrap-e2e-default-pool-f191f1b4-k9m2  us-central1-c  n1-standard-2               10.128.0.3   35.192.211.43   RUNNING
+gke-bootstrap-e2e-default-pool-f191f1b4-nh0r  us-central1-c  n1-standard-2               10.128.0.2   34.68.148.178   RUNNING
+gke-bootstrap-e2e-default-pool-f191f1b4-wxvl  us-central1-c  n1-standard-2               10.128.0.4   104.198.58.197  RUNNING
+NAME                                                             LOCATION       LOCATION_SCOPE  SIZE_GB  TYPE         STATUS
+gke-bootstrap-e2e-3541-pvc-c3103450-d15c-11e9-9f44-42010a80002f  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-3541-pvc-d5a6f820-d15c-11e9-9f44-42010a80002f  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-3541-pvc-e19a0084-d15c-11e9-9f44-42010a80002f  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-default-pool-f191f1b4-k9m2                     us-central1-c  zone            100      pd-standard  READY
+gke-bootstrap-e2e-default-pool-f191f1b4-nh0r                     us-central1-c  zone            100      pd-standard  READY
+gke-bootstrap-e2e-default-pool-f191f1b4-wxvl                     us-central1-c  zone            100      pd-standard  READY
+default-route-06f110d193efc35e                                   bootstrap-e2e  10.164.0.0/20  bootstrap-e2e                                                         1000
+default-route-15884c362a6a8af9                                   bootstrap-e2e  10.166.0.0/20  bootstrap-e2e                                                         1000
+default-route-20f0f843af723181                                   bootstrap-e2e  10.174.0.0/20  bootstrap-e2e                                                         1000
+default-route-22a456a9c584721e                                   bootstrap-e2e  10.146.0.0/20  bootstrap-e2e                                                         1000
+default-route-283330de5ea2b2d5                                   bootstrap-e2e  10.168.0.0/20  bootstrap-e2e                                                         1000
+default-route-306e1fdd8ba05717                                   bootstrap-e2e  10.128.0.0/20  bootstrap-e2e                                                         1000
+default-route-356ae874dfcc569d                                   bootstrap-e2e  10.172.0.0/20  bootstrap-e2e                                                         1000
+default-route-42bb610638fabe9a                                   bootstrap-e2e  0.0.0.0/0      default-internet-gateway                                              1000
+default-route-4372224e925cfd51                                   bootstrap-e2e  10.158.0.0/20  bootstrap-e2e                                                         1000
+default-route-456b418678e15199                                   bootstrap-e2e  10.170.0.0/20  bootstrap-e2e                                                         1000
+default-route-656315059f73edbe                                   bootstrap-e2e  10.152.0.0/20  bootstrap-e2e                                                         1000
+default-route-6ba24ed1bd5040ae                                   bootstrap-e2e  10.150.0.0/20  bootstrap-e2e                                                         1000
+default-route-7a4056765f0a7121                                   bootstrap-e2e  10.140.0.0/20  bootstrap-e2e                                                         1000
+default-route-7c85b41402bd4e47                                   bootstrap-e2e  10.142.0.0/20  bootstrap-e2e                                                         1000
+default-route-8a944f49a8bf361d                                   bootstrap-e2e  10.156.0.0/20  bootstrap-e2e                                                         1000
+default-route-8ac9d7f081409e9f                                   bootstrap-e2e  10.160.0.0/20  bootstrap-e2e                                                         1000
+default-route-a29d7832ba5f7503                                   bootstrap-e2e  10.132.0.0/20  bootstrap-e2e                                                         1000
+default-route-ab964dbc9944da9f                                   bootstrap-e2e  10.154.0.0/20  bootstrap-e2e                                                         1000
+default-route-ad4d3060d7199588                                   bootstrap-e2e  10.148.0.0/20  bootstrap-e2e                                                         1000
+default-route-cae5cbb0634249d0                                   bootstrap-e2e  10.162.0.0/20  bootstrap-e2e                                                         1000
+default-route-d2bbfcf72eded8ec                                   bootstrap-e2e  10.138.0.0/20  bootstrap-e2e                                                         1000
+gke-bootstrap-e2e-35414272-a1721b35-d15c-11e9-9f44-42010a80002f  bootstrap-e2e  10.4.0.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-f191f1b4-k9m2  1000
+gke-bootstrap-e2e-35414272-a178dd05-d15c-11e9-9f44-42010a80002f  bootstrap-e2e  10.4.1.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-f191f1b4-nh0r  1000
+gke-bootstrap-e2e-35414272-a179b892-d15c-11e9-9f44-42010a80002f  bootstrap-e2e  10.4.2.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-f191f1b4-wxvl  1000
+k8s-fw-ac3050c8bd15c11e99f4442010a80002  bootstrap-e2e  INGRESS    1000      tcp:80                              False
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 15 Passed Tests

Show 4413 Skipped Tests