This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 17 failed / 14 succeeded
Started2019-09-01 10:30
Elapsed47m29s
Revision
Buildergke-prow-ssd-pool-1a225945-mv4c
links{u'resultstore': {u'url': u'https://source.cloud.google.com/results/invocations/80851acd-59fc-4523-8652-57f84150777c/targets/test'}}
pod6540f802-cca3-11e9-9abc-1abf1f9e6e59
resultstorehttps://source.cloud.google.com/results/invocations/80851acd-59fc-4523-8652-57f84150777c/targets/test
infra-commitb4aa999c2
job-versionv1.14.7-beta.0.24+f78564d9ba2908
master_os_image
node_os_imagecos-u-73-11647-267-0
pod6540f802-cca3-11e9-9abc-1abf1f9e6e59
revisionv1.14.7-beta.0.24+f78564d9ba2908

Test Failures


Deferred TearDown 6.47s

error deleting cluster: error during gcloud container clusters delete -q bootstrap-e2e --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


IsUp 2m31s

error during kubectl get nodes --no-headers: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Kubernetes e2e suite [sig-cluster-lifecycle] Upgrade [Feature:Upgrade] master upgrade should maintain a functioning cluster [Feature:MasterUpgrade] 34m29s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[sig\-cluster\-lifecycle\]\sUpgrade\s\[Feature\:Upgrade\]\smaster\supgrade\sshould\smaintain\sa\sfunctioning\scluster\s\[Feature\:MasterUpgrade\]$'
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:91
Unexpected error:
    <*errors.errorString | 0xc0006524d0>: {
        s: "error running gcloud [container clusters --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.28+bd82bb9f5cb2d4 --quiet]; got error exit status 1, stdout \"\", stderr \"Upgrading bootstrap-e2e...\\n......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\\n clusterConditions: []\\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.'\\n endTime: u'2019-09-01T10:54:45.005845353Z'\\n name: u'operation-1567334424321-13c3b42b'\\n nodepoolConditions: []\\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/operations/operation-1567334424321-13c3b42b'\\n startTime: u'2019-09-01T10:40:24.321719911Z'\\n status: StatusValueValuesEnum(DONE, 3)\\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.'\\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/clusters/bootstrap-e2e'\\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.\\n\"",
    }
    error running gcloud [container clusters --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.28+bd82bb9f5cb2d4 --quiet]; got error exit status 1, stdout "", stderr "Upgrading bootstrap-e2e...\n......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\n clusterConditions: []\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.'\n endTime: u'2019-09-01T10:54:45.005845353Z'\n name: u'operation-1567334424321-13c3b42b'\n nodepoolConditions: []\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/operations/operation-1567334424321-13c3b42b'\n startTime: u'2019-09-01T10:40:24.321719911Z'\n status: StatusValueValuesEnum(DONE, 3)\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.'\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/clusters/bootstrap-e2e'\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.\n"
occurred
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:106
				
				Click to see stdout/stderrfrom junit_upgrade01.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] daemonset-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sdaemonset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc000a40000>: {
        Op: "Get",
        URL: "https://35.239.171.119/api/v1/nodes",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/api/v1/nodes: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*DaemonSetUpgradeTest).validateRunningDaemonSet(0x7e9ddb8, 0xc000c36780)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/daemonsets.go:114 +0xbe
k8s.io/kubernetes/test/e2e/upgrades/apps.(*DaemonSetUpgradeTest).Test(0x7e9ddb8, 0xc000c36780, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/daemonsets.go:103 +0xa4
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eeea80, 0xc00244ad40)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ad40, 0xc001ccc830)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] deployment-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sdeployment\-upgrade$'
Unexpected error:
    <*url.Error | 0xc0009a4090>: {
        Op: "Get",
        URL: "https://35.239.171.119/apis/apps/v1/namespaces/sig-apps-deployment-upgrade-4846/deployments/dp",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/apis/apps/v1/namespaces/sig-apps-deployment-upgrade-4846/deployments/dp: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*DeploymentUpgradeTest).Test(0x7eaaa80, 0xc000bf7180, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/deployments.go:130 +0x259
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee840, 0xc00244aca0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244aca0, 0xc001ccc7d0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] job-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sjob\-upgrade$'
Unexpected error:
    <*url.Error | 0xc0009a41e0>: {
        Op: "Get",
        URL: "https://35.239.171.119/api/v1/namespaces/sig-apps-job-upgrade-5282/pods?labelSelector=job%3Dfoo",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/api/v1/namespaces/sig-apps-job-upgrade-5282/pods?labelSelector=job%3Dfoo: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*JobUpgradeTest).Test(0x7ea6ad0, 0xc000bf7540, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/job.go:58 +0xe4
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee940, 0xc00244acc0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244acc0, 0xc001ccc7f0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] replicaset-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sreplicaset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc00229a240>: {
        Op: "Get",
        URL: "https://35.239.171.119/apis/apps/v1/namespaces/sig-apps-replicaset-upgrade-961/replicasets/rs",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/apis/apps/v1/namespaces/sig-apps-replicaset-upgrade-961/replicasets/rs: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades/apps.(*ReplicaSetUpgradeTest).Test(0x7ea24d0, 0xc000bf68c0, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/replicasets.go:82 +0x275
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee740, 0xc00244ac40)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ac40, 0xc001ccc7b0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-apps] statefulset-upgrade 18m30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-apps\]\sstatefulset\-upgrade$'
Unexpected error:
    <*url.Error | 0xc000a407e0>: {
        Op: "Get",
        URL: "https://35.239.171.119/apis/apps/v1/namespaces/ss/statefulsets",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/apis/apps/v1/namespaces/ss/statefulsets: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.DeleteAllStatefulSets(0x4f77d60, 0xc0023a92c0, 0x4617c61, 0x2)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:678 +0x1df
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).Teardown(0x7ea6ab0, 0xc000bf6dc0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:93 +0x53
panic(0x424a420, 0xc0022fc200)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc002414000, 0x2a3, 0x7d0790c, 0x6d, 0x10d, 0xc0021d3500, 0x6fa)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc002414000, 0x2a3, 0xc001bec2d0, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0022fc000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x0, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc0022fc000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc0009ba000, 0x0, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).GetPodList(0xc001ccccd0, 0xc000552d80, 0x40fb88)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:269 +0x1ed
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).ExecInStatefulPods(0xc001ccccd0, 0xc000552d80, 0xc001f3a820, 0xe, 0x1, 0xc001fe00a0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:135 +0x50
k8s.io/kubernetes/test/e2e/framework.(*StatefulSetTester).CheckMount(0xc001ccccd0, 0xc000552d80, 0x461a029, 0x5, 0x0, 0xc001413eb0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/statefulset_utils.go:126 +0x3cb
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).verify(0x7ea6ab0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:98 +0x7a
k8s.io/kubernetes/test/e2e/upgrades/apps.(*StatefulSetUpgradeTest).Test(0x7ea6ab0, 0xc000bf6dc0, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apps/statefulset.go:88 +0x42
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee7c0, 0xc00244ac80)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ac80, 0xc001ccc7c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-cluster-lifecycle] master-upgrade 14m25s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-cluster\-lifecycle\]\smaster\-upgrade$'
Unexpected error:
    <*errors.errorString | 0xc0006524d0>: {
        s: "error running gcloud [container clusters --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.28+bd82bb9f5cb2d4 --quiet]; got error exit status 1, stdout \"\", stderr \"Upgrading bootstrap-e2e...\\n......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\\n clusterConditions: []\\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.'\\n endTime: u'2019-09-01T10:54:45.005845353Z'\\n name: u'operation-1567334424321-13c3b42b'\\n nodepoolConditions: []\\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/operations/operation-1567334424321-13c3b42b'\\n startTime: u'2019-09-01T10:40:24.321719911Z'\\n status: StatusValueValuesEnum(DONE, 3)\\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.'\\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/clusters/bootstrap-e2e'\\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \\\"kube-apiserver\\\" from endpoint \\\"gke-9a1659de8907c44e3471-3fb3\\\" is unhealthy.\\n\"",
    }
    error running gcloud [container clusters --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c upgrade bootstrap-e2e --master --cluster-version=1.15.4-beta.0.28+bd82bb9f5cb2d4 --quiet]; got error exit status 1, stdout "", stderr "Upgrading bootstrap-e2e...\n......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done.\nERROR: (gcloud.container.clusters.upgrade) Operation [<Operation\n clusterConditions: []\n detail: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.'\n endTime: u'2019-09-01T10:54:45.005845353Z'\n name: u'operation-1567334424321-13c3b42b'\n nodepoolConditions: []\n operationType: OperationTypeValueValuesEnum(UPGRADE_MASTER, 3)\n selfLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/operations/operation-1567334424321-13c3b42b'\n startTime: u'2019-09-01T10:40:24.321719911Z'\n status: StatusValueValuesEnum(DONE, 3)\n statusMessage: u'All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.'\n targetLink: u'https://test-container.sandbox.googleapis.com/v1/projects/156903543516/zones/us-central1-c/clusters/bootstrap-e2e'\n zone: u'us-central1-c'>] finished with error: All cluster resources were brought up, but the cluster API is reporting that: component \"kube-apiserver\" from endpoint \"gke-9a1659de8907c44e3471-3fb3\" is unhealthy.\n"
occurred

k8s.io/kubernetes/test/e2e/lifecycle.glob..func2.1.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:106 +0xfd
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do(0xc00259f350)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:111 +0x358
k8s.io/kubernetes/test/e2e/lifecycle.runUpgradeSuite(0xc000bb5cc0, 0x7d59460, 0xc, 0xc, 0xc000a90f90, 0xc001e67b30, 0xc00244a9a0, 0x0, 0xc001ec87c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:483 +0x458
k8s.io/kubernetes/test/e2e/lifecycle.glob..func2.1.1()
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:109 +0x227
k8s.io/kubernetes/test/e2e.RunE2ETests(0xc000215200)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:243 +0x237
k8s.io/kubernetes/test/e2e.TestE2E(0xc000215200)
	_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:96 +0x2b
testing.tRunner(0xc000215200, 0x47cc2b0)
	/usr/local/go/src/testing/testing.go:865 +0xc0
created by testing.(*T).Run
	/usr/local/go/src/testing/testing.go:916 +0x35a
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] [sig-api-machinery] configmap-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\s\[sig\-api\-machinery\]\sconfigmap\-upgrade$'
Error creating Pod
Unexpected error:
    <*url.Error | 0xc00229a3c0>: {
        Op: "Post",
        URL: "https://35.239.171.119/api/v1/namespaces/sig-storage-sig-api-machinery-configmap-upgrade-9248/pods",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Post https://35.239.171.119/api/v1/namespaces/sig-storage-sig-api-machinery-configmap-upgrade-9248/pods: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc001bf2780, 0xc0029be380, 0x34)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000bf7a40, 0xc0029be380, 0x4655850, 0x15, 0xc00251fe58, 0x2, 0x2, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000bf7a40, 0x4667b0f, 0x18, 0xc0029be380, 0x0, 0xc00262ee58, 0x2, 0x2, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades.(*ConfigMapUpgradeTest).testPod(0x7e9ddb0, 0xc000bf7a40)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/configmaps.go:147 +0x9aa
k8s.io/kubernetes/test/e2e/upgrades.(*ConfigMapUpgradeTest).Test(0x7e9ddb0, 0xc000bf7a40, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/configmaps.go:73 +0x76
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee980, 0xc00244ace0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ace0, 0xc001ccc800)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] [sig-api-machinery] secret-upgrade 18m0s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\s\[sig\-api\-machinery\]\ssecret\-upgrade$'
Error creating Pod
Unexpected error:
    <*url.Error | 0xc0009bab10>: {
        Op: "Post",
        URL: "https://35.239.171.119/api/v1/namespaces/sig-storage-sig-api-machinery-secret-upgrade-9188/pods",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Post https://35.239.171.119/api/v1/namespaces/sig-storage-sig-api-machinery-secret-upgrade-9188/pods: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc001a64bc0, 0xc000179500, 0x31)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000bf6500, 0xc000179500, 0x464715b, 0x12, 0xc0025b9e58, 0x2, 0x2, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000bf6500, 0x465c69f, 0x16, 0xc000179500, 0x0, 0xc00262ae58, 0x2, 0x2, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades.(*SecretUpgradeTest).testPod(0x7e9dda8, 0xc000bf6500)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/secrets.go:144 +0x9a7
k8s.io/kubernetes/test/e2e/upgrades.(*SecretUpgradeTest).Test(0x7e9dda8, 0xc000bf6500, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/secrets.go:71 +0x76
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eee680, 0xc00244ac20)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ac20, 0xc001ccc780)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade [sig-storage] persistent-volume-upgrade 19m2s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\s\[sig\-storage\]\spersistent\-volume\-upgrade$'
Sep  1 10:56:21.096: Failed to delete 1 or more PVs/PVCs and/or the GCE volume. Errors: [failed to delete PVC "pvc-jxmdl": PVC Delete API error: Delete https://35.239.171.119/api/v1/namespaces/sig-storage-persistent-volume-upgrade-5159/persistentvolumeclaims/pvc-jxmdl: dial tcp 35.239.171.119:443: i/o timeout, failed to delete PV "pv-upgrade7l58v": PV Delete API error: Delete https://35.239.171.119/api/v1/persistentvolumes/pv-upgrade7l58v: dial tcp 35.239.171.119:443: i/o timeout]

k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).Teardown(0x7ea6af0, 0xc000c363c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:93 +0x19c
panic(0x424a420, 0xc002274a40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc0007c2500, 0x280, 0x7d07d2b, 0x60, 0x50, 0xc001e3d800, 0x7ed)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc0007c2500, 0x280, 0xc001a7c9d0, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc002274840, 0x4e82e00, 0x7ecac68, 0x0, 0xc0004feb60, 0x1, 0x1, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc002274840, 0x4e82e00, 0x7ecac68, 0xc0004feb60, 0x1, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc0009a4300, 0xc0004feb60, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/framework.(*PodClient).Create(0xc002467cc0, 0xc000461180, 0x2a)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/pods.go:80 +0xe4
k8s.io/kubernetes/test/e2e/framework.(*Framework).MatchContainerOutput(0xc000c363c0, 0xc000461180, 0x4624b63, 0x9, 0xc003e01e98, 0x1, 0x1, 0x47d0180, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2358 +0xb0
k8s.io/kubernetes/test/e2e/framework.(*Framework).testContainerOutputMatcher(0xc000c363c0, 0x46390b8, 0xf, 0xc000461180, 0x0, 0xc00262ce98, 0x1, 0x1, 0x47d0180)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2342 +0x1bb
k8s.io/kubernetes/test/e2e/framework.(*Framework).TestContainerOutput(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:468
k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).testPod(0x7ea6af0, 0xc000c363c0, 0x4695ef2, 0x20)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:101 +0x118
k8s.io/kubernetes/test/e2e/upgrades/storage.(*PersistentVolumeUpgradeTest).Test(0x7ea6af0, 0xc000c363c0, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/storage/persistent_volumes.go:83 +0x8f
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eeea40, 0xc00244ad20)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ad20, 0xc001ccc820)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade apparmor-upgrade 18m30s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\sapparmor\-upgrade$'
Should be able to get pod
Unexpected error:
    <*url.Error | 0xc0009ba4b0>: {
        Op: "Get",
        URL: "https://35.239.171.119/api/v1/namespaces/apparmor-upgrade-3547/pods/test-apparmor-q2tbw",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/api/v1/namespaces/apparmor-upgrade-3547/pods/test-apparmor-q2tbw: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/upgrades.(*AppArmorUpgradeTest).verifyPodStillUp(0x7e9ddc0, 0xc000c36c80)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apparmor.go:89 +0x159
k8s.io/kubernetes/test/e2e/upgrades.(*AppArmorUpgradeTest).Test(0x7e9ddc0, 0xc000c36c80, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/apparmor.go:73 +0x94
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eeeac0, 0xc00244ad60)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ad60, 0xc001ccc840)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


Master upgrade hpa-upgrade 21m25s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Master\supgrade\shpa\-upgrade$'
Unexpected error:
    <*url.Error | 0xc00229a960>: {
        Op: "Get",
        URL: "https://35.239.171.119/api/v1/namespaces/hpa-upgrade-136/replicationcontrollers/res-cons-upgrade",
        Err: {
            Op: "dial",
            Net: "tcp",
            Source: nil,
            Addr: {
                IP: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 255, 255, 35, 239, 171, 119],
                Port: 443,
                Zone: "",
            },
            Err: {},
        },
    }
    Get https://35.239.171.119/api/v1/namespaces/hpa-upgrade-136/replicationcontrollers/res-cons-upgrade: dial tcp 35.239.171.119:443: i/o timeout
occurred

k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).CleanUp(0xc00133ec30)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:433 +0x20b
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).Teardown(0x7ea24e0, 0xc000bf7e00)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:75 +0x55
panic(0x424a420, 0xc002550200)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc000784000, 0x27b, 0x7cf5db2, 0x6a, 0x151, 0xc000dc4000, 0x8a6)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa1
panic(0x3acfc00, 0x4d70c40)
	/usr/local/go/src/runtime/panic.go:522 +0x1b5
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc000784000, 0x27b, 0xc001f3a260, 0x1, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x19b
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc002550000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x0, 0x7ecac68)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:75 +0x1f1
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).NotTo(0xc002550000, 0x4e82e00, 0x7ecac68, 0x0, 0x0, 0x0, 0x1)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:48 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, 0x4e27900, 0xc002320030, 0x0, 0x0, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2073 +0x191
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/util.go:2064
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).GetReplicas(0xc00133ec30, 0x40f2f9)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:337 +0x66c
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).WaitForReplicas.func1(0xc00262dd38, 0x10ccbdd, 0x40433c0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:369 +0x37
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.pollImmediateInternal(0xc001ca1fa0, 0xc001a64ce0, 0xc001ca1fa0, 0xc001a64ce0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:330 +0x2b
k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate(0x4a817c800, 0xd18c2e2800, 0xc001a64ce0, 0x1, 0x26)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:326 +0x4d
k8s.io/kubernetes/test/e2e/common.(*ResourceConsumer).WaitForReplicas(0xc00133ec30, 0x1, 0xd18c2e2800)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/common/autoscaling_utils.go:368 +0x81
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).test(0x7ea24e0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:85 +0x213
k8s.io/kubernetes/test/e2e/upgrades.(*HPAUpgradeTest).Test(0x7ea24e0, 0xc000bf7e00, 0xc003e9c660, 0x0)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/upgrades/horizontal_pod_autoscalers.go:68 +0x99
k8s.io/kubernetes/test/e2e/lifecycle.(*chaosMonkeyAdapter).Test(0xc001eeea00, 0xc00244ad00)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/lifecycle/cluster_upgrade.go:397 +0x309
k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do.func1(0xc00244ad00, 0xc001ccc810)
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:90 +0x76
created by k8s.io/kubernetes/test/e2e/chaosmonkey.(*Chaosmonkey).Do
	/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/chaosmonkey/chaosmonkey.go:87 +0xa7
				from junit_upgradeupgrades.xml

Filter through log files | View test history on testgrid


TearDown 41s

error deleting cluster: error during gcloud container clusters delete -q bootstrap-e2e --project=k8s-gke-cvm-1-6-1-5-ctl-skew --zone=us-central1-c: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


UpgradeTest 34m56s

error during kubetest --test --test_args=--ginkgo.focus=\[Feature:MasterUpgrade\] --upgrade-image=gci --upgrade-target=ci/k8s-stable1 --num-nodes=3 --report-dir=/workspace/_artifacts --disable-log-dump=true --report-prefix=upgrade --check-version-skew=false: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


diffResources 0.01s

Error: 39 leaked resources
+NAME                                     MACHINE_TYPE   PREEMPTIBLE  CREATION_TIMESTAMP
+gke-bootstrap-e2e-default-pool-6deb451a  n1-standard-2               2019-09-01T03:32:50.445-07:00
+NAME                                         LOCATION       SCOPE  NETWORK        MANAGED  INSTANCES
+gke-bootstrap-e2e-default-pool-6deb451a-grp  us-central1-c  zone   bootstrap-e2e  Yes      3
+NAME                                          ZONE           MACHINE_TYPE   PREEMPTIBLE  INTERNAL_IP  EXTERNAL_IP    STATUS
+gke-bootstrap-e2e-default-pool-6deb451a-7dk9  us-central1-c  n1-standard-2               10.128.0.2   35.238.137.76  RUNNING
+gke-bootstrap-e2e-default-pool-6deb451a-thmn  us-central1-c  n1-standard-2               10.128.0.3   35.193.158.65  RUNNING
+gke-bootstrap-e2e-default-pool-6deb451a-tkrr  us-central1-c  n1-standard-2               10.128.0.4   35.238.33.232  RUNNING
+NAME                                                             LOCATION       LOCATION_SCOPE  SIZE_GB  TYPE         STATUS
+gke-bootstrap-e2e-9a16-pvc-78cc0ee3-cca4-11e9-8d3c-42010a800007  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-9a16-pvc-8525f2f5-cca4-11e9-8d3c-42010a800007  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-9a16-pvc-91b15484-cca4-11e9-8d3c-42010a800007  us-central1-c  zone            1        pd-standard  READY
+gke-bootstrap-e2e-default-pool-6deb451a-7dk9                     us-central1-c  zone            100      pd-standard  READY
+gke-bootstrap-e2e-default-pool-6deb451a-thmn                     us-central1-c  zone            100      pd-standard  READY
+gke-bootstrap-e2e-default-pool-6deb451a-tkrr                     us-central1-c  zone            100      pd-standard  READY
+default-route-001a79961f34b997                                   bootstrap-e2e  10.158.0.0/20  bootstrap-e2e                                                         1000
+default-route-07f96d72e64f3a52                                   bootstrap-e2e  10.166.0.0/20  bootstrap-e2e                                                         1000
+default-route-10ca7b7eb7dbe3aa                                   bootstrap-e2e  10.156.0.0/20  bootstrap-e2e                                                         1000
+default-route-20f864782fd42890                                   bootstrap-e2e  10.172.0.0/20  bootstrap-e2e                                                         1000
+default-route-228bc665ed1595df                                   bootstrap-e2e  10.160.0.0/20  bootstrap-e2e                                                         1000
+default-route-2e21249d5a4dbf5b                                   bootstrap-e2e  10.152.0.0/20  bootstrap-e2e                                                         1000
+default-route-3b64a69e59c16608                                   bootstrap-e2e  10.128.0.0/20  bootstrap-e2e                                                         1000
+default-route-4bbdb4e1c17cb1fc                                   bootstrap-e2e  10.164.0.0/20  bootstrap-e2e                                                         1000
+default-route-5b63ad7d9da175dd                                   bootstrap-e2e  0.0.0.0/0      default-internet-gateway                                              1000
+default-route-5d9dc13efd8cc198                                   bootstrap-e2e  10.154.0.0/20  bootstrap-e2e                                                         1000
+default-route-5f57f960da34800d                                   bootstrap-e2e  10.146.0.0/20  bootstrap-e2e                                                         1000
+default-route-7074dfe459ccb026                                   bootstrap-e2e  10.174.0.0/20  bootstrap-e2e                                                         1000
+default-route-7b662ef8718ec2be                                   bootstrap-e2e  10.148.0.0/20  bootstrap-e2e                                                         1000
+default-route-8b4016254b43cdc0                                   bootstrap-e2e  10.170.0.0/20  bootstrap-e2e                                                         1000
+default-route-92951a4afccf4ca6                                   bootstrap-e2e  10.142.0.0/20  bootstrap-e2e                                                         1000
+default-route-a60dc0dcf1f8dea1                                   bootstrap-e2e  10.168.0.0/20  bootstrap-e2e                                                         1000
+default-route-bdc1b3604e8d24b7                                   bootstrap-e2e  10.140.0.0/20  bootstrap-e2e                                                         1000
+default-route-bf6d934ec9cbc78f                                   bootstrap-e2e  10.150.0.0/20  bootstrap-e2e                                                         1000
+default-route-d045ecb098b965c5                                   bootstrap-e2e  10.162.0.0/20  bootstrap-e2e                                                         1000
+default-route-da28fa66dc2ec870                                   bootstrap-e2e  10.138.0.0/20  bootstrap-e2e                                                         1000
+default-route-f396899adee95eeb                                   bootstrap-e2e  10.132.0.0/20  bootstrap-e2e                                                         1000
+gke-bootstrap-e2e-9a1659de-55df00e4-cca4-11e9-8d3c-42010a800007  bootstrap-e2e  10.4.0.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-6deb451a-7dk9  1000
+gke-bootstrap-e2e-9a1659de-55e07f42-cca4-11e9-8d3c-42010a800007  bootstrap-e2e  10.4.1.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-6deb451a-tkrr  1000
+gke-bootstrap-e2e-9a1659de-55e59d52-cca4-11e9-8d3c-42010a800007  bootstrap-e2e  10.4.2.0/24    us-central1-c/instances/gke-bootstrap-e2e-default-pool-6deb451a-thmn  1000
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 14 Passed Tests

Show 4413 Skipped Tests