This job view page is being replaced by Spyglass soon. Check out the new job view.
PRkoushki: Add support to define a tag for syslog messages
ResultFAILURE
Tests 0 failed / 0 succeeded
Started2019-08-16 11:04
Elapsed22m46s
Revision77cdf0392e85561f03eeaf13356669e58aa8ea63
Refs 4255

No Test Failures!


Error lines from build-log.txt

... skipping 515 lines ...
k8s.io/ingress-nginx/vendor/k8s.io/kubernetes/pkg/kubelet/util/sliceutils
k8s.io/ingress-nginx/internal/ingress/status
k8s.io/ingress-nginx/internal/ingress/controller
k8s.io/ingress-nginx/cmd/nginx
k8s.io/ingress-nginx/vendor/github.com/spf13/cobra
k8s.io/ingress-nginx/cmd/dbg
Error: No such image: ingress-controller/nginx-ingress-controller-amd64:dev
mkdir -p /tmp/tmp.Oi2Jhrvg6D/rootfs
cp bin/amd64/nginx-ingress-controller /tmp/tmp.Oi2Jhrvg6D/rootfs/nginx-ingress-controller
cp bin/amd64/dbg /tmp/tmp.Oi2Jhrvg6D/rootfs/dbg
cp -RP ./* /tmp/tmp.Oi2Jhrvg6D
sed -i "s|BASEIMAGE|quay.io/kubernetes-ingress-controller/nginx-amd64:0.91|g" /tmp/tmp.Oi2Jhrvg6D/rootfs/Dockerfile
sed -i "s|QEMUARCH||g" /tmp/tmp.Oi2Jhrvg6D/rootfs/Dockerfile
... skipping 96 lines ...
Removing intermediate container b3dfb6af28af
 ---> 0b64af6b0d31
Step 12/15 : USER www-data
 ---> Running in 0992d395c8c9
Removing intermediate container 0992d395c8c9
 ---> 10fcfaa23d45
Step 13/15 : RUN  ln -sf /dev/stdout /usr/local/openresty/nginx/logs/access.log   && ln -sf /dev/stderr /usr/local/openresty/nginx/logs/error.log   && ln -s /usr/local/openresty/nginx/logs/* /var/log/nginx
 ---> Running in a8a6ce240f20
Removing intermediate container a8a6ce240f20
 ---> e0dce93e8e1d
Step 14/15 : ENTRYPOINT ["/usr/bin/dumb-init", "--"]
 ---> Running in 84810fc649b4
Removing intermediate container 84810fc649b4
... skipping 148 lines ...
Setting up libtinfo6:amd64 (6.1+20181013-2) ...
Selecting previously unselected package bash.
(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 3917 files and directories currently installed.)
Preparing to unpack .../archives/bash_5.0-4_amd64.deb ...
Unpacking bash (5.0-4) ...
Setting up bash (5.0-4) ...
update-alternatives: error: alternative path /usr/share/man/man7/bash-builtins.7.gz doesn't exist

Selecting previously unselected package tzdata.
(Reading database ... 
(Reading database ... 5%
(Reading database ... 10%
(Reading database ... 15%
(Reading database ... 20%
(Reading database ... 25%
(Reading database ... 30%
(Reading database ... 35%
(Reading database ... 40%
(Reading database ... 45%
(Reading database ... 50%
(Reading database ... 55%
(Reading database ... 60%
(Reading database ... 65%
(Reading database ... 70%
(Reading database ... 75%
(Reading database ... 80%
(Reading database ... 85%
(Reading database ... 90%
(Reading database ... 95%
(Reading database ... 100%
(Reading database ... 3989 files and directories currently installed.)
Preparing to unpack .../00-tzdata_2019b-0+deb10u1_all.deb ...
Unpacking tzdata (2019b-0+deb10u1) ...
Selecting previously unselected package libssl1.1:amd64.
Preparing to unpack .../01-libssl1.1_1.1.1c-1_amd64.deb ...
... skipping 154 lines ...
Successfully built b3a54cb5e8a7
Successfully tagged nginx-ingress-controller:e2e
make[2]: Leaving directory '/home/prow/go/src/k8s.io/ingress-nginx/test/e2e-image'
make[1]: Leaving directory '/home/prow/go/src/k8s.io/ingress-nginx'
make[1]: Entering directory '/home/prow/go/src/k8s.io/ingress-nginx/images/fastcgi-helloserver'
docker rmi -f ingress-controller/fastcgi-helloserver-amd64:dev || true
Error: No such image: ingress-controller/fastcgi-helloserver-amd64:dev
CGO_ENABLED=0 GOOS=linux GOARCH=amd64 go build -a -installsuffix cgo \
	-ldflags "-s -w" \
	-o /tmp/tmp.3ZaZaIqyS4/rootfs/fastcgi-helloserver k8s.io/ingress-nginx/images/fastcgi-helloserver/...
cp -r ./* /tmp/tmp.3ZaZaIqyS4
sed -i 's|BASEIMAGE|alpine:3.9|g' /tmp/tmp.3ZaZaIqyS4/rootfs/Dockerfile
sed -i "s|QEMUARCH||g" /tmp/tmp.3ZaZaIqyS4/rootfs/Dockerfile
... skipping 205 lines ...
STEP: Creating a kubernetes client
STEP: Building a namespace api object
Aug 16 11:10:26.523: INFO: Created namespace: e2e-tests-authtls-1565953826490853303-8fwqd
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Annotations - AuthTLS
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/authtls.go:34
[It] should set valid auth-tls-secret, pass certificate to upstream, and error page
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/authtls.go:114
[AfterEach] [ingress-nginx] Annotations - AuthTLS
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Annotations - AuthTLS
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/authtls.go:38


• [SLOW TEST:50.409 seconds]
[ingress-nginx] Annotations - AuthTLS
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  should set valid auth-tls-secret, pass certificate to upstream, and error page
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/authtls.go:114
------------------------------
[BeforeEach] [ingress-nginx] SSL
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:77
STEP: Creating a kubernetes client
STEP: Building a namespace api object
... skipping 23 lines ...
Aug 16 11:10:26.703: INFO: Created namespace: e2e-tests-forwarded-port-headers-1565953826665557832-txtfp
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Listen on nondefault ports
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/listen_nondefault_ports.go:39
[It] should set X-Forwarded-Port header to 443
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/listen_nondefault_ports.go:72
Aug 16 11:11:15.255: INFO: Unexpected TLS error: x509: certificate is valid for ingress.local, not forwarded-headers
[AfterEach] [ingress-nginx] Listen on nondefault ports
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist


• [SLOW TEST:60.237 seconds]
... skipping 29 lines ...
Aug 16 11:10:26.683: INFO: Created namespace: e2e-tests-forwarded-port-headers-1565953826638623844-75722
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Listen on nondefault ports
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/listen_nondefault_ports.go:39
[It] should set the X-Forwarded-Port header to 443
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/listen_nondefault_ports.go:102
Aug 16 11:11:30.911: INFO: Unexpected TLS error: x509: certificate is valid for ingress.local, not forwarded-headers
[AfterEach] [ingress-nginx] Listen on nondefault ports
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist


• [SLOW TEST:75.552 seconds]
... skipping 406 lines ...
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Configmap change
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/configmap_change.go:32
[It] should reload after an update in the configuration
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/configmap_change.go:39
STEP: adding a whitelist-source-range
STEP: changing error-log-level
[AfterEach] [ingress-nginx] Configmap change
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Configmap change
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/configmap_change.go:36

... skipping 198 lines ...
STEP: Creating a kubernetes client
STEP: Building a namespace api object
Aug 16 11:12:18.312: INFO: Created namespace: e2e-tests-luarestywaf-1565953938303607767-g24nj
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Annotations - lua-resty-waf
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/luarestywaf.go:34
[It] should not fail a request with multipart content type when multipart body processing disabled
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/luarestywaf.go:99
[AfterEach] [ingress-nginx] Annotations - lua-resty-waf
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist

•
... skipping 8 lines ...
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/global_external_auth.go:48
[BeforeEach] when global external authentication is configured
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/global_external_auth.go:58
STEP: Adding an ingress rule for /foo
STEP: Adding an ingress rule for /bar
STEP: Adding a global-auth-url to configMap
[It] should add custom error page when global-auth-signin url is configured
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/global_external_auth.go:209
STEP: Adding a global-auth-signin to configMap
[AfterEach] [ingress-nginx] Global External Auth
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Global External Auth
... skipping 2 lines ...

• [SLOW TEST:80.930 seconds]
[ingress-nginx] Global External Auth
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  when global external authentication is configured
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/global_external_auth.go:56
    should add custom error page when global-auth-signin url is configured
    /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/global_external_auth.go:209
------------------------------
[BeforeEach] [ingress-nginx] Annotations - ModSecurityLocation
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:77
STEP: Creating a kubernetes client
STEP: Building a namespace api object
... skipping 102 lines ...
STEP: Creating a kubernetes client
STEP: Building a namespace api object
Aug 16 11:13:01.665: INFO: Created namespace: e2e-tests-luarestywaf-1565953981657281550-78cz8
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Annotations - lua-resty-waf
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/luarestywaf.go:34
[It] should fail a request with multipart content type when multipart body processing enabled by default
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/luarestywaf.go:116
[AfterEach] [ingress-nginx] Annotations - lua-resty-waf
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist

•
... skipping 1552 lines ...
Aug 16 11:16:31.314: INFO: Created namespace: e2e-tests-settings-tls-1565954191294907173-j5rkl
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:41
[It] should configure HSTS policy header
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:105
Aug 16 11:17:06.116: INFO: Unexpected TLS error: x509: certificate is valid for ingress.local, not settings-tls
STEP: setting max-age parameter
STEP: setting includeSubDomains parameter
STEP: setting preload parameter
[AfterEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
... skipping 94 lines ...
STEP: Creating a kubernetes client
STEP: Building a namespace api object
Aug 16 11:17:42.853: INFO: Created namespace: e2e-tests-rewrite-1565954262848257397-hkqzm
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Annotations - Rewrite
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/rewrite.go:35
[It] should fail to use longest match for documented warning
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/rewrite.go:164
STEP: creating a regular ingress definition
STEP: creating an ingress definition with the use-regex annotation
STEP: check that '/foo/bar/bar' does not match the longest exact path
[AfterEach] [ingress-nginx] Annotations - Rewrite
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
... skipping 133 lines ...
[BeforeEach] [ingress-nginx] Annotations - custom-http-errors
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/customhttperrors.go:37
[It] configures Nginx correctly
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/customhttperrors.go:44
STEP: turning on proxy_intercept_errors directive
STEP: configuring error_page directive
STEP: creating error locations
STEP: updating configuration when only custom-http-error value changes
STEP: ignoring duplicate values (503 in this case) per server
STEP: using the custom default-backend from annotation for upstream
[AfterEach] [ingress-nginx] Annotations - custom-http-errors
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Annotations - custom-http-errors
... skipping 348 lines ...
STEP: Adding an ingress rule for /foo
STEP: Adding an ingress rule for /bar
STEP: Adding an ingress rule for /foo
STEP: Adding an ingress rule for /bar
[It] should deny login for different location on same server
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/auth.go:419
STEP: receiving an internal server error without cache on location /bar
[AfterEach] [ingress-nginx] Annotations - Auth
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Annotations - Auth
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/auth.go:43

... skipping 72 lines ...
Aug 16 11:18:42.380: INFO: Created namespace: e2e-tests-settings-tls-1565954322371826177-rvkk6
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:41
[It] should configure TLS protocol
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:49
Aug 16 11:19:16.189: INFO: Unexpected TLS error: x509: certificate is valid for ingress.local, not settings-tls
STEP: setting cipher suite
STEP: enforcing TLS v1.0
[AfterEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Settings - TLS)
... skipping 417 lines ...
Aug 16 11:20:10.061: INFO: Created namespace: e2e-tests-settings-tls-1565954410048856347-9xn6w
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:41
[It] should not use ports or X-Forwarded-Host during the HTTP to HTTPS redirection
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:196
Aug 16 11:20:59.769: INFO: Unexpected TLS error: x509: certificate is valid for ingress.local, not settings-tls
[AfterEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Settings - TLS)
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/settings/tls.go:46

... skipping 120 lines ...
STEP: Creating a kubernetes client
STEP: Building a namespace api object
Aug 16 11:20:30.468: INFO: Created namespace: e2e-tests-ewma-1565954430464022391-ml5zm
STEP: Starting new ingress controller
[BeforeEach] [ingress-nginx] Load Balance - EWMA
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/loadbalance/ewma.go:35
[It] does not fail requests
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/loadbalance/ewma.go:41
Aug 16 11:21:26.808: INFO: Request distribution: map[http-svc-56bbf465dc-jfjbj:11 http-svc-56bbf465dc-l5bgn:18 http-svc-56bbf465dc-s9m8k:1]
[AfterEach] [ingress-nginx] Load Balance - EWMA
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist


• [SLOW TEST:56.554 seconds]
[ingress-nginx] Load Balance - EWMA
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  does not fail requests
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/loadbalance/ewma.go:41
------------------------------
[BeforeEach] [ingress-nginx] Dynamic Configuration
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:77
STEP: Creating a kubernetes client
STEP: Building a namespace api object
... skipping 413 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "lua_ingress")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		lua_ingress = res
		lua_ingress.set_config({
			use_forwarded_headers = false,
			is_ssl_passthrough_enabled = false,
			http_redirect_code = 308,
		listen_ports = { ssl_proxy = "442", https = "443" },
		})
		end
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		balancer = res
		end
		
		ok, res = pcall(require, "monitor")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		monitor = res
		end
		
		ok, res = pcall(require, "certificate")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		certificate = res
		end
		
		ok, res = pcall(require, "plugins")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		plugins = res
		end
		-- load all plugins that'll be used here
	plugins.init({})
	}
... skipping 86 lines ...
		
		default 1;
	}
	
	access_log /var/log/nginx/access.log upstreaminfo  if=$loggable;
	
	error_log  /var/log/nginx/error.log notice;
	
	resolver 10.96.0.10 valid=30s;
	
	# See https://www.nginx.com/blog/websocket-nginx
	map $http_upgrade $connection_upgrade {
		default          upgrade;
... skipping 188 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 4 lines ...
		location /healthz {
			
			access_log off;
			return 200;
		}
		
		# this is required to avoid error if nginx is being monitored
		# with an external software (like sysdig)
		location /nginx_status {
			
			allow 127.0.0.1;
			
			allow ::1;
... skipping 114 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 77 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_balancer = res
		end
	}
	
	init_worker_by_lua_block {
... skipping 3 lines ...
	lua_add_variable $proxy_upstream_name;
	
	log_format log_stream [$time_local] $protocol $status $bytes_sent $bytes_received $session_time;
	
	access_log /var/log/nginx/access.log log_stream ;
	
	error_log  /var/log/nginx/error.log;
	
	upstream upstream_balancer {
		server 0.0.0.1:1234; # placeholder
		
		balancer_by_lua_block {
			tcp_udp_balancer.balance()
... skipping 24 lines ...
• Failure [214.223 seconds]
[ingress-nginx] Annotations - Log
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  enable syslog with tag [It]
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/log.go:85

  unexpected error waiting for nginx server condition/s
  Unexpected error:
      <*errors.errorString | 0xc0000b7050>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

... skipping 31 lines ...
STEP: Adding an ingress rule for /bar
STEP: Adding an ingress rule for /foo
STEP: Adding an ingress rule for /bar
[It] should deny login for different servers
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/auth.go:461
STEP: logging into server thisHost /foo
STEP: receiving an internal server error without cache on thisHost location /bar
[AfterEach] [ingress-nginx] Annotations - Auth
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:78
STEP: Waiting for test namespace to no longer exist
[AfterEach] [ingress-nginx] Annotations - Auth
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/auth.go:43

... skipping 91 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "lua_ingress")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		lua_ingress = res
		lua_ingress.set_config({
			use_forwarded_headers = false,
			is_ssl_passthrough_enabled = false,
			http_redirect_code = 308,
		listen_ports = { ssl_proxy = "442", https = "443" },
		})
		end
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		balancer = res
		end
		
		ok, res = pcall(require, "monitor")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		monitor = res
		end
		
		ok, res = pcall(require, "certificate")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		certificate = res
		end
		
		ok, res = pcall(require, "plugins")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		plugins = res
		end
		-- load all plugins that'll be used here
	plugins.init({})
	}
... skipping 86 lines ...
		
		default 1;
	}
	
	access_log /var/log/nginx/access.log upstreaminfo  if=$loggable;
	
	error_log  /var/log/nginx/error.log notice;
	
	resolver 10.96.0.10 valid=30s;
	
	# See https://www.nginx.com/blog/websocket-nginx
	map $http_upgrade $connection_upgrade {
		default          upgrade;
... skipping 188 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 4 lines ...
		location /healthz {
			
			access_log off;
			return 200;
		}
		
		# this is required to avoid error if nginx is being monitored
		# with an external software (like sysdig)
		location /nginx_status {
			
			allow 127.0.0.1;
			
			allow ::1;
... skipping 114 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 77 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_balancer = res
		end
	}
	
	init_worker_by_lua_block {
... skipping 3 lines ...
	lua_add_variable $proxy_upstream_name;
	
	log_format log_stream [$time_local] $protocol $status $bytes_sent $bytes_received $session_time;
	
	access_log /var/log/nginx/access.log log_stream ;
	
	error_log  /var/log/nginx/error.log;
	
	upstream upstream_balancer {
		server 0.0.0.1:1234; # placeholder
		
		balancer_by_lua_block {
			tcp_udp_balancer.balance()
... skipping 24 lines ...
• Failure [211.260 seconds]
[ingress-nginx] Annotations - Log
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  enable syslog [It]
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/log.go:66

  unexpected error waiting for nginx server condition/s
  Unexpected error:
      <*errors.errorString | 0xc000080020>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

... skipping 99 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "lua_ingress")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		lua_ingress = res
		lua_ingress.set_config({
			use_forwarded_headers = false,
			is_ssl_passthrough_enabled = false,
			http_redirect_code = 308,
		listen_ports = { ssl_proxy = "442", https = "443" },
		})
		end
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		balancer = res
		end
		
		ok, res = pcall(require, "monitor")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		monitor = res
		end
		
		ok, res = pcall(require, "certificate")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		certificate = res
		end
		
		ok, res = pcall(require, "plugins")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		plugins = res
		end
		-- load all plugins that'll be used here
	plugins.init({})
	}
... skipping 86 lines ...
		
		default 1;
	}
	
	access_log /var/log/nginx/access.log upstreaminfo  if=$loggable;
	
	error_log  /var/log/nginx/error.log notice;
	
	resolver 10.96.0.10 valid=30s;
	
	# See https://www.nginx.com/blog/websocket-nginx
	map $http_upgrade $connection_upgrade {
		default          upgrade;
... skipping 188 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 4 lines ...
		location /healthz {
			
			access_log off;
			return 200;
		}
		
		# this is required to avoid error if nginx is being monitored
		# with an external software (like sysdig)
		location /nginx_status {
			
			allow 127.0.0.1;
			
			allow ::1;
... skipping 114 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 77 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_balancer = res
		end
	}
	
	init_worker_by_lua_block {
... skipping 3 lines ...
	lua_add_variable $proxy_upstream_name;
	
	log_format log_stream [$time_local] $protocol $status $bytes_sent $bytes_received $session_time;
	
	access_log /var/log/nginx/access.log log_stream ;
	
	error_log  /var/log/nginx/error.log;
	
	upstream upstream_balancer {
		server 0.0.0.1:1234; # placeholder
		
		balancer_by_lua_block {
			tcp_udp_balancer.balance()
... skipping 24 lines ...
• Failure [211.060 seconds]
[ingress-nginx] Annotations - Log
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  enable syslog with tag [It]
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/log.go:85

  unexpected error waiting for nginx server condition/s
  Unexpected error:
      <*errors.errorString | 0xc0000b7050>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

... skipping 56 lines ...
I0816 11:23:37.033969       6 leaderelection.go:235] attempting to acquire leader lease  e2e-tests-log-1565954612829907337-ctt5m/ingress-controller-leader-nginx...
I0816 11:23:37.034910       6 controller.go:133] Configuration changes detected, backend reload required.
I0816 11:23:37.041471       6 leaderelection.go:245] successfully acquired lease e2e-tests-log-1565954612829907337-ctt5m/ingress-controller-leader-nginx
I0816 11:23:37.041858       6 status.go:86] new leader elected: nginx-ingress-controller-64bc9d4ddd-d5h2d
I0816 11:23:37.133109       6 controller.go:149] Backend successfully reloaded.
I0816 11:23:37.133200       6 controller.go:158] Initial sync, sleeping for 1 second.
E0816 11:23:37.222910       6 checker.go:58] healthcheck error: 500
I0816 11:24:10.306759       6 event.go:258] Event(v1.ObjectReference{Kind:"Ingress", Namespace:"e2e-tests-log-1565954612829907337-ctt5m", Name:"log.foo.com", UID:"5e292d8a-c018-11e9-8cd3-0242ac110004", APIVersion:"networking.k8s.io/v1beta1", ResourceVersion:"33369", FieldPath:""}): type: 'Normal' reason: 'CREATE' Ingress e2e-tests-log-1565954612829907337-ctt5m/log.foo.com
I0816 11:24:10.717959       6 controller.go:133] Configuration changes detected, backend reload required.
I0816 11:24:10.821342       6 controller.go:149] Backend successfully reloaded.

STEP: Dumping NGINX configuration after a failure running a test
Aug 16 11:27:11.107: INFO: 
... skipping 34 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "lua_ingress")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		lua_ingress = res
		lua_ingress.set_config({
			use_forwarded_headers = false,
			is_ssl_passthrough_enabled = false,
			http_redirect_code = 308,
		listen_ports = { ssl_proxy = "442", https = "443" },
		})
		end
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		balancer = res
		end
		
		ok, res = pcall(require, "monitor")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		monitor = res
		end
		
		ok, res = pcall(require, "certificate")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		certificate = res
		end
		
		ok, res = pcall(require, "plugins")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		plugins = res
		end
		-- load all plugins that'll be used here
	plugins.init({})
	}
... skipping 86 lines ...
		
		default 1;
	}
	
	access_log /var/log/nginx/access.log upstreaminfo  if=$loggable;
	
	error_log  /var/log/nginx/error.log notice;
	
	resolver 10.96.0.10 valid=30s;
	
	# See https://www.nginx.com/blog/websocket-nginx
	map $http_upgrade $connection_upgrade {
		default          upgrade;
... skipping 188 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 4 lines ...
		location /healthz {
			
			access_log off;
			return 200;
		}
		
		# this is required to avoid error if nginx is being monitored
		# with an external software (like sysdig)
		location /nginx_status {
			
			allow 127.0.0.1;
			
			allow ::1;
... skipping 114 lines ...
			proxy_request_buffering                 on;
			proxy_http_version                      1.1;
			
			proxy_cookie_domain                     off;
			proxy_cookie_path                       off;
			
			# In case of errors try the next upstream server before returning an error
			proxy_next_upstream                     error timeout;
			proxy_next_upstream_timeout             0;
			proxy_next_upstream_tries               3;
			
			proxy_pass http://upstream_balancer;
			
			proxy_redirect                          off;
... skipping 77 lines ...
		
		-- init modules
		local ok, res
		
		ok, res = pcall(require, "configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_configuration")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_configuration = res
		end
		
		ok, res = pcall(require, "tcp_udp_balancer")
		if not ok then
		error("require failed: " .. tostring(res))
		else
		tcp_udp_balancer = res
		end
	}
	
	init_worker_by_lua_block {
... skipping 3 lines ...
	lua_add_variable $proxy_upstream_name;
	
	log_format log_stream [$time_local] $protocol $status $bytes_sent $bytes_received $session_time;
	
	access_log /var/log/nginx/access.log log_stream ;
	
	error_log  /var/log/nginx/error.log;
	
	upstream upstream_balancer {
		server 0.0.0.1:1234; # placeholder
		
		balancer_by_lua_block {
			tcp_udp_balancer.balance()
... skipping 24 lines ...
• Failure [218.279 seconds]
[ingress-nginx] Annotations - Log
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:150
  enable syslog [It]
  /home/prow/go/src/k8s.io/ingress-nginx/test/e2e/annotations/log.go:66

  unexpected error waiting for nginx server condition/s
  Unexpected error:
      <*errors.errorString | 0xc000080020>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

... skipping 20 lines ...
Aug 16 11:27:11.110: INFO: Running AfterSuite actions on all nodes



Summarizing 4 Failures:

[Fail] [ingress-nginx] Annotations - Log [It] enable syslog with tag 
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:194

[Fail] [ingress-nginx] Annotations - Log [It] enable syslog 
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:194

[Fail] [ingress-nginx] Annotations - Log [It] enable syslog with tag 
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:194

[Fail] [ingress-nginx] Annotations - Log [It] enable syslog 
/home/prow/go/src/k8s.io/ingress-nginx/test/e2e/framework/framework.go:194

Ran 208 of 209 Specs in 1004.641 seconds
FAIL! -- 206 Passed | 2 Failed | 0 Flaked | 0 Pending | 1 Skipped


Ginkgo ran 1 suite in 16m44.751690737s
Test Suite Failed
pod "e2e" deleted
pod default/e2e terminated (Error)
Makefile:171: recipe for target 'e2e-test' failed
make[1]: *** [e2e-test] Error 1
make[1]: Leaving directory '/home/prow/go/src/k8s.io/ingress-nginx'
Makefile:232: recipe for target 'kind-e2e-test' failed
make: *** [kind-e2e-test] Error 2
+ EXIT_VALUE=2
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
[Barnacle] 2019/08/16 11:27:12 Cleaning up Docker data root...
[Barnacle] 2019/08/16 11:27:12 Removing all containers.
... skipping 35 lines ...