nginx - Regarding calling rest api, one third of the http requests failed and timed out.-PHP Chinese Network Q&A

Article Topic Learning Download Q&A Programming Dictionary Game Recent Updates

简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)

nginx - Regarding calling rest api, one third of the http requests failed and timed out.

过去多啦不再A梦 2017-05-16 17:20:58

548

The tomcat 8.0 server is used, nio mode. Others are default configurations.
Write an interface using rest of spring mvc, and then call it with resttemplate, through the connection pool implemented by httpclient. When 1,000 requests were made concurrently, some requests were found to have timed out. causing access failure. .

The entire system architecture is like this
There are three applications A, B, and C
C is responsible for operating the database, providing interfaces, and returning JSON
B is responsible for processing business, providing interfaces, returning JSON, and calling C's interface, save/read data
A is responsible for the front desk, calling B's interface
When A calls B, complex balancing is done through nginx, and there are two B servers.

Excuse me, what are the situations that may cause timeout?