Hey,
Can you let us know what troubleshooting actions did you run?
Hi Baptiste,
This is a production setup so we did not have the time to perform any troubleshooting.
We just restarted the haproxy service on the server on both occasions.
Post this, the application team claim that they were able to access the API configured on 10.250.2.127:54322.
Can you let us know what needs to be checked if the issue reoccurs?
Well, the first test I would have run would have been accessing the IP address directly.
This issue does not make any sense at all to me, unless the IP address pointed to by your hostname can change in the DNS or not be resolved anymore.
HAProxy does not care if the traffic comes via the IP address or the hostname.
Can you tell us more about your environment? Where is HAProxy running, what type of application are connected to it, etc…
Hi,
The HA proxy service is running on two RHEL 7.4 servers, where the virtual IP 10.250.2.127 is configured.
The primary node has a boot IP of 10.250.2.144 and the secondary node has a boot IP of 10.250.2.145
Currently all requests are being proxied via 2.144.
There are 4 frontends configured, namely firstpoint, secondpoint, thirdpoint and fourthpoint.
The firstpoint frontend handles all requests for 10.250.2.127 on port 54321
The secondpoint frontend handles all requests for 10.250.2.127 on port 8011
The thirdpoint frontend handles all requests for 10.250.2.127 on port 54322
the fourthpoint frontend handles all requests for 10.250.2.127 on port 54323.
There are separate backends configured for each frontend and they forward requests to 2 Windows servers viz 10.250.0.41 and 10.250.0.36 on the ports mentioned above.
For eg. a request on port 54321 would be redirected to either 10.250.0.41 or 10.250.0.36 on port 54321, where the trackwizz application is currently hosted.
54322 is the port used by the API.
Ok thx for the info.
so no docker, no VM, just bare metal installation?
If the problem occur again, please just tcpdump the traffic on this port for a few seconds and run a ‘sudo ss -lpten | fgrep 54322’ to check if the port is still bound.
Do you have the HAProxy log lines from the latest incident?
Hi Baptiste,
The 2 Linux servers on which HA proxy is installed are VM servers based on an ESXI host.
I will provide the logs from when the issue last occurred
Shortly.
Oct 30 09:07:21 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:50997 [30/Oct/2019:09:06:51.794] thirdpoint trackwizz_3/server1 1/0/30007 25 sD 0/0/0/0/0 0/0
Oct 30 09:09:31 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58571 [30/Oct/2019:09:09:31.539] firstpoint trackwizz/server1 1/0/9 0 SD 6/6/6/6/0 0/0
Oct 30 09:09:34 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58568 [30/Oct/2019:09:09:08.683] firstpoint trackwizz/server1 1/0/25719 1411 – 5/5/5/5/0 0/0
Oct 30 09:09:34 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58567 [30/Oct/2019:09:09:08.681] firstpoint trackwizz/server1 1/0/26221 1411 – 4/4/4/4/0 0/0
Oct 30 09:09:35 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58564 [30/Oct/2019:09:09:08.569] firstpoint trackwizz/server1 1/0/26849 4125 – 3/3/3/3/0 0/0
Oct 30 09:09:35 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58566 [30/Oct/2019:09:09:08.678] firstpoint trackwizz/server1 1/0/27256 5522 – 2/2/2/2/0 0/0
Oct 30 09:09:38 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58573 [30/Oct/2019:09:09:38.174] firstpoint trackwizz/server1 1/0/7 0 SD 3/3/3/3/0 0/0
Oct 30 09:10:13 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58565 [30/Oct/2019:09:09:08.570] firstpoint trackwizz/server1 1/0/64477 701750 sD 2/2/2/2/0 0/0
Oct 30 09:10:13 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58569 [30/Oct/2019:09:09:08.685] firstpoint trackwizz/server1 1/0/64362 78293 sD 1/1/1/1/0 0/0
Oct 30 09:10:43 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51046 [30/Oct/2019:09:10:13.694] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 1/0/0/0/0 0/0
Oct 30 09:11:14 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59763 [30/Oct/2019:09:11:14.915] firstpoint trackwizz/server1 1/0/10 0 SD 8/7/7/7/0 0/0
Oct 30 09:11:16 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59766 [30/Oct/2019:09:11:16.440] firstpoint trackwizz/server1 1/0/10 314 CD 8/7/7/7/0 0/0
Oct 30 09:11:17 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59711 [30/Oct/2019:09:10:53.059] firstpoint trackwizz/server1 1/0/24937 22071 – 13/12/12/12/0 0/0
Oct 30 09:11:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59709 [30/Oct/2019:09:10:52.897] firstpoint trackwizz/server1 1/0/25107 4899 – 12/11/11/11/0 0/0
Oct 30 09:11:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59713 [30/Oct/2019:09:10:53.075] firstpoint trackwizz/server1 1/0/25429 13804 – 11/10/10/10/0 0/0
Oct 30 09:11:19 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59710 [30/Oct/2019:09:10:52.897] firstpoint trackwizz/server1 1/0/26177 27322 CD 10/9/9/9/0 0/0
Oct 30 09:11:23 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51047 [30/Oct/2019:09:10:53.069] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 9/0/0/0/0 0/0
Oct 30 09:11:27 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59712 [30/Oct/2019:09:10:53.069] firstpoint trackwizz/server1 1/0/34186 1611 – 8/8/8/8/0 0/0
Oct 30 09:11:28 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59714 [30/Oct/2019:09:10:53.077] firstpoint trackwizz/server1 1/0/35194 2988 – 7/7/7/7/0 0/0
Oct 30 09:12:01 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51060 [30/Oct/2019:09:11:31.481] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 7/0/0/0/0 0/0
Oct 30 09:12:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59767 [30/Oct/2019:09:11:16.590] firstpoint trackwizz/server1 1/0/56249 8943 sD 6/6/6/6/0 0/0
Oct 30 09:12:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59768 [30/Oct/2019:09:11:16.593] firstpoint trackwizz/server1 1/0/56246 6530 sD 5/5/5/5/0 0/0
Oct 30 09:12:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59770 [30/Oct/2019:09:11:16.597] firstpoint trackwizz/server1 1/0/56242 13619 sD 4/4/4/4/0 0/0
Oct 30 09:12:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59772 [30/Oct/2019:09:11:16.604] firstpoint trackwizz/server1 1/0/56235 1745 sD 3/3/3/3/0 0/0
Oct 30 09:12:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59769 [30/Oct/2019:09:11:16.595] firstpoint trackwizz/server1 1/0/56244 24950 sD 2/2/2/2/0 0/0
Oct 30 09:12:25 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59160 [30/Oct/2019:09:12:21.269] firstpoint trackwizz/server1 1/0/4019 36316 CD 8/8/8/8/0 0/0
Oct 30 09:12:25 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59157 [30/Oct/2019:09:12:21.264] firstpoint trackwizz/server1 1/0/4215 22136 CD 7/7/7/7/0 0/0
Oct 30 09:12:26 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59158 [30/Oct/2019:09:12:21.265] firstpoint trackwizz/server1 1/0/4870 2202 – 6/6/6/6/0 0/0
Oct 30 09:12:26 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59156 [30/Oct/2019:09:12:21.203] firstpoint trackwizz/server1 1/0/5239 25696 – 5/5/5/5/0 0/0
Oct 30 09:12:26 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59159 [30/Oct/2019:09:12:21.267] firstpoint trackwizz/server1 1/0/5677 25299 – 4/4/4/4/0 0/0
Oct 30 09:12:42 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59871 [30/Oct/2019:09:12:12.861] firstpoint trackwizz/server1 1/0/30046 201 sD 2/2/2/2/0 0/0
Oct 30 09:13:12 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59771 [30/Oct/2019:09:11:16.600] firstpoint trackwizz/server1 1/0/116314 269291 sD 1/1/1/1/0 0/0
Oct 30 09:13:42 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.109:59938 [30/Oct/2019:09:13:12.921] firstpoint trackwizz/server1 1/0/30002 0 sD 2/1/1/1/0 0/0
Oct 30 09:13:47 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51063 [30/Oct/2019:09:13:17.609] thirdpoint trackwizz_3/server1 1/0/30006 25 sD 1/0/0/0/0 0/0
Oct 30 09:14:40 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51066 [30/Oct/2019:09:14:10.356] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 2/0/0/0/0 0/0
Oct 30 09:15:25 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59380 [30/Oct/2019:09:14:39.061] firstpoint trackwizz/server1 1/0/45988 276 sD 1/1/1/1/0 0/0
Oct 30 09:17:39 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51082 [30/Oct/2019:09:17:09.237] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 1/0/0/0/0 0/0
Oct 30 09:20:11 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59711 [30/Oct/2019:09:19:39.047] firstpoint trackwizz/server1 1/0/31989 276 sD 1/1/1/1/0 0/0
Oct 30 09:24:16 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59998 [30/Oct/2019:09:24:16.535] firstpoint trackwizz/server1 1/0/9 0 SD 7/6/6/6/0 0/0
Oct 30 09:24:25 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59999 [30/Oct/2019:09:24:25.549] firstpoint trackwizz/server1 1/0/7 0 SD 7/6/6/6/0 0/0
Oct 30 09:24:30 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51090 [30/Oct/2019:09:24:00.071] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 6/0/0/0/0 0/0
Oct 30 09:25:08 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59987 [30/Oct/2019:09:24:07.805] firstpoint trackwizz/server1 1/0/60228 3617 sD 6/5/5/5/0 0/0
Oct 30 09:25:08 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59997 [30/Oct/2019:09:24:11.661] firstpoint trackwizz/server1 1/0/56372 3757 sD 5/4/4/4/0 0/0
Oct 30 09:25:14 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:58572 [30/Oct/2019:09:09:37.395] firstpoint trackwizz/server1 1/0/936867 476276 sD 4/3/3/3/0 0/0
Oct 30 09:25:17 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59995 [30/Oct/2019:09:24:11.658] firstpoint trackwizz/server1 1/0/66316 275470 sD 3/2/2/2/0 0/0
Oct 30 09:25:21 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51125 [30/Oct/2019:09:24:51.126] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 2/0/0/0/0 0/0
Oct 30 09:25:33 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59996 [30/Oct/2019:09:24:11.660] firstpoint trackwizz/server1 1/0/81371 38312 sD 1/1/1/1/0 0/0
Oct 30 09:25:33 EDEMUMHAPRXY01 haproxy[27486]: 10.215.0.99:59994 [30/Oct/2019:09:24:11.654] firstpoint trackwizz/server1 1/0/81377 45799 sD 0/0/0/0/0 0/0
Oct 30 09:28:41 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51130 [30/Oct/2019:09:28:11.325] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 0/0/0/0/0 0/0
Oct 30 09:34:52 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51134 [30/Oct/2019:09:34:22.959] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 0/0/0/0/0 0/0
Oct 30 09:36:03 EDEMUMHAPRXY01 haproxy[27486]: 10.215.1.24:64083 [30/Oct/2019:09:35:33.422] thirdpoint trackwizz_3/server2 1/1/30281 999 sD 0/0/0/0/0 0/0
Oct 30 09:36:40 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51142 [30/Oct/2019:09:36:10.861] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 0/0/0/0/0 0/0
Oct 30 09:37:29 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51143 [30/Oct/2019:09:36:59.649] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 0/0/0/0/0 0/0
Oct 30 09:38:12 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51144 [30/Oct/2019:09:37:42.041] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 0/0/0/0/0 0/0
Oct 30 09:39:10 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57373 [30/Oct/2019:09:39:10.298] firstpoint trackwizz/server1 1/0/620 0 SD 7/6/6/6/0 0/0
Oct 30 09:39:40 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51150 [30/Oct/2019:09:39:10.086] thirdpoint trackwizz_3/server2 1/0/30005 25 sD 6/0/0/0/0 0/0
Oct 30 09:39:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57364 [30/Oct/2019:09:38:49.833] firstpoint trackwizz/server1 1/0/69659 3628 sD 5/5/5/5/0 0/0
Oct 30 09:39:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57365 [30/Oct/2019:09:38:49.833] firstpoint trackwizz/server1 1/0/69659 13789 sD 4/4/4/4/0 0/0
Oct 30 09:39:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57361 [30/Oct/2019:09:38:47.813] firstpoint trackwizz/server1 1/0/71679 4809 sD 3/3/3/3/0 0/0
Oct 30 09:39:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57362 [30/Oct/2019:09:38:49.831] firstpoint trackwizz/server1 1/0/69662 5411 sD 2/2/2/2/0 0/0
Oct 30 09:39:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57363 [30/Oct/2019:09:38:49.832] firstpoint trackwizz/server1 1/0/69660 2863 sD 1/1/1/1/0 0/0
Oct 30 09:41:10 EDEMUMHAPRXY01 haproxy[27486]: 10.215.1.24:64568 [30/Oct/2019:09:40:40.734] secondpoint trackwizz_2/server1 1/0/30003 0 sD 3/0/0/0/0 0/0
Oct 30 09:41:10 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51172 [30/Oct/2019:09:40:40.747] thirdpoint trackwizz_3/server1 1/0/30005 25 sD 2/0/0/0/0 0/0
Oct 30 09:41:30 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57728 [30/Oct/2019:09:40:46.571] firstpoint trackwizz/server1 1/0/44379 8893 CD 1/1/1/1/0 0/0
Oct 30 09:42:58 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59422 [30/Oct/2019:09:42:54.860] firstpoint trackwizz/server1 1/0/3211 2140 – 8/8/8/8/0 0/0
Oct 30 09:43:08 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59430 [30/Oct/2019:09:43:02.309] firstpoint trackwizz/server1 1/0/5752 201 – 8/8/8/8/0 0/0
Oct 30 09:43:08 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59429 [30/Oct/2019:09:43:02.309] firstpoint trackwizz/server1 1/0/5752 201 – 7/7/7/7/0 0/0
Oct 30 09:43:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59432 [30/Oct/2019:09:43:13.470] firstpoint trackwizz/server1 1/0/4591 201 – 12/12/12/12/0 0/0
Oct 30 09:43:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59434 [30/Oct/2019:09:43:14.006] firstpoint trackwizz/server1 1/0/4054 201 – 10/10/10/10/0 0/0
Oct 30 09:43:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59436 [30/Oct/2019:09:43:14.009] firstpoint trackwizz/server1 1/0/4051 617 – 9/9/9/9/0 0/0
Oct 30 09:43:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59435 [30/Oct/2019:09:43:14.009] firstpoint trackwizz/server1 1/0/4051 491 – 8/8/8/8/0 0/0
Oct 30 09:43:18 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59433 [30/Oct/2019:09:43:13.469] firstpoint trackwizz/server1 1/0/4592 3435 – 7/7/7/7/0 0/0
Oct 30 09:43:27 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57776 [30/Oct/2019:09:42:18.690] firstpoint trackwizz/server1 1/0/68892 445055 sD 12/12/12/12/0 0/0
Oct 30 09:43:27 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57778 [30/Oct/2019:09:42:18.739] firstpoint trackwizz/server1 1/0/68859 140100 sD 11/11/11/11/0 0/0
Oct 30 09:43:28 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59444 [30/Oct/2019:09:43:28.489] firstpoint trackwizz/server1 1/0/287 0 SD 11/11/11/11/0 0/0
Oct 30 09:43:34 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57780 [30/Oct/2019:09:42:18.741] firstpoint trackwizz/server1 1/0/75475 1041086 sD 10/10/10/10/0 0/0
Oct 30 09:43:34 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57779 [30/Oct/2019:09:42:18.739] firstpoint trackwizz/server1 1/0/75489 2517060 sD 9/9/9/9/0 0/0
Oct 30 09:43:34 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57781 [30/Oct/2019:09:42:18.741] firstpoint trackwizz/server1 1/0/75491 74130 sD 8/8/8/8/0 0/0
Oct 30 09:43:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59438 [30/Oct/2019:09:43:25.139] firstpoint trackwizz/server1 1/0/12923 14006 – 7/7/7/7/0 0/0
Oct 30 09:43:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59443 [30/Oct/2019:09:43:26.397] firstpoint trackwizz/server1 1/0/11665 2505 – 6/6/6/6/0 0/0
Oct 30 09:43:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59442 [30/Oct/2019:09:43:26.396] firstpoint trackwizz/server1 1/0/11666 1261 – 5/5/5/5/0 0/0
Oct 30 09:43:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59441 [30/Oct/2019:09:43:26.396] firstpoint trackwizz/server1 1/0/11666 1681 – 4/4/4/4/0 0/0
Oct 30 09:43:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59439 [30/Oct/2019:09:43:26.242] firstpoint trackwizz/server1 1/0/11821 1519 – 3/3/3/3/0 0/0
Oct 30 09:43:40 EDEMUMHAPRXY01 haproxy[27486]: 10.170.0.85:57777 [30/Oct/2019:09:42:18.738] firstpoint trackwizz/server1 1/0/81898 65581 sD 2/2/2/2/0 0/0
Oct 30 09:44:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57467 [30/Oct/2019:09:44:11.500] firstpoint trackwizz/server1 1/0/47990 276 sD 2/2/2/2/0 0/0
Oct 30 09:48:17 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.36:50692 [30/Oct/2019:09:47:17.111] thirdpoint trackwizz_3/server1 1/0/60483 914 sD 14/6/6/2/0 0/0
Oct 30 09:48:17 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49323 [30/Oct/2019:09:47:11.096] secondpoint trackwizz_2/server2 1/0/66557 441 sD 13/5/5/2/0 0/0
Oct 30 09:48:20 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51204 [30/Oct/2019:09:47:06.320] thirdpoint trackwizz_3/server2 1/0/74065 897 sD 14/6/6/3/0 0/0
Oct 30 09:48:30 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51206 [30/Oct/2019:09:47:27.792] thirdpoint trackwizz_3/server2 1/0/62785 914 sD 14/5/5/2/0 0/0
Oct 30 09:48:30 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49376 [30/Oct/2019:09:47:27.781] secondpoint trackwizz_2/server1 1/0/62801 441 sD 13/5/5/2/0 0/0
Oct 30 09:48:38 EDEMUMHAPRXY01 haproxy[27486]: 10.216.73.224:59554 [30/Oct/2019:09:48:30.260] firstpoint trackwizz/server1 1/0/7833 276 – 12/2/2/2/0 0/0
Oct 30 09:48:40 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.36:50695 [30/Oct/2019:09:47:40.682] thirdpoint trackwizz_3/server1 1/0/59965 914 sD 11/4/4/2/0 0/0
Oct 30 09:48:40 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49421 [30/Oct/2019:09:47:40.670] secondpoint trackwizz_2/server2 1/0/59979 441 sD 10/4/4/2/0 0/0
Oct 30 09:48:52 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51207 [30/Oct/2019:09:47:50.735] thirdpoint trackwizz_3/server2 1/0/61416 914 sD 9/3/3/1/0 0/0
Oct 30 09:48:52 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49484 [30/Oct/2019:09:47:50.725] secondpoint trackwizz_2/server1 1/0/61430 441 sD 8/3/3/1/0 0/0
Oct 30 09:48:58 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.36:50696 [30/Oct/2019:09:48:02.250] thirdpoint trackwizz_3/server1 1/0/56736 914 sD 7/2/2/1/0 0/0
Oct 30 09:48:59 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49522 [30/Oct/2019:09:48:02.242] secondpoint trackwizz_2/server2 1/0/56773 441 sD 6/2/2/1/0 0/0
Oct 30 09:49:08 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.41:51208 [30/Oct/2019:09:48:09.139] thirdpoint trackwizz_3/server2 1/0/59684 914 sD 5/1/1/0/0 0/0
Oct 30 09:49:08 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49539 [30/Oct/2019:09:48:09.105] secondpoint trackwizz_2/server1 1/0/59722 466 sD 4/1/1/0/0 0/0
Oct 30 09:49:15 EDEMUMHAPRXY01 haproxy[27486]: 10.250.0.36:50697 [30/Oct/2019:09:48:18.932] thirdpoint trackwizz_3/server1 1/0/56634 914 sD 4/0/0/0/0 0/0
Oct 30 09:49:15 EDEMUMHAPRXY01 haproxy[27486]: 10.250.4.20:49569 [30/Oct/2019:09:48:18.904] secondpoint trackwizz_2/server2 1/0/56666 466 sD 3/0/0/0/0 0/0
Oct 30 09:49:46 EDEMUMHAPRXY01 haproxy[27486]: Connect from 10.109.1.18:64529 to 10.250.2.144:8888 (status/HTTP)
Oct 30 09:49:46 EDEMUMHAPRXY01 haproxy[27486]: Connect from 10.109.1.18:64530 to 10.250.2.144:8888 (status/HTTP)
Oct 30 09:49:59 EDEMUMHAPRXY01 haproxy[27486]: 10.216.98.113:57521 [30/Oct/2019:09:49:11.523] firstpoint trackwizz/server1 1/0/47958 276 sD 2/2/2/2/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59581 [30/Oct/2019:09:51:13.276] firstpoint trackwizz/server1 1/0/4821 1158 – 6/6/6/6/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59573 [30/Oct/2019:09:50:56.229] firstpoint trackwizz/server1 1/0/21868 245167 – 5/5/5/5/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59580 [30/Oct/2019:09:51:13.279] firstpoint trackwizz/server1 1/0/4819 2380 – 4/4/4/4/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59579 [30/Oct/2019:09:51:13.275] firstpoint trackwizz/server1 1/0/4822 28114 – 3/3/3/3/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59578 [30/Oct/2019:09:51:13.276] firstpoint trackwizz/server1 1/0/4825 1206 – 2/2/2/2/0 0/0
Oct 30 09:51:18 EDEMUMHAPRXY01 haproxy[32303]: 10.216.73.224:59576 [30/Oct/2019:09:51:13.172] firstpoint trackwizz/server1 1/0/4929 17300 – 1/1/1/1/0 0/0
Oct 30 09:52:26 EDEMUMHAPRXY01 haproxy[32303]: Connect from 10.109.1.18:64619 to 10.250.2.144:8888 (status/HTTP)
Oct 30 09:52:26 EDEMUMHAPRXY01 haproxy[32303]: Connect from 10.109.1.18:64620 to 10.250.2.144:8888 (status/HTTP)
Oct 30 09:52:46 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51215 [30/Oct/2019:09:51:51.996] thirdpoint trackwizz_3/server1 1/0/54551 860 sD 1/0/0/0/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64633 [30/Oct/2019:09:53:00.575] firstpoint trackwizz/server1 1/0/50097 3105 sD 8/6/6/6/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64634 [30/Oct/2019:09:53:00.576] firstpoint trackwizz/server1 1/0/50098 201 sD 7/5/5/5/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64635 [30/Oct/2019:09:53:00.666] firstpoint trackwizz/server1 1/0/50011 201 sD 6/4/4/4/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64636 [30/Oct/2019:09:53:00.667] firstpoint trackwizz/server1 1/0/50010 201 sD 5/3/3/3/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64637 [30/Oct/2019:09:53:00.668] firstpoint trackwizz/server1 1/0/50259 402 sD 4/2/2/2/0 0/0
Oct 30 09:53:50 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64638 [30/Oct/2019:09:53:00.668] firstpoint trackwizz/server1 1/0/50258 907 sD 3/1/1/1/0 0/0
Oct 30 09:53:54 EDEMUMHAPRXY01 haproxy[32303]: 10.109.1.18:64639 [30/Oct/2019:09:53:04.710] thirdpoint trackwizz_3/server2 1/0/50056 1804 sD 1/0/0/0/0 0/0
Oct 30 09:54:59 EDEMUMHAPRXY01 haproxy[32303]: 10.216.98.113:57692 [30/Oct/2019:09:54:11.685] firstpoint trackwizz/server1 1/0/47792 276 sD 1/1/1/1/0 0/0
Oct 30 09:56:27 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51216 [30/Oct/2019:09:55:35.789] thirdpoint trackwizz_3/server1 1/0/51943 888 sD 1/0/0/0/0 0/0
Oct 30 09:58:23 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51217 [30/Oct/2019:09:57:25.818] thirdpoint trackwizz_3/server2 1/0/57584 860 sD 1/0/0/0/0 0/0
Oct 30 10:00:01 EDEMUMHAPRXY01 haproxy[32303]: 10.216.98.113:58042 [30/Oct/2019:09:59:11.536] firstpoint trackwizz/server1 1/0/50010 276 sD 3/1/1/1/0 0/0
Oct 30 10:00:26 EDEMUMHAPRXY01 haproxy[32303]: 10.215.1.24:49618 [30/Oct/2019:09:59:54.138] secondpoint trackwizz_2/server1 1/0/32300 752 sD 4/0/0/0/0 0/0
Oct 30 10:00:46 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51224 [30/Oct/2019:09:59:54.152] thirdpoint trackwizz_3/server1 1/0/52150 1279 sD 5/3/3/1/0 0/0
Oct 30 10:09:53 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51238 [30/Oct/2019:10:08:58.667] thirdpoint trackwizz_3/server1 1/0/55060 873 sD 3/1/1/0/0 0/0
Oct 30 10:10:01 EDEMUMHAPRXY01 haproxy[32303]: 10.216.98.113:58172 [30/Oct/2019:10:09:11.505] firstpoint trackwizz/server1 1/0/50009 276 sD 2/1/1/1/0 0/0
Oct 30 10:10:13 EDEMUMHAPRXY01 haproxy[32303]: 10.250.0.41:51239 [30/Oct/2019:10:09:13.980] thirdpoint trackwizz_3/server2 1/0/59278 859 sD 1/0/0/0/0 0/0
Hi,
Can someone help out wrt this issue?
Please provide all informations requested by Baptiste, as well as the configuration and the output of haproxy -vv.
1.) This is the output of tcpdump.pcap, obtained by running tcpdump for a few seconds on the command line:
13:15:14.464187 IP EDEMUMHAPRXY01.47916 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 2382711238, win 29200, options [mss 1460,sackOK,TS val 271645500 ecr 0,nop,wscale 7], length 0
13:15:14.464489 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47916: Flags [S.], seq 725860460, ack 2382711239, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386333 ecr 271645500], length 0
13:15:14.464558 IP EDEMUMHAPRXY01.47916 > edemumkycapp002.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159386333], length 0
13:15:14.617848 IP EDEMUMHAPRXY01.33674 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 1622632766, win 29200, options [mss 1460,sackOK,TS val 271645654 ecr 0,nop,wscale 7], length 0
13:15:14.618272 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33674: Flags [S.], seq 3869667391, ack 1622632767, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159174990 ecr 271645654], length 0
13:15:14.618331 IP EDEMUMHAPRXY01.33674 > edemumkycapp001.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159174990], length 0
13:15:15.465550 IP EDEMUMHAPRXY01.47932 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 2312715945, win 29200, options [mss 1460,sackOK,TS val 271646502 ecr 0,nop,wscale 7], length 0
13:15:15.465892 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47932: Flags [S.], seq 952059582, ack 2312715946, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386433 ecr 271646502], length 0
13:15:15.465966 IP EDEMUMHAPRXY01.47932 > edemumkycapp002.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159386433], length 0
13:15:15.618393 IP EDEMUMHAPRXY01.33690 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 2754472082, win 29200, options [mss 1460,sackOK,TS val 271646654 ecr 0,nop,wscale 7], length 0
13:15:15.618861 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33690: Flags [S.], seq 2608202623, ack 2754472083, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159175090 ecr 271646654], length 0
13:15:15.618922 IP EDEMUMHAPRXY01.33690 > edemumkycapp001.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159175090], length 0
13:15:15.863790 IP edemumkycapp002.edelcap.com.51965 > amltrackwizz.edelcap.com.54322: Flags [SEW], seq 777251238, win 8192, options [mss 1460,nop,wscale 8,nop,nop,sackOK], length 0
13:15:15.863821 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51965: Flags [S.], seq 585903501, ack 777251239, win 29200, options [mss 1460,nop,nop,sackOK,nop,wscale 7], length 0
13:15:15.864098 IP edemumkycapp002.edelcap.com.51965 > amltrackwizz.edelcap.com.54322: Flags [.], ack 1, win 256, length 0
13:15:15.864181 IP EDEMUMHAPRXY01.47940 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 2830128245, win 29200, options [mss 1460,sackOK,TS val 271646900 ecr 0,nop,wscale 7], length 0
13:15:15.864318 IP edemumkycapp002.edelcap.com.51965 > amltrackwizz.edelcap.com.54322: Flags [P.], seq 1:179, ack 1, win 256, length 178
13:15:15.864332 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51965: Flags [.], ack 179, win 237, length 0
13:15:15.864392 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47940: Flags [S.], seq 349886213, ack 2830128246, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386473 ecr 271646900], length 0
13:15:15.864406 IP EDEMUMHAPRXY01.47940 > edemumkycapp002.edelcap.com.54322: Flags [.], ack 1, win 229, options [nop,nop,TS val 271646900 ecr 159386473], length 0
13:15:15.864436 IP EDEMUMHAPRXY01.47940 > edemumkycapp002.edelcap.com.54322: Flags [P.], seq 1:179, ack 1, win 229, options [nop,nop,TS val 271646900 ecr 159386473], length 178
13:15:15.866343 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47940: Flags [P.], seq 1:26, ack 179, win 260, options [nop,nop,TS val 159386473 ecr 271646900], length 25
13:15:15.866361 IP EDEMUMHAPRXY01.47940 > edemumkycapp002.edelcap.com.54322: Flags [.], ack 26, win 229, options [nop,nop,TS val 271646902 ecr 159386473], length 0
13:15:15.866383 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51965: Flags [P.], seq 1:26, ack 179, win 237, length 25
13:15:15.866876 IP edemumkycapp002.edelcap.com.51965 > amltrackwizz.edelcap.com.54322: Flags [P.], seq 179:1068, ack 26, win 256, length 889
13:15:15.866922 IP EDEMUMHAPRXY01.47940 > edemumkycapp002.edelcap.com.54322: Flags [P.], seq 179:1068, ack 26, win 229, options [nop,nop,TS val 271646903 ecr 159386473], length 889
13:15:15.906495 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51965: Flags [.], ack 1068, win 251, length 0
13:15:15.933314 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47940: Flags [.], ack 1068, win 256, options [nop,nop,TS val 159386480 ecr 271646903], length 0
13:15:16.467159 IP EDEMUMHAPRXY01.47950 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 2386939161, win 29200, options [mss 1460,sackOK,TS val 271647503 ecr 0,nop,wscale 7], length 0
13:15:16.467498 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47950: Flags [S.], seq 3727511510, ack 2386939162, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386533 ecr 271647503], length 0
13:15:16.467568 IP EDEMUMHAPRXY01.47950 > edemumkycapp002.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159386533], length 0
13:15:16.620056 IP EDEMUMHAPRXY01.33708 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 1811725508, win 29200, options [mss 1460,sackOK,TS val 271647656 ecr 0,nop,wscale 7], length 0
13:15:16.620477 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33708: Flags [S.], seq 1717877823, ack 1811725509, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159175190 ecr 271647656], length 0
13:15:16.620578 IP EDEMUMHAPRXY01.33708 > edemumkycapp001.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159175190], length 0
13:15:17.468563 IP EDEMUMHAPRXY01.47966 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 2218347830, win 29200, options [mss 1460,sackOK,TS val 271648505 ecr 0,nop,wscale 7], length 0
13:15:17.469028 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47966: Flags [S.], seq 2440975635, ack 2218347831, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386633 ecr 271648505], length 0
13:15:17.469108 IP EDEMUMHAPRXY01.47966 > edemumkycapp002.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159386633], length 0
13:15:17.621466 IP EDEMUMHAPRXY01.33724 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 4091299100, win 29200, options [mss 1460,sackOK,TS val 271648657 ecr 0,nop,wscale 7], length 0
13:15:17.621869 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33724: Flags [S.], seq 2194960544, ack 4091299101, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159175291 ecr 271648657], length 0
13:15:17.621930 IP EDEMUMHAPRXY01.33724 > edemumkycapp001.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159175291], length 0
13:15:18.469689 IP EDEMUMHAPRXY01.47982 > edemumkycapp002.edelcap.com.54322: Flags [S], seq 35080592, win 29200, options [mss 1460,sackOK,TS val 271649506 ecr 0,nop,wscale 7], length 0
13:15:18.470089 IP edemumkycapp002.edelcap.com.54322 > EDEMUMHAPRXY01.47982: Flags [S.], seq 326593467, ack 35080593, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159386733 ecr 271649506], length 0
13:15:18.470226 IP EDEMUMHAPRXY01.47982 > edemumkycapp002.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159386733], length 0
13:15:18.622522 IP EDEMUMHAPRXY01.33740 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 607092125, win 29200, options [mss 1460,sackOK,TS val 271649659 ecr 0,nop,wscale 7], length 0
13:15:18.622984 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33740: Flags [S.], seq 1774064416, ack 607092126, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159175391 ecr 271649659], length 0
13:15:18.623049 IP EDEMUMHAPRXY01.33740 > edemumkycapp001.edelcap.com.54322: Flags [R.], seq 1, ack 1, win 229, options [nop,nop,TS val 0 ecr 159175391], length 0
13:15:19.149184 IP edemumkycapp002.edelcap.com.51966 > amltrackwizz.edelcap.com.54322: Flags [SEW], seq 1825140554, win 8192, options [mss 1460,nop,wscale 8,nop,nop,sackOK], length 0
13:15:19.149207 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51966: Flags [S.], seq 1529044179, ack 1825140555, win 29200, options [mss 1460,nop,nop,sackOK,nop,wscale 7], length 0
13:15:19.149386 IP edemumkycapp002.edelcap.com.51966 > amltrackwizz.edelcap.com.54322: Flags [.], ack 1, win 256, length 0
13:15:19.149493 IP EDEMUMHAPRXY01.33750 > edemumkycapp001.edelcap.com.54322: Flags [S], seq 2525594034, win 29200, options [mss 1460,sackOK,TS val 271650186 ecr 0,nop,wscale 7], length 0
13:15:19.149535 IP edemumkycapp002.edelcap.com.51966 > amltrackwizz.edelcap.com.54322: Flags [P.], seq 1:180, ack 1, win 256, length 179
13:15:19.149546 IP amltrackwizz.edelcap.com.54322 > edemumkycapp002.edelcap.com.51966: Flags [.], ack 180, win 237, length 0
13:15:19.149951 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33750: Flags [S.], seq 2984229369, ack 2525594035, win 8192, options [mss 1460,nop,wscale 8,sackOK,TS val 159175443 ecr 271650186], length 0
13:15:19.149972 IP EDEMUMHAPRXY01.33750 > edemumkycapp001.edelcap.com.54322: Flags [.], ack 1, win 229, options [nop,nop,TS val 271650186 ecr 159175443], length 0
13:15:19.149992 IP EDEMUMHAPRXY01.33750 > edemumkycapp001.edelcap.com.54322: Flags [P.], seq 1:180, ack 1, win 229, options [nop,nop,TS val 271650186 ecr 159175443], length 179
13:15:19.150301 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33750: Flags [.], ack 180, win 514, options [nop,nop,TS val 159175443 ecr 271650186], length 0
13:15:19.151519 IP edemumkycapp001.edelcap.com.54322 > EDEMUMHAPRXY01.33750: Flags [P.], seq 1:26, ack 180, win 514, options [nop,nop,TS val 159175444 ecr 271650186], length 25
13:15:19.151529 IP EDEMUMHAPRXY01.33750 > edemumkycapp001.edelcap.com.54322: Flags [.], ack 26, win 229, options [nop,nop,TS val 271650188 ecr 159175444], length 0
2.)This is the output of ss -lpten |fgrep 54322:
[root@EDEMUMHAPRXY01 safeliro]# ss -lpten | fgrep 54322
LISTEN 0 128 10.250.2.127:54322 : users:((“haproxy”,pid=4936,fd=7)) ino:46940573 sk:ffff8800ba4cae80 <->
and this is the output of haproxy -vv 
[root@EDEMUMHAPRXY01 safeliro]# haproxy -vv
HA-Proxy version 1.5.18 2016/05/10
Copyright 2000-2016 Willy Tarreau willy@haproxy.org
Build options :
TARGET = linux2628
CPU = generic
CC = gcc
CFLAGS = -O2 -g -fno-strict-aliasing -DTCP_USER_TIMEOUT=18
OPTIONS = USE_LINUX_TPROXY=1 USE_ZLIB=1 USE_REGPARM=1 USE_OPENSSL=1 USE_PCRE=1
Default settings :
maxconn = 2000, bufsize = 16384, maxrewrite = 8192, maxpollevents = 200
Encrypted password support via crypt(3): yes
Built with zlib version : 1.2.7
Compression algorithms supported : identity, deflate, gzip
Built with OpenSSL version : OpenSSL 1.0.1e-fips 11 Feb 2013
Running on OpenSSL version : OpenSSL 1.0.1e-fips 11 Feb 2013
OpenSSL library supports TLS extensions : yes
OpenSSL library supports SNI : yes
OpenSSL library supports prefer-server-ciphers : yes
Built with PCRE version : 8.32 2012-11-30
PCRE library supports JIT : no (USE_PCRE_JIT not set)
Built with transparent proxy support using: IP_TRANSPARENT IPV6_TRANSPARENT IP_FREEBIND
Available polling systems :
epoll : pref=300, test result OK
poll : pref=200, test result OK
select : pref=150, test result OK
Total: 3 (3 usable), will use epoll.
[root@EDEMUMHAPRXY01 safeliro]#
Please let us know if you require any other information, Lukas.
Lukas,
With reference to the information provided, do you have anything that could help us?
Still need that configuration.
What configuration?
Did you read my replies to your original post?
The haproxy configuration itself.
The root cause is unknown, we don’t know what we are looking for, therefor we need all the available information.
From the haproxy log file, it appears that there is some problem with the server or the connectivity between haproxy and the servers (sD and SD termination flags).
Did you provide the ouputs of tcpdump, ss and haproxy logs while having the issue, before the restart?
Did you provide the ouputs of
tcpdump,ssandhaproxylogs while having the issue, before the restart?
I have posted the output of tcpdump (before the restart) and this is in post 11.
The output of ss is also in post 11.
HA proxy logs are in post 8 of this thread.
Please actually read what I’m writing.
I asked whether those output are during the issue or not.
I also asked for the haproxy configuration, for the third time now.
those outputs are during the issue.
I believe you haven’t read the case notes clearly enough.
Your laconic style of replying does not help either.
Everything is in plain english in the case history.
Expect for the configuration, which you have still not provided. Don’t bother though, I have frankly better things to do than keep on asking for the same thing all over again.
Did you bother reading post 4 by any chance?
I think the configuration has been explained succinctly.
I fail to see the reason behind you being so deliberately obtuse.
If there is something else that is required i.e. if you require a configuration file please let me know.
[root@XXXXXXXXXXXXXXX01 ~]# cat /etc/haproxy/haproxy.cfg
global
log /dev/log local0 info
log /dev/log local1 notice
defaults
log global
option dontlognull
timeout connect 10000
timeout client 45000
timeout server 24000
maxconn 50000
frontend firstpoint
mode tcp
bind XX.XXX.2.127:54321 transparent
option tcplog
timeout connect 100000
timeout client 50000
timeout server 50000
default_backend trackwizz
backend trackwizz
mode tcp
balance roundrobin
balance leastconn
option forwardfor
timeout server 30000
timeout connect 40000
appsession ASP.Net_SessionID len 24 timeout 30m request-learn prefix
server server1 XX.XXX.0.41:54321 check weight 1 fall 2 inter 1s rise 2
server server2 XX.XXX.0.36:54321 check backup weight 1 fall 2 inter 1s rise 2
frontend secondpoint
mode tcp
bind XX.XXX.2.127:8011 transparent
option tcplog
timeout connect 100000
timeout client 50000
timeout server 50000
default_backend trackwizz_2
backend trackwizz_2
balance leastconn
option forwardfor
timeout server 30000
timeout connect 40000
server server1 XX.XXX.0.41:8011 check weight 1 fall 2 inter 1s rise 2
server server2 XX.XXX.0.36:8011 check weight 1 fall 2 inter 1s rise 2
frontend thirdpoint
mode tcp
bind XX.XXX.2.127:54322
option tcplog
timeout connect 100000
timeout client 50000
timeout server 50000
default_backend trackwizz_3
backend trackwizz_3
balance leastconn
option forwardfor
timeout server 30000
timeout connect 40000
server server1 XX.XXX.0.41:54322 check weight 1 fall 2 inter 1s rise 2
server server2 XX.XXX.0.36:54322 check weight 1 fall 2 inter 1s rise 2
frontend fourthpoint
mode tcp
bind XX.XXX.2.127:54323
option tcplog
timeout connect 100000
timeout client 50000
timeout server 50000
default_backend trackwizz_4
backend trackwizz_4
balance leastconn
option forwardfor
timeout server 30000
timeout connect 40000
server server1 XX.XXX.0.41:54323 check weight 1 fall 2 inter 1s rise 2
server server2 XX.XXX.0.36:54323 check weight 1 fall 2 inter 1s rise 2
listen status XX.XXX.2.144:8888
mode http
stats enable
stats uri /hastatus
stats auth admin:12345678
[root@XXXXXXXXXXXXXXX ~]#