HAproxy 2.4 spontaneously dying and restarting?

Jan 7 08:14:52 [xxxx] haproxy[2634]: [WARNING] 006/081452 (2634) : Exiting Master process…
Jan 7 08:14:52 [xxxx] haproxy[2634]: [NOTICE] 006/081452 (2634) : haproxy version is 2.2.5-1ppa1~bionic
Jan 7 08:14:52 [xxxx] haproxy[2634]: [NOTICE] 006/081452 (2634) : path to executable is /usr/sbin/haproxy
Jan 7 08:14:52 [xxxx] haproxy[2634]: [ALERT] 006/081452 (2634) : Current worker #1 (2639) exited with code 143 (Terminated)
Jan 7 08:14:52 [xxxx] haproxy[2634]: [WARNING] 006/081452 (2634) : All workers exited. Exiting… (0)

About every 36-48 hours I’m getting a log entry like this. Somehow its getting a reason to exit and automatically restarts.

Is there a log settings I need to turn on to get debug or other information on this? If I need to update my build or something, no problem.

Thanks in advance!

Fusion

# haproxy -vvv

HA-Proxy version 2.4-dev0-50c03a-40 2020/11/06 - https://haproxy.org/
Status: development branch - not safe for use in production.
Known bugs: Issues · haproxy/haproxy · GitHub
Running on: Linux 4.15.0-111-generic #112-Ubuntu SMP Thu Jul 9 20:32:34 UTC 2020 x86_64
Build options :
TARGET = linux-glibc
CPU = generic
CC = cc
CFLAGS = -O2 -g -Wall -Wextra -Wdeclaration-after-statement -fwrapv -Wno-unused-label -Wno-sign-compare -Wno-unused-parameter -Wno-clobbered -Wno-missing-field-initializers -Wtype-limits -Wshift-negative-value -Wshift-overflow=2 -Wduplicated-cond -Wnull-dereference
OPTIONS = USE_PCRE=1 USE_OPENSSL=1 USE_LUA=1 USE_ZLIB=1 USE_SYSTEMD=1

Feature list : +EPOLL -KQUEUE +NETFILTER +PCRE -PCRE_JIT -PCRE2 -PCRE2_JIT +POLL -PRIVATE_CACHE +THREAD -PTHREAD_PSHARED +BACKTRACE -STATIC_PCRE -STATIC_PCRE2 +TPROXY +LINUX_TPROXY +LINUX_SPLICE +LIBCRYPT +CRYPT_H +GETADDRINFO +OPENSSL +LUA +FUTEX +ACCEPT4 -CLOSEFROM +ZLIB -SLZ +CPU_AFFINITY +TFO +NS +DL +RT -DEVICEATLAS -51DEGREES -WURFL +SYSTEMD -OBSOLETE_LINKER +PRCTL +THREAD_DUMP -EVPORTS

Default settings :
bufsize = 16384, maxrewrite = 1024, maxpollevents = 200

Built with multi-threading support (MAX_THREADS=64, default=6).
Built with OpenSSL version : OpenSSL 1.1.1 11 Sep 2018
Running on OpenSSL version : OpenSSL 1.1.1 11 Sep 2018
OpenSSL library supports TLS extensions : yes
OpenSSL library supports SNI : yes
OpenSSL library supports : TLSv1.0 TLSv1.1 TLSv1.2 TLSv1.3
Built with Lua version : Lua 5.3.3
Built with network namespace support.
Built with zlib version : 1.2.11
Running on zlib version : 1.2.11
Compression algorithms supported : identity(“identity”), deflate(“deflate”), raw-deflate(“deflate”), gzip(“gzip”)
Built with transparent proxy support using: IP_TRANSPARENT IPV6_TRANSPARENT IP_FREEBIND
Built with PCRE version : 8.39 2016-06-14
Running on PCRE version : 8.39 2016-06-14
PCRE library supports JIT : no (USE_PCRE_JIT not set)
Encrypted password support via crypt(3): yes
Built with gcc compiler version 7.5.0

Available polling systems :
epoll : pref=300, test result OK
poll : pref=200, test result OK
select : pref=150, test result OK
Total: 3 (3 usable), will use epoll.

Available multiplexer protocols :
(protocols marked as cannot be specified using ‘proto’ keyword)
h2 : mode=HTTP side=FE|BE mux=H2
fcgi : mode=HTTP side=BE mux=FCGI
: mode=HTTP side=FE|BE mux=H1
: mode=TCP side=FE|BE mux=PASS

Available services : none

Available filters :
[SPOE] spoe
[CACHE] cache
[FCGI] fcgi-app
[COMP] compression
[TRACE] trace

It’s a crash due to a bug.

Please see the second line of your -vv output:

Status: development branch - not safe for use in production.

You are using a development release, and and old one too.

Get a stable release from haproxy:
http://www.haproxy.org/

Or, if you are a developer and want to help test the latest releases, then clone it from git, or at the very least, use a latest tag (2.4-dev5).

But anything close those production that is supposed to be reliable needs a stable release.

thanks, I’ve updated to the latest on GIT.

I get that the thing could be crashing, but its not giving one useful output to identify why its crashing. I guess I could run it through a debugger and see if I can catch the crash.

Anyway, thanks.