In this case it’s likely that the haproxy instance running the old configuration is still running and accepting requests, because in this case the kernel load balances between the old and new process, so that is why the result is inconsistent.
Stop haproxy completely, and then check if there are still haproxy processes running. Kill them all and start haproxy again.