Trouble with RDS Scanner Redirection


I am having trouble getting Microsoft Remote Desktop Services to redirection remotefx devices. Specifically scanners when connecting through HAProxy. It does work, but the speed is incredibly slow. 5min per page to scan!

It works perfectly fine if I bypass HAProxy when connecting. I am using HAProxy to balance the RDS rdweb servers.

Here is my config


#log local2
log /dev/log local0
chroot /var/lib/haproxy
pidfile /var/run/
maxconn 4000
user haproxy
group haproxy

#turn on stats unix socket
stats socket /var/lib/haproxy/stats

#utilize system-wide crypto-policies
ssl-default-bind-ciphers PROFILE=SYSTEM
ssl-default-server-ciphers PROFILE=SYSTEM

mode http
log global
option httplog
option dontlognull
option http-server-close
option forwardfor except
option redispatch
retries 3
timeout http-request 10s
timeout queue 1m
timeout connect 10s
timeout client 1m
timeout server 1m
timeout http-keep-alive 10s
timeout check 10s
maxconn 3000

frontend rds_frontend
bind frontend:443
mode tcp
default_backend rds_gateway

backend rds_gateway
balance source
mode tcp
server server1 server1:443 maxconn 1000 weight 10 check
server server2 server2:443 maxconn 1000 weight 10 check

listen stats
bind backend:8080
stats enable
stats uri /stats
stats refresh 10s
stats admin if LOCALHOST

I am completely at a lose. Any help would be appreciated!