Ubuntu with two gateways 20.04

Hello
I am building HAProxy on a vm running Ubuntu 20.04.
I want to have use two nics, on two separate subnets so I can have a management IP address that is not on the same network as my frontend vips.

I can reach both management nic and the nic that is on the vip network. But when I try to source ping from the nic on the vip network to the backend servers it doesn’t work. All my traffic wants to use the management network interface as its gateway.

Has anyone been able to do this on Ubuntu 20.04 using Netplan?

Below is my netplan config, the 10.99.20.0/24 is management and 10.10.111.10 is for the vip side

version: 2
renderer: networkd
ethernets:
ens192:
addresses:
- 10.99.20.135/24
gateway4: 10.99.20.1
dhcp4: no
dhcp6: no
routes:
- to: 10.99.20.0/24
via: 10.99.20.1
table: 800
metric: 100
routing-policy:
- from: 10.99.20.135/24
table: 800
ens224:
addresses:
- 10.10.111.10/24
routes:
- to: 10.10.111.0/24
via: 10.10.111.1
table: 801
metric: 101
routing-policy:
- from: 10.10.111.10/24
table: 801

This discourse forum is about haproxy, not about networking in general, networkd or netplan.