Do you have dummy HDMI plugs into them? You can buy them 6 for $20 on Amazon. The last handful I bought are currently at that price.
https://www.amazon.com/gp/product/B088KHSNBT
Using these and similar clears up all kinds of VNC into a remote system without a display attached issues.