I'm spending a bit more time with Windows since I built an actual Windows-based gaming rig, and I couldn't figure out how to get the tightVNC client to connect to any display except 0.
I finally found the answer on softpanorama. You don't actually use the port number or the display number.
Take the display number and subtract 5900. So display #1 becomes -5899. Display #2 is -5898.
Enter this value like a port number in the server IP field.
Why this uses the negative compliment of the actual port number, I have no idea.
But now, I can access my home TV and monitor my podcast from Windows.