The Return to Game Ports option in the map vote screen is being removed entirely in the next update, but I still think it’d be useful if it was kept but only for friends only and singleplayer servers.
In a game with only friends, it’s significantly less likely that the Game World Port vote would win without everyone agreeing on it first, since you’d likely all be communicating with each other which is less likely in public games, so I think the option lends itself a lot better for it.
The option is a nice way to easily switch Game Worlds without interrupting the current session by having to make a new server each time, which is especially useful when playing alone or with friends. It would be useful as well if the option sent you to a friends only Game World Ports server, so that it’s still only you and your friends there.