I thought I had reported this before but I can’t remember what I titled it as so I can’t find it.
You have to disconnect from the server to truly leave a minigame, whether or not you’ve completed it. I’m having issues that if I end up (accidentally or otherwise) in a minigame the music plays long after I’ve left and my ability to interact with other stuff is cut off because it still thinks I’m in the minigame. So I have to leave the plaza and come back.