This is something we are still thinking about a bit. I'd personally like to see a permission system similar to that of modern forum software with different levels of authorization.
This is something I've thought about as well. I kinda figured that if you didn't want that person, you'd ban them from your condo.
However, I could just as easily just make it have a checkbox to turn off automatically allowing your Steam friends. Which is probably gonna happen.