Join friends

I know I can join games through the steam interface, but it would be nice to be able to click on the right side and have the option. Invite and chat is already there, why not join also?

I thought I remembered seeing this in an old screenshot/dev stream before and I have no idea where it went, this would definitely be a lot more convenient than using steam.