When I play virus with my friends or people overseas I get constant frame rate drops from 60 fps to about 3-4 fps, this happens every game and it almost renders the virus game mode unplayable for me, i don’t think it’s lag because I’ll be getting these frame drops on servers I host, so i’m wondering if it’s a optimization bug or just my computer being terrible
Currently as you know Tower Unite is in Early Access and isn’t fully optimized yet, though I could said that maybe if you turn all your settings to low and play it on a lower resolution might fix it. 
Latency wouldn’t cause a framerate drop anyway.
Have you tried verifying your files via Steam?
What are your specs?
Specs are
AMD FX 6100
Geforce GTX 650 1GB
8GB DDR3 Ram
and I’ve verified my files
Your graphics card is a bit on the lower side, but does meet minimum specifications. I don’t know what’s wrong then.
Do you get 60 on other games and in the Lobby?
I get 60 on everything but planet panic and virus, and my graphics card does meet the steam minimum and about 40-50 on medium settings.