That's why you should be a spy sniper. No one gives a crap about a sniper.
Heavy and Medic are the worst classes to spy as, because if you pick the first, a medic will run up and try to uber you, and if you pick the second, enemies are bound to run up asking for heals and then shoot you when you can't talk.
