I was playing in room with "scarymaou" and I won game but in last frames he spectators... -.-
Anyway to stop this? Is annoying.

No, there's no way to avoid leavers.

Just leave the server. He probably just wants to do that so he keeps his Win/Loss ratio high. It's frowned upon here.