I agree here, it isn't fair.

Although, it should be able to tell the difference if someone actually quits from when someone loses connection (ping timeout), which I have seen happen.