Uh I can speak from experience and tell you that I have absolutely no sexual feelings for women. In fact, seeing one would probably turn me off. Many of my friends/exes experience the same thing, so what you are saying is very unfair to say.

There could be people that call themselves gay, while they are actually bisexual/pansexual/whatever, but there are gay people that feel no attraction at all to the opposite gender.