Dan Savage, for one, would disagree with you. He often points out that virtually all gay people have some straight people in their lives who are special to them.
It’s not that they’re gay that makes them hard to reach. It’s not even that they’re conservative. It’s that they’re misogynistic, blinkered assholes. The trick, and it is a difficult one, is to get them to feel empathy.