Indeed! I've found that there are a lot of people in the middle and they're afraid to speak up, but once I break the ice by challenging a remark, they're almost relieved.
I'm not nasty. Sometimes all it takes is challenging a bigoted remark with something like, "I know a lot of gay people and I'm not seeing what you're talking about."
One by one they fall in with, "Yeah, my brother is gay" or "Really? My daughter is gay" and so on. I believe there are a lot more people like that than there are of the clown's hate mongers. At least for now.