Well, just look at it:
“I support free speech” is becoming the new “I have a black friend” or “I’m not racist but… [insert racist joke here]”
It doesn’t label anyone a racist. It’s about what people sometimes say, not whatever they supposedly are. If you think it’s labeling anyone a racist, then yes, you are misinterpreting it.