I was guessing that this would vary by municipality, but I would not be surprised if what you are saying is mostly true. People love jumping on with their easily stereotyped behaviors.
I am dealing with that in my town. I disagree that “trespassing” is even possible with public land and/or buildings, and am refining strategies for fixing that. But that’s a story for a different topic.