In reality I probably wouldn’t punch them myself unless I felt personally threatened, but I certainly wouldn’t get in the way if someone else wanted to. I’d also probably forget what the puncher looked like if the police asked me about it afterward.
For those doubting the efficacy of the “make racists afraid again” approach:
