The problem is that Nazis have already abandoned the notion of free speech. As ever, it comes down to an imbalance in the meaning behind common language as used by different groups. When Nazis say “I want my free speech” they universally mean “I deserve to be heard by as many people as possible and any attempt to even counter my argument is an offense that should be subject to legal punishment”, whereas people who oppose the freedom of speech for Nazis are usually opposed to it because the Nazis are calling for the destruction of democracy and the violent subjugation of those they consider inferior.
It’s basically “so much for the tolerant left” with more appeals to the constitution.
I feel like there are ways to qualify “free speech” in at least the colloquial (aka “not the government telling you what you’re allowed to say”) sense that exclude expressions which advocate for the violation of fundamental human rights without endangering actual freedom of expression.
