No, I’m afraid that’s what you’d like the argument to be, but that’s not what it is, at all. Symbols, like words, do not exist in a vaccuum. I cannot put photos of guns around, believing them to be symbols of quality engineering, and pretend that to everyone else it isn’t a potential threat of violence. Symbols are frequently co-opted by culture. The same thing happened in the US to the confederate flag - it doesn’t matter that to some it does not stand for bigotry. For most it does, and you cannot simply pretend otherwise.
Not all “sides” of an argument are equal. This isn’t Fox News. you cannot remove the bigotry and hate from Nazi symbolism, and a discussion about whether or not those using it “mean” for it to represent those things is, therefore, a non-starter here.