Stop letting reactionaries define your language for you. Anti-fascism is a big tent ranging from liberal pacifists to the Swedish Antifa (who admit they do go looking for violence).
Try liberals and socialists. (and I do mean social liberals in this case)