I’m with ya.
If a woman has a buzz-cut it’s not called a ‘woman buzz-cut’ - If a man has a ponytail it’s not called a ‘man ponytail’ - Nobody calls Willie Nelson’s braids ‘man braids’.
Yet, for some reason, man bun.
I think the addition of ‘man’ in notiing a man with a hair-bun is merely a subtle disparage-ization - perhaps because people like to mock anything hipsters were noted for (I know maile hipsters were not the first men to don buns by far - but I think the most recent resurgence/prominence came from hipsters)