Well, aside from the valid point you just made, another reason is that sex workers require monetary payment for their services, whereas the very basis of incel/MRA/PUA culture is that men are “automatically owed” sex from the ideal female of their choosing.
So being expected to pay for sex is “beneath them,” a direct “insult” to their ever-so-fragile manhood.
