Agreed, that’s highly fallacious reasoning.
Any group that amasses enough significant power can oppress and exploit the masses, who often do not have easy access to the same resources.