He also enslaved human beings.
“But wait!” I can already hear you protest, “While it’s true that slavery is an egregious crime against humanity, it’s not fair to judge Madison by modern standards! We need to weigh his actions and opinions in their proper historical context.”
To which I say: Quite right. And the same stands true for his stance on firearms.
