I totally agree with this. That said, religion’s often been what dictates our culture, and not just a product of it. If we have something dictating our behaviour it should be fair and rational. In other words, not a religion.
Why do we live in a misogynist culture? Because our irrational religions have promoted misogyny for centuries.