He isn't hurting them.
The people bothered by Trump mostly aren't GOP voters. But since the GOP rump now have complete control of the US electoral system, only their votes matter .
Yes, a few of the GOP establishment plutocrats and paleocons are upset by Trump, but most of the base are absolutely delighted with him. Their only complaint is that he isn't getting rid of the brown people fast enough.
You're in the mid-late stages of a fascist takeover. Voting ain't gonna change that, and neither is an intra-GOP coup. Even if that were to happen , you'd just be swapping a clumsy fascist for a well-oiled one.
 Barring effective mass unrest/insurrection.
 Very unlikely; the GOP base show no sign of abandoning Trump in significant numbers.