This is a terrible idea. You point out that it’s a good thing that it doesn’t block the people that you already follow, so you understand that there may be a reason that someone is following a twit that doesn’t mean that the follower is a twit as well. Some people like to keep an eye on what “the other side” is talking about. Others follow someone because of one thing tweeted at some point that they liked or agreed with, and only find out much later that the person is actually a horrible human being. Whatever the cause, there are plenty of reasons that a person who follows or is followed by a Nazi is not a Nazi themselves.
Meanwhile, you’ve now shut yourself off from potentially interesting voices that just got caught in the dragnet.
Guilt by association is just not a good look, whether it’s in the form of Sesame Credit or in the form of mass-blocking of followers and the followed on Twitter. Sure, it’s much WORSE when it’s done by governments, lenders and employers than when it’s done by ordinary people who just want to trim their Twitter feed, but the idea that guilt by association is a good way to filter folks at all should probably be discouraged on principle just the same.