They surely believe they protect Justice itself.
It’s reasonable to assume that on the steps of the court there are attorney-client talks which would fall under the eponymous privilege. How many totally unrelated cases could be overturned because of the illegal tapping.
Also that’s why the FBI (hopefully right) thought they’d never get a warrant in the first place.