There's a notorious Nazi concentration camp guard living in New York City and ICE won't deport him

That’s something a court should decide. If the USA is unwilling to prosecute there’s still the option of the ICC. Even non signatories can ask the ICC to prosecute. That won’t happen unfortunately because that would mean a severe loss of face diplomatically.