There's a notorious Nazi concentration camp guard living in New York City and ICE won't deport him

As you apparently didn’t bother to read the article I repeat myself:

He never was a german citizen.

Additionally:

The USA had no problems prosecuting nazis before.

The USA had no problems sheltering nazis before. Unfortunately this one wasn’t as useful as the others.