Ammonium nitrate can go boom by itself, especially if it is impure, poorly stored etc. All that nitrogen wants to be gas! ANFO is more reliable and stable, hence it’s used when you’re purposefully trying to blow something up.
And yes, fire can be enough, in a confined space where the stuff can’t just burn or deflagrate in (extremely relative) peace.
