A large chunk of that destruction was brought about by the late heavy bombardment ~4b years ago. Since then, the impacts have been considerably less frequent and severe. Not absent, obviously. See: Lack of dinosaurs for the last 64 million years. But probably a pretty damn secure location for the history of the human race should we (as is looking increasingly likely) off ourselves. When the High Overlords return to find we have royally screwed the pooch, at least there will be a record of our pooch screwing.
6 Likes