How to solve the artificial intelligence "stop button" problem

What you need is a second agi that rides on the back of the first agi with one that has the utility function of ensuring that the first always does what it’s supposed to.
I call it nuclear jiminy cricket option.