And who will guard the AI guardians?
But seriously, we won’t have to worry about programming/training ethical bank software because we’ll have AI guardians who will do it for us? If we can write generic AI guardians, then it will be a lot easier to write ethical software with only one area of experise. And really, watching the software should really be a human job right now, not a job for an AI in the distant future.
That’s what I take away from these warnings from various luminaries about evil AI: that we should be spending time now thinking about how to instill ethical behaviour into all of our systems — software or organizational — instead of putting it off to some numinous future.