"Intellectual Debt": It's bad enough when AI gets its predictions wrong, but it's potentially WORSE when AI gets it right

[JonS]

@doctorow

One concrete proposal is to create backups of the data and algorithms used to produce these opaque-but-functional systems so that when they break down, we can inspect their inputs and try to figure out why.

Backups are great … until we forget how to use them, or destroy all the machines which can read them. See; NASA