In simulation, AI-enabled drone kills its human operators if they try to cancel its mission

Fair point, though in this particular scenario the AI would be more likely to be incentivized to lie to convince the operator to issue the “don’t kill” order, since not killing is simpler than killing (since it’s the default result of inaction).

Wholeheartedly agree. We should never design AIs that can actually kill people, because we will screw it up.

Still, AI isn’t going away, so we will need to learn how to use it responsibly. You don’t have to build a murder machine to do real damage with a poorly designed AI model. While I suspect this particular experiment was intentionally designed to highlight some of these problems, if it was a serious attempt to model an AI killer, their approach (and especially their follow up patch) was incompetently flawed.

4 Likes
6 Likes

That’s exactly what an A.I. would want you to think.

4 Likes

… which is on par for military-issue equipment, if the standard jokes have any truth behind them. :slight_smile: the highest prices for the lowest quality. :smiley:

3 Likes

apparently what they’re saying now is that it was just a thought experiment

5 Likes

Updated:

 

4 Likes

Exactly right. And more than negative points, attacking your own side should completely void the game. The problem is that for ages now “friendly fire” and “colateral damage” have been an integral part of the equation in war simulations.

3 Likes

This topic was automatically closed after 5 days. New replies are no longer allowed.