Military AI as a Convergent Goal of Self-Improving AI

In Artificial Intelligence Safety and Security. Louiswille: CRC Press (2018)
Download Edit this record How to cite View on PhilPapers
Abstract
Better instruments to predict the future evolution of artificial intelligence (AI) are needed, as the destiny of our civilization depends on it. One of the ways to such prediction is the analysis of the convergent drives of any future AI, started by Omohundro. We show that one of the convergent drives of AI is a militarization drive, arising from AI’s need to wage a war against its potential rivals by either physical or software means, or to increase its bargaining power. This militarization trend increases global catastrophic risk or even existential risk during AI takeoff, which includes the use of nuclear weapons against rival AIs, blackmail by the threat of creating a global catastrophe, and the consequences of a war between two AIs. As a result, even benevolent AI may evolve into potentially dangerous military AI. The type and intensity of militarization drive depend on the relative speed of the AI takeoff and the number of potential rivals. We show that AI militarization drive and evolution of national defense will merge, as a superintelligence created in the defense environment will have quicker takeoff speeds, but a distorted value system. We conclude with peaceful alternatives.
PhilPapers/Archive ID
TURMAA-6
Upload history
First archival date: 2018-01-13
Latest version: 2 (2018-04-29)
View other versions
Added to PP index
2018-01-13

Total views
1,215 ( #3,444 of 2,445,379 )

Recent downloads (6 months)
188 ( #2,866 of 2,445,379 )

How can I increase my downloads?

Downloads since first upload
This graph includes both downloads from PhilArchive and clicks on external links on PhilPapers.