Ethical issues in advanced artificial intelligence

Download Edit this record How to cite View on PhilPapers
Abstract
The ethical issues related to the possible future creation of machines with general intellectual capabilities far outstripping those of humans are quite distinct from any ethical problems arising in current automation and information systems. Such superintelligence would not be just another technological development; it would be the most important invention ever made, and would lead to explosive progress in all scientific and technological fields, as the superintelligence would conduct research with superhuman efficiency. To the extent that ethics is a cognitive pursuit, a superintelligence could also easily surpass humans in the quality of its moral thinking. However, it would be up to the designers of the superintelligence to specify its original motivations. Since the superintelligence may become unstoppably powerful because of its intellectual superiority and the technologies it could develop, it is crucial that it be provided with human-friendly motivations. This paper surveys some of the unique ethical issues in creating superintelligence, and discusses what motivations we ought to give a superintelligence, and introduces some cost-benefit considerations relating to whether the development of superintelligent machines ought to be accelerated or retarded.
Keywords
No keywords specified (fix it)
PhilPapers/Archive ID
BOSEII
Revision history
Archival date: 2019-03-18
View upload history
References found in this work BETA

No references found.

Add more references

Citations of this work BETA
Autonomous Machines, Moral Judgment, and Acting for the Right Reasons.Purves, Duncan; Jenkins, Ryan & Strawser, Bradley J.
Thinking Inside the Box: Controlling and Using an Oracle AI.Armstrong, Stuart; Sandberg, Anders & Bostrom, Nick

View all 10 citations / Add more citations

Added to PP index
2009-01-28

Total views
2,001 ( #790 of 43,836 )

Recent downloads (6 months)
1,106 ( #179 of 43,836 )

How can I increase my downloads?

Downloads since first upload
This graph includes both downloads from PhilArchive and clicks to external links.