In this article, I use science-fiction scenarios drawn from Dan Simmons’ “Hyperion Cantos” (Hyperion, The Fall of Hyperion, Endymion, The Rise of Endymion) to explore a cluster of issues related to the evolutionary history and neural bases of human moral cognition, and the moral desirability of improving our ability to make moral decisions by techniques of neuroengineering. I begin by sketching a picture of what recent research can teach us about the character of human moral psychology, with a particular emphasis (...) on highlighting the importance of our evolutionary background as social mammals. I then consider how the moral psychology of intelligent machines might differ from our own, and argue that the differences would depend on the extent to which their evolutionary background resembled our own. I offer two very different case studies—the “Technocore AIs” that have evolved from early, parasitic computer programs, and the mysterious “Shrike,” who travels backward through time. I close by looking at the character of Aenea, a messianic figure that is a joint descendant of humans and machines. I argue that while the sort of “moral enhancement” she represents is far beyond the scope of either contemporary neuroscience or artificial intelligence research, it nevertheless represents a worthwhile goal. (shrink)

Epistemic consequentialists think that epistemic norms are about believing the truth and avoiding error. Recently, a number of authors have rejected epistemic consequentialism on the basis that it incorrectly sanctions tradeoffs of epistemic goodness. Here, I argue that epistemic consequentialists should borrow two lessons from ethical consequentialists to respond to these worries. Epistemic consequentialists should construe their view as an account of right belief, which they distinguish from other notions like rational and justified belief. Epistemic consequentialists should also make their (...) view ‘sophisticated,’ in the sense of Railton. Epistemic consequentialism, I conclude, is best construed as sharing much of its structure with prominent act-consequentialist views in ethics. Epistemic consequentialism has an advantage over its ethical counterpart though: the key claim of the view is practically universally accepted, which gives us an additional reason to think it’s true. (shrink)