Ethics in the tradition of Derek Parfit’s Reasons and Persons is riddled with sorites-like arguments, which lead us by what seem innocent steps to seemingly false conclusions. Take, for example, spectrum arguments for the Repugnant Conclusion that appeal to slight differences in quality of life. Several authors have taken the view that, since spectrum arguments are structurally analogous to sorites arguments, the correct response to spectrum arguments is structurally analogous to the correct response to sorites arguments. This sorites analogy is (...) here argued against. There are potential structural disanalogies between spectrum arguments and sorites arguments. But even if these arguments are relevantly structurally analogous, they differ in their content in ways that show the sorites analogy to be implausible. Two content-based disanalogies are here explored—one is inspired by Parfit’s work on reductionism, and the other involves hypersensitivity. The chapter concludes with a methodological lesson. (shrink)

After generalizing the Archimedean property of real numbers in such a way as to make it adaptable to non-numeric structures, we demonstrate that the real numbers cannot be used to accurately measure non-Archimedean structures. We argue that, since an agent with Artificial General Intelligence (AGI) should have no problem engaging in tasks that inherently involve non-Archimedean rewards, and since traditional reinforcement learning rewards are real numbers, therefore traditional reinforcement learning probably will not lead to AGI. We indicate two possible ways (...) traditional reinforcement learning could be altered to remove this roadblock. (shrink)