The Morality First strategy for developing AI systems that can represent and respond to human values aims to first develop systems that can represent and respond to moral values. I argue that Morality First and other X-First views are unmotivated. Moreover, according to some widely accepted philosophical views about value, these strategies are positively distorting. The natural alternative, according to which no domain of value comes “first” introduces a new set of challenges and highlights an important but otherwise obscured problem (...) for e-AI developers. (shrink)

A theory of normative reasons for action faces the fundamental challenge of accounting for the dual nature of reasons. On the one hand, some reasons appear to depend on, and vary with, desires. On the other hand, some reasons appear categorical in the sense of being desire‐independent. However, it has turned out to be difficult to provide a theory that accommodates both these aspects. Internalism is able to account for the former aspect, but has difficulties to account for the latter, (...) whereas externalism is vulnerable to the reverse problem. In this paper, I outline an ecumenical view that consists of two parts: First, I defend a distinction between requiring reasons and justifying reasons in terms of their different connections to rationality. Second, I put forward a subjectivist, procedural, view of rationality. The ecumenical alternative, I argue, is able to accommodate the mentioned duality within a unified theory. In outlining this view, I also suggest that it has a number of other significant advantages. (shrink)