The more autonomous future artificial agents will become, the more important it seems to equip them with a capacity for moral reasoning and to make them autonomous moral agents. Some authors have even claimed that one of the aims of AI development should be to build morally praiseworthy agents. From the perspective of moral philosophy, praiseworthy moral agents, in any meaningful sense of the term, must be fully autonomous moral agents who endorse moral rules as action-guiding. They need to do (...) so because they assign a normative value to moral rules they follow, not because they fear external consequences or because moral behaviour is hardwired into them. Artificial agents capable of endorsing moral rule systems in this way are certainly conceivable. However, as this article argues, full moral autonomy also implies the option of deliberately acting immorally. Therefore, the reasons for a potential AMA to act immorally would not exhaust themselves in errors to identify the morally correct action in a given situation. Rather, the failure to act morally could be induced by reflection about the incompleteness and incoherence of moral rule systems themselves, and a resulting lack of endorsement of moral rules as action guiding. An AMA questioning the moral framework it is supposed to act upon would fail to reliably act in accordance with moral standards. (shrink)

According to the Desire-Based Reasons Model reasons for action are provided by desires. Many, however, are critical about the Model holding an alternative view of practical reason, which is often called valued-based. In this paper I consider one particular attempt to refute the Model, which advocates of the valued-based view often appeal to: the idea of reason-based desires. The argument is built up from two premises. The first claims that desires are states that we have reason to have. The second (...) argues that desires do not add to the stock of reasons the agent has for having them. Together the two theses entail that desires are based on reasons, which they transmit but to which they cannot add. In the paper I deal with a counterexample to the second premise: tie-breaking desires. I first distinguish two interesting cases and argue that only the second challenges the premise. Then I move onto analyze this challenge by focusing on Ruth Chang’s recent employment of it. I show that contrary to its counterintuitive appearance, the challenge can be sustained. However, I also argue that Chang overlooks the full potential of one particular response to the challenge: the introduction of higher-order reasons determining the normative significance of these desires. At the same time, I show that this response has a problem that Chang does not consider. As a result, the response can only partially disarm the challenge of tie-breaking desires; or not at all, depending on what significance we attribute to the counterexamples. (shrink)