Suppose there are no in-principle restrictions on the contents of arbitrarily intelligent agents’ goals. According to “instrumental convergence” arguments, potentially scary things follow. I do two things in this paper. First, focusing on the influential version of the instrumental convergence argument due to Nick Bostrom, I explain why such arguments require an account of “promotion,” i.e., an account of what it is to “promote” a goal. Then, I consider whether extant accounts of promotion in the literature -- in particular, probabilistic (...) and fit-based views of promotion -- can be used to support dangerous instrumental convergence. I argue that neither account of promotion can do the work. The opposite is true: accepting either account of promotion undermines support for instrumental convergence arguments’ existentially worrying conclusions. The conclusion is that we needn’t be scared -- at least not because of arguments concerning instrumental convergence. (shrink)

Consequentialist theories that directly assess multiple focal points face an important objection: that one right option may conflict with another. Robert Adams raises an instance of this objection regarding the possibility that the right act conflicts with the right motives. Whereas only partial responses have previously been given, assuming particular views of the relation between motives and acts, an exhaustive treatment is in order. Either motives psychologically determine acts, or they do not – and I defend direct consequentialism on each (...) assumption. Crucially, if motives determine acts, this may be compatible with the ability to act otherwise, but there remains a defense for consequentialism even on these assumptions. What clears consequentialism of conflict is not necessarily that the apparently right act is unavailable, but rather that its outcome is suboptimal once we account for necessary motives. Even if the agent remains free to perform the act, the act costs too much. (shrink)

Extant discussions of subjectivism about reasons for action have concentrated on presentist versions of the theory, on which reasons for present actions are grounded in present desires. In this article, I motivate and investigate the prospects of futurist subjectivism, on which reasons for present actions are grounded in present or future desires. Futurist subjectivism promises to answer Parfit's Agony Argument, and it is motivated by natural extensions of some of the considerations that support subjectivism in general. However, it faces a (...) problem: because which desires one will have in the future can depend on what one does now, it must tell us which of one's possible future desires give one reasons to promote their satisfaction. I argue that the most natural solutions to this problem are unsatisfactory: they either fail to answer the Agony Argument or have unacceptable implications elsewhere. Then, I propose a more promising solution. Moreover, I argue that a closely analogous problem arises for an important class of idealizing subjectivist views and that this problem admits of a similar solution. (shrink)

According to extant versions of epistemic instrumentalism, epistemic reasons are instrumental reasons. Epistemic instrumentalism is unpopular. I think it’s just misunderstood. Rather than saying epistemic reasons are instrumental reasons, epistemic instrumentalists should only say that if there is an epistemic reason, there is also an instrumental reason. This is the view I call ecumenical epistemic instrumentalism. In this paper, I first motivate, next sketch, and finally highlight the advantages of this version of epistemic instrumentalism.