Chrisoula Andreou says procrastination qua imprudent delay is modeled by Warren Quinn’s self-torturer, who supposedly has intransitive preferences that rank each indulgence in something that delays his global goals over working toward those goals and who finds it vague where best to stop indulging. His pair-wise choices to indulge result in his failing the goals, which he then regrets. This chapter argues, contra the money-pump argument, that it is not irrational to have or choose from intransitive (...) class='Hi'>preferences; so the agent’s delays are not imprudent, not instances of procrastination. Moreover, the self-torturer case is intelligible only if there is no vagueness and if the agent’s preferences are transitive. But then he would delay only from ordinary weakness of will. And when it is vague where best to stop indulging, rational agents would use symmetry-breaking techniques; so, again, any procrastination would be explained by standard weakness of will, not vagueness. (shrink)

According to a widely held view, rationality demands that the preferences of a person be transitive. The transitivity assumption is an axiom in standard theories of rational choice. It is also prima facie very plausible. I argue here that transitivity is not a necessary condition of rationality; it is a constraint only in some cases. The argument presented here is based on the non-linearity of differential utility functions. This paper has four parts. First, I present an argument against the (...) transitivity assumption (I, II). Second, I discuss some objections; this will also bring out some features of the view defended here, like the essentially comparative nature of choice (III). Then, I discuss certain proposals that promise to avoid my conclusion (IV). Finally, I go into some implications concerning the nature of rational decision making (V). To accept some intransitivities as rational does not make our life easier; it can even lead to hard choices. However, it does not lead to skepticism about rational choice. (shrink)

When discussing the general inertia in climate change mitigation, it is common to approach the analysis either in terms of epistemic obstacles (climate change is too scientifically complex to be fully understood by all in its dramatic nature and/or to find space in the media) and/or moral obstacles (the causal link between polluting actions and social damage is too loose, both geographically and temporally, to allow individuals to understand the consequences of their emissions). In this chapter I maintain that both (...) categories of obstacles now play a secondary role: many people have a clear understanding of the physical and social dynamics involved in climate change. The main reason why so few manage to reduce their ecological footprint is an ethical short-circuit that does not allow most people to reveal their “true” climate-related preferences in their daily choices. This short-circuit manifests itself in two phenomena that can be analysed through the lens of moral psychology. First, as the possibility of anticipated utility approaches, individuals further discount expected future utility and may even reverse their preferences (due to the so-called immediacy multiplier, in addition to the better known and discussed future utility discounting). Second, individuals struggle to order their preferences transitively when presented with the opportunity to obtain small net marginal utilities in the short run. The intertemporal and collective structure of the climate problem creates fertile ground for both phenomena, which means that even those who are sincerely convinced of the need to contribute to climate change mitigation end up trapped in loops of procrastination, both first and second level. If, however, we can understand the origin of these phenomena, then we will be able to devise counteracting solutions that will speed up individual mitigation efforts. I will therefore briefly propose three ethical/public strategies to break the procrastination loop: pre-commitment; increasing the costs of marginal postponements; reducing the disutility of action that is likely to be postponed. (shrink)

I argue that we can generate intransitive preference orderings for a single person on the model of Sen's Libertarian Paradox.

So-called money pump arguments aim to show that intransitive preferences are irrational because they will lead someone to accept a series of deals that leaves his/her financially worse off and better off in no respect. A common response to these arguments is the foresight response, which counters that the agent in question may see the exploitation coming, and refuse to trade at all. To obviate this response, I offer a “deluxe money pump argument” that applies dominance reasoning to (...) a modified money pump case. (shrink)

The essentially comparative conception of value entails that the value of a state of affairs does not depend solely upon features intrinsic to the state of affairs, but also upon extrinsic features, such as the set of feasible alternatives. It has been argued that this conception of value gives us reason to abandon the transitivity of the better than relation. This paper shows that the support for intransitivity derived from this conception of value is very limited. On its most plausible (...) interpretations, it merely provides a necessary, but not sufficient, condition for intransitivity. It is further argued that the essentially comparative conception of value appears to support a disjunctive conclusion: there is incommensurability of value or betterness is not transitive. Of these two alternatives, incommensurability is preferable, because it is far less threatening to our other axiological commitments. (shrink)

This paper concerns Warren Quinn’s famous “The Puzzle of the Self-Torturer.” I argue that even if we accept his assumption that practical rationality is purely instrumental such that what he ought to do is simply a function of how the relevant options compare to each other in terms of satisfying his actual preferences that doesn’t mean that every explanation as to why he shouldn’t advance to the next level must appeal to the idea that so advancing would be suboptimal (...) in terms of the satisfaction of his actual preferences. Rather, we can admit that his advancing would always be optimal, but argue that advancing isn’t always what he ought to do given that advancing sometimes fails to meet some necessary condition for being what he ought to do. For instance, something can be what he ought to do only if it’s an option for him. What’s more, something can be what he ought to do only if it’s something that he can do without responding inappropriately to his reasons—or, so, I argue. Thus, the solution to the puzzle is, I argue, to realize that, in certain circumstances, advancing is not what the self-torturer ought to do given that he can do so only by responding inappropriately to his reasons. (shrink)

How can we resist the repugnant conclusion? James Griffin has plausibly suggested that part way through the sequence we may reach a world—let us call it “J”—in which the lives are lexically superior to those that follow. If it would be preferable to live a single life in J than through any number of lives in the next one, then it would be strange to judge K the better world. Instead, we may reasonably “suspend addition” and judge J superior, as (...) if aggregating the lives in the larger world intrapersonally. I argue that the addition of new people with separate preferences renders this inference illicit when comparing J+ and K. When one pairwise comparison suspends addition and the other does not, the result is an intransitive value judgement: J < J+ < K < J, producing the mere addition paradox. (shrink)

This a review of Alex Worsnip's book 'Fitting Things Together: Coherence and the Demands of Structural Rationality'.

In “The Irrelevance of the Diachronic Money-Pump Argument for Acyclicity,” The Journal of Philosophy CX, 8 (August 2013), 460-464, Johan E. Gustafsson contends that if Davidson, McKinsey and Suppes’ diachronic money-pump argument in their "Outlines of a Formal Theory of Value, I," Philosophy of Science 22 (1955), 140-160 is valid, so is the synchronic argument Gustafsson himself offers. He concludes that the latter renders irrelevant diachronic choice considerations in general, and the two best-known diachronic solutions to the money pump problem (...) in particular. I argue here that this reasoning is incorrect, and that Gustafsson’s synchronic argument is faulty on independent grounds. Specifically, it is based on a false analogy between the derivation of a synchronic ordinal ranking from a transitive series of pairwise comparisons, and the putative derivation of such a ranking from an intransitive series. The latter is not possible under the assumption of revealed preference theory, and is highly improbable even if that assumption is rejected. Moreover, Gustafsson’s argument raises issues of fidelity to the historical texts that must be addressed. I conclude that the money pump, and cyclical choice more generally, are necessarily diachronic; and therefore that the two best-known diachronic solutions to the money pump problem remain relevant. (shrink)

LLMs have dramatically improved in capabilities in recent years. This raises the question of whether LLMs could become genuine agents with beliefs and desires. This paper demonstrates an in principle limit to LLM agency, based on their architecture. LLMs are next word predictors: given a string of text, they calculate the probability that various words can come next. LLMs produce outputs that reflect these probabilities. I show that next word predictors are exploitable. If LLMs are prompted to make probabilistic predictions (...) about the world, these predictions are guaranteed to be incoherent, and so Dutch bookable. If LLMs are prompted to make choices over actions, their preferences are guaranteed to be intransitive, and so money pumpable. In short, the problem is that selecting an action based on its potential value is structurally different then selecting the description of an action that is most likely given a prompt: probability cannot be forced into the shape of expected value. The in principle exploitability of LLMs raises doubts about how agential they can become. This exploitability also offers an opportunity for humanity to safely control such AI systems. (shrink)

Approval Voting offers advantages over other voting systems for single-winner elections. This manuscript analyzes three unique virtues of Approval Voting. First, the procedure does not violate the independence of irrelevant alternatives criterion for rational choice. Second, it prevents manipulation of outcomes through agenda setting. Third, it avoids intransitive majority preference cycles like Condorcet paradoxes and so escapes Arrow’s Impossibility Theorem constraints. As a result of these virtues, which are generally not shared by its best known competitors, Approval voting emerges (...) as a strong option for realizing majoritarian democratic will. (shrink)

Two experiments are reported which demonstrated intransitivity in category judgments, thus challenging a widely held assumption that the relation between categorized sets is one of class inclusion. Subjects consistently accepted the truth of certain category statements, in spite of being aware of the existence of counterexamples. Implications for semantic memory theory are discussed.

The word ?consciousness? is notoriously ambiguous. This is mainly because it is not a term of art, but a mundane word we all use quite frequently, for different purposes and in different everyday contexts. In this paper, I discuss consciousness in one specific sense of the word. To avoid the ambiguities, I introduce a term of art ? intransitive self-consciousness ? and suggest that this form of self-consciousness is an essential component of the folk notion of consciousness. I then (...) argue for a specific account of consciousness as intransitive self-consciousness. According to this account, a mental state is conscious iff it represents its own occurrence. The argument is a ?modernizing? modification of an older argument due to Aristotle and Brentano. (shrink)

Supererogatory acts are those that lie “beyond the call of duty.” There are two standard ways to define this idea more precisely. Although the definitions are often seen as equivalent, I argue that they can diverge when options are infinite, or when there are cycles of better options; moreover, each definition is acceptable in only one case. I consider two ways out of this dilemma.

There has been a call for a potentially revolutionary change to our existing understanding of the psychological concept of personal identity. Apparently, people can psychologically represent people, including themselves, as multiple individuals at the same time. Here we ask whether the intransitive judgments found in these studies truly reflect the operation of an intransitive concept of personal identity. We manipulate several factors that arbitrate between transitivity and intransitivity and find most support for transitivity: in contrast to prior work, (...) most participants do not make intransitive judgments when there is any reason to favor one individual over another. People change which single individual they personally identify with, depending on which individual competes more strongly or weakly for identity, rather than identifying with both individuals. Even when two individuals are identical and therefore both entitled to be the same person, we find that people make more transitive judgments once they understand the practical commitments of their responses (Experiment 4), and report not being able to actually imagine two perspectives simultaneously when reasoning about the scenario (Experiment 5). In short, we suggest that while people may make intransitive judgments, these do not reflect that they psychologically represent identity in an intransitive manner. (shrink)

Igor Douven establishes several new intransitivity results concerning evidential support. I add to Douven’s very instructive discussion by establishing two further intransitivity results and a transitivity result.

This paper is a pastiche of the Lacanian philosopher Renata Salecl, my fourth attempt, combined with a note. In it I present a response I anticipate from analytic philosophy to the thesis that the signifier has priority over the signified: that this thesis is either trivially true or obviously false.

Philosophers working on time-biases assume that people are hedonically biased toward the future. A hedonically future-biased agent prefers pleasurable experiences to be future instead of past, and painful experiences to be past instead of future. Philosophers further predict that this bias is strong enough to apply to unequal payoffs: people often prefer less pleasurable future experiences to more pleasurable past ones, and more painful past experiences to less painful future ones. In addition, philosophers have predicted that future-bias is restricted to (...) first-person preferences, and that people’s third-person preferences are time-neutral. Philosophers disagree vigorously about the normative status of these preferences—i.e., they disagree about whether first-person future-bias is rationally permissible. Time-neutralists, for example, have appealed to the predicted asymmetry between first- and third-person preferences to argue for the rational impermissibility of future-bias. We empirically tested these predictions, and found that while people do prefer more past pain to less future pain, they do not prefer less future pleasure to more past pleasure. This was so in both first and third-person conditions. This suggests that future-bias is typically non-absolute, and is more easily outweighed in the case of positive events. We connect this result to the normative debate over future-bias. (shrink)

This paper has two aims. First, it aims to provide an adverbial account of the idea of intransitive self-consciousness and second, it aims to argue in favor of this account. These aims both require a new framework that emerges from a critical review of Perry’s famous notion of the “unarticulated constituents” of propositional content (1986). First, I aim to show that the idea of intransitive self-consciousness can be phenomenologically described in an analogy with the adverbial theory of perception. (...) In an adverbial theory of perception, we do not see a blue sense-data, but we see something blue-ly, whereas in intransitive self-consciousness, we are not conscious of ourselves when we undergo a conscious experience—instead, we experience something self-consciously. But what does this mean precisely? First, I take intransitive self-consciousness to be the first-person operator that prefixes the content of any experience that the subject undergoes, regardless of whether or not the subject is self-referred. Further, I argue that this first-person adverbial way of entertaining the content of any experience in Perry’s revised framework fixes the subject as part of the circumstance of the evaluation of the content of her own experience. We can only evaluate whether the content is veridical or falsidical relative to the subject undergoing the experience. This is referred to here as “self-concernment without self-reference.” When I am absorbed in reading a book, I do not self-represent my own experience of reading a book, let alone see myself as a constituent of the content of this experience. Even so, I experience that reading self-consciously in the precise sense that I do belong to the circumstance of the evaluation of the selfless content of my experience of reading the book. The content of the experience of reading a book is simply a propositional function, true or false of myself. (shrink)

I distinguish several doctrines that economic methodologists have found attractive, all of which have a positivist flavour. One of these is the doctrine that preference assignments in economics are just shorthand descriptions of agents' choice behaviour. Although most of these doctrines are problematic, the latter doctrine about preference assignments is a respectable one, I argue. It doesn't entail any of the problematic doctrines, and indeed it is warranted independently of them.

An important objection to preference-satisfaction theories of well-being is that these theories cannot make sense of interpersonal comparisons of well-being. A tradition dating back to Harsanyi () attempts to respond to this objection by appeal to so-called extended preferences: very roughly, preferences over situations whose description includes agents’ preferences. This paper examines the prospects for defending the preference-satisfaction theory via this extended preferences program. We argue that making conceptual sense of extended preferences is less problematic (...) than others have supposed, but that even so extended preferences do not provide a promising way for the preference satisfaction theorist to make interpersonal well-being comparisons. Our main objection takes the form of a trilemma: depending on how the theory based on extended preferences is developed, either the result will be inconsistent with ordinary preference-satisfaction theory, or it will fail to recover sufficiently rich interpersonal well-being comparisons, or it will take on a number of other arguably odd and undesirable commitments. (shrink)

In this paper, I draw attention to comparative preference claims, i.e. sentences of the form \S prefers p to q\. I show that preference claims exhibit interesting patterns, and try to develop a semantics that captures them. Then I use my account of preference to provide an analysis of desire. The resulting entry for desire ascriptions is independently motivated, and finds support from a wide range of phenomena.

Some common explanations of issue polarization and echo chambers rely on social or cognitive mechanisms of exclusion. Accordingly, suggested interventions like “be more open-minded” target these mechanisms: avoid epistemic bubbles and don’t discount contrary information. Contrary to such explanations, we show how a much weaker mechanism—the preference for belief—can produce issue polarization in epistemic communities with little to no mechanisms of exclusion. We present a network model that demonstrates how a dynamic interaction between the preference for belief and common structures (...) of epistemic communities can turn very small unequal distributions of initial beliefs into full-blown polarization. This points to a different class of explanations, one that emphasizes the importance of the initial spread of information. We also show how our model complements extant explanations by including a version of biased assimilation and motivated reasoning—cognitive mechanisms of exclusion. We find that mechanisms of exclusion can exacerbate issue polarization, but may not be the ultimate root of it. Hence, the recommended interventions suggested by extant literature is expected to be limited and the problem of issue polarization to be even more intractable. (shrink)

I argue that Gauthier's constrained-maximizer rationality is problematic. But standard Maximizing Rationality means one's preferences are only rational if it would not maximize on them to adopt new ones. In the Prisoner's Dilemma, it maximizes to adopt conditionally cooperative preferences. (These are detailed, with a view to avoiding problems of circularity of definition.) Morality then maximizes. I distinguish the roles played in rational choices and their bases by preferences, dispositions, moral and rational principles, the aim of rational (...) action, and rational decision rules. I argue that Maximizing Rationality necessarily structures conclusive reasons for action. Thus conations of any sort can base rational choices only if the conations are structured like a coherent preference function; rational actions maximize on such functions. Maximization-constraining dispositions cannot integrate into a coherent preference function. (shrink)

Adaptive preference formation is the unconscious altering of our preferences in light of the options we have available. Jon Elster has argued that this is bad because it undermines our autonomy. I agree, but think that Elster's explanation of why is lacking. So, I draw on a richer account of autonomy to give the following answer. Preferences formed through adaptation are characterized by covert influence (that is, explanations of which an agent herself is necessarily unaware), and covert influence (...) undermines our autonomy because it undermines the extent to which an agent's preferences are ones that she has decided upon for herself. This answer fills the lacuna in Elster's argument. It also allows us to draw a principled distinction between adaptive preference formation and the closely related phenomenon of character planning. (shrink)

I argue that taking the Practical Conditionals Thesis seriously demands a new understanding of the semantics of such conditionals. Practical Conditionals Thesis: A practical conditional [if A][ought] expresses B’s conditional preferability given A Paul Weirich has argued that the conditional utility of a state of affairs B on A is to be identified as the degree to which it is desired under indicative supposition that A. Similarly, exploiting the PCT, I will argue that the proper analysis of indicative practical conditionals (...) is in terms of what is planned, desired, or preferred, given suppositional changes to an agent’s information. Implementing such a conception of conditional preference in a semantic analysis of indicative practical conditionals turns out to be incompatible with any approach which treats the indicative conditional as expressing non-vacuous universal quantification over some domain of relevant antecedent-possibilities. Such analyses, I argue, encode a fundamental misunderstanding of what it is to be best, given some condition. The analysis that does the best vis-à-vis the PCT is, instead, one that blends a Context-Shifty account of indicative antecedents with an Expressivistic, or non-propositional, treatment of their practical consequents. (shrink)

Adaptive preferences are preferences formed in response to circumstances and opportunities – paradigmatically, they occur when we scale back our desires so they accord with what is probable or at least possible. While few commentators are willing to wholly reject the normative significance of such preferences, adaptive preferences have nevertheless attracted substantial criticism in recent political theory. The groundbreaking analysis of Jon Elster charged that such preferences are not autonomous, and several other commentators have since (...) followed Elster’s lead. On a second front, Capacity Theorists Martha Nussbaum and Amartya Sen have objected that adaptive preferences lead people away from objective goods and constitute an impediment to progressive change in developing countries. In this paper I argue that the criticisms of Elster, Sen and Nussbaum fail on the one hand to take into account what may be positively said in favour of this type of preference formation, and fail on the other hand to distinguish between different types of psychological changes – with the result that many of the critiques offered have a narrower purview than is currently allowed. My analysis of adaptive preferences, even in their most ideal form, is however not entirely positive; I adduce reasons why we can be cautious about allowing adaptive preferences to play certain types of roles in political processes, even as we accept those very preferences as normative and autonomous for the agent holding them. [International scholars without access to the AJPAE are invited to email [email protected] for a pdf copy of this article.]. (shrink)

In this paper we describe a few interrelated issues for validating theories that posit levels of consciousness. First, validating levels of consciousness requires consensus about the ordering of conscious states, which cannot be easily achieved. This problem is particularly severe if we believe conscious states can be irreducibly smeared over time. Second, the relationship between conscious states is probably sometimes intransitive, which means levels of consciousness will not be amenable to a single continuous measure. Finally, even if a multidimensional (...) approach to levels of consciousness is adopted, we argue that there are further problems for its validation. (shrink)

I argue, first, that the deprived individuals whose predicaments Nussbaum cites as examples of "adaptive preference" do not in fact prefer the conditions of their lives to what we should regard as more desirable alternatives, indeed that we believe they are badly off precisely because they are not living the lives they would prefer to live if they had other options and were aware of them. Secondly, I argue that even where individuals in deprived circumstances acquire tastes for conditions that (...) we regard as bad, they are typically better off having their acquired preferences satisfied. If they are badly off it is because they cannot get what we and they, would regard as more desirable alternatives. Preference utilitarianism explains why individuals in such circumstances are badly off whether they have adapted to their deprived circumstances or not. Even if they prefer the conditions of their lives to all other available alternatives, most would prefer alternatives that are not available to them which would, on the preferentist account, make them better off. And that, on the preferentist account, is the basis for a radical critique of unjust institutions that limit people's options and prevent them from getting what they want. (shrink)

Patient preference predictors aim to solve the moral problem of making treatment decisions on behalf of incapacitated patients. This commentary on a case of an unrepresented patient at the end of life considers 3 related problems of such predictors: the problem of restricting the scope of inputs to the models (the “scope” problem), the problem of weighing inputs against one another (the “weight” problem), and the problem of multiple reasonable solutions to the scope and weight problems (the “multiple reasonable models” (...) problem). Each of these problems poses challenges to reliably implementing patient preference predictors in important, high-stakes health care decision making. This commentary also suggests a way forward. (shrink)

This paper is a partial review of the literature on ‘social preferences'. There are empirical findings that convincingly demonstrate the existence of social preferences, but there are also studies that indicate their fragility. So how robust are social preferences, and how exactly are they context dependent? One of the most promising insights from the literature, in my view, is an equilibrium explanation of mutually referring conditional social preferences and expectations. I use this concept of equilibrium, summarized (...) by means of a figure, to discuss a range of empirical studies. Where appropriate, I also briefly discuss a couple of insights from the (mostly parallel) evolutionary literature about cooperation. A concrete case of the Orma in Kenya will be used as a motivating example in the beginning. (shrink)

To the normal reasons that we think can justify one in preferring something, x (namely, that x has objectively preferable properties, or has properties that one prefers things to have, or that x's obtaining would advance one's preferences), I argue that it can be a justifying reason to prefer x that one's very preferring of x would advance one's preferences. Here, one prefers x not because of the properties of x, but because of the properties of one's having (...) the preference for x. So-revising one's preferences is rational in paradoxical choice situations like Kavka's Deterrence Paradox. I then try to meet the following objections: that this is stoicist, incoherent, bad faith; that it conflates instrumental and intrinsic value, gives wrong solutions to the problems presented by paradoxical choice situations, entails vicious regresses of value justification, falsifies value realism, makes valuing x unresponsive to x's properties, causes value conflict, conflicts with other standards of rationality, violates decision theory, counsels immorality, makes moral paradox, treats value change as voluntary, conflates first- and second-order values, is psychologically unrealistic, and wrongly presumes that paradoxical choice situations can even occur. (shrink)

Preference, according to many theories of human behaviour, is a very important phenomenon. It is therefore some what surprising that philosophers of mind pay so little attention to it. One question about preference concerns its variety. Is preference always preference for one option or state of affairs rather than another? Or is there also, as ordinary language suggests, object-preference – preferences for one person rather than another, for one country rather than another, for one value rather than another? Another (...) question or rather group of questions concerns the nature of preference. Is it a mental state, disposition, act or episode, a theoretical construct, a purely behavioural phenomenon? If it is a mental state or act, is it an intellectual, affective or a conative phenomenon? If it is an affective phenomenon, does it enjoy a positive or negative “valence”? Is preference to be understood as a relation between a person’s attitudes or is it a primitive phenomenon? (shrink)

For most of its history, decision theory has investigated the rational choices of humans under the assumption of static preferences. Human preferences, however, change. In recent years, decision theory has increasingly acknowledged the reality of preference change throughout life. This Element provides an accessible introduction and new contributions to the debates on preference change. It is divided into three chapters. In the first chapter, the authors discuss what preference change is and whether we can integrate it into decision (...) theory. In the second chapter, they present models of preference change, including a novel proposal of their own. In the third and final chapter, they discuss how we can rationally choose a course of action when our preferences might change. Both the transformative experience literature and recent work on choosing for changing selves are discussed. (shrink)

We investigate the conflict between the ex ante and ex post criteria of social welfare in a new framework of individual and social decisions, which distinguishes between two sources of uncertainty, here interpreted as an objective and a subjective source respectively. This framework makes it possible to endow the individuals and society not only with ex ante and ex post preferences, as is usually done, but also with interim preferences of two kinds, and correspondingly, to introduce interim forms (...) of the Pareto principle. After characterizing the ex ante and ex post criteria, we present a first solution to their conflict that extends the former as much possible in the direction of the latter. Then, we present a second solution, which goes in the opposite direction, and is also maximally assertive. Both solutions translate the assumed Pareto conditions into weighted additive utility representations, and both attribute to the individuals common probability values on the objective source of uncertainty, and different probability values on the subjective source. We discuss these solutions in terms of two conceptual arguments, i.e., the by now classic spurious unanimity argument and a novel informational argument labelled complementary ignorance. The paper complies with the standard economic methodology of basing probability and utility representations on preference axioms, but for the sake of completeness, also considers a construal of objective uncertainty based on the assumption of an exogeneously given probability measure. JEL classification: D70; D81. (shrink)

The use of machine learning, or “artificial intelligence” (AI) in medicine is widespread and growing. In this paper, I focus on a specific proposed clinical application of AI: using models to predict incapacitated patients’ treatment preferences. Drawing on results from machine learning, I argue this proposal faces a special moral problem. Machine learning researchers owe us assurance on this front before experimental research can proceed. In my conclusion I connect this concern to broader issues in AI safety.

I argue that the discussion around the True Preferences Knowledge Problem in behavioral welfare economics has suffered from a missing distinction between two different knowledge problems: one about welfare, and the other about public policy. Here, I separate those knowledge problems and show that, given their different success conditions, it is no surprise that we haven’t found a satisfactory answer to “the” true preferences knowledge problem. There is an embedded tendency to try to answer the policy knowledge problem (...) by engaging the welfare knowledge problem. I show that the impulse is misguided, and that we do not need to appeal to a complete theory of how preferences are related to welfare to answer questions about policy. However, this does not mean that we need to stop talking about preferences. We can make progress on the policy knowledge problem without appealing to a theory of welfare by focusing on the information that people are giving us about the mistakes they are making. I introduce repudiated preferences as a device that allows us to break out of this cycle and start to make progress in our discussions of nudging and Behavioral Intervention Policies without first solving the welfare knowledge problem. Finally, I acknowledge the challenges that still face this approach, and trace some avenues for how further work could build on these insights. (shrink)

I explain and motivate the shutdown problem: the problem of creating artificial agents that (1) shut down when a shutdown button is pressed, (2) don’t try to prevent or cause the pressing of the shutdown button, and (3) otherwise pursue goals competently. I then propose a solution: train agents to have incomplete preferences. Specifically, I propose that we train agents to lack a preference between every pair of different-length trajectories. I suggest a way to train such agents using reinforcement (...) learning: we give the agent lower reward for repeatedly choosing same-length trajectories. (shrink)

Technological advancement makes translation convenient due to the emergence of various translation tools. This Explanatory-Sequential study aims to determine the preference and the factors affecting the preference of Filipino and Foreign college students toward the Online Translation Tool. Likewise, it also aimed to identify if there is a significant difference between the respondents' choices. To acquire the data, the researchers used a survey conducted on 15 Filipino and foreign collegiate students enrolled in universities in Manila and a focus group discussion (...) among 3 Filipino students. The transcribed data were analyzed using Thematic Analysis. Moreover, the results of the quantitative data revealed that Google Translate was the preferred Online Translation Tool of Filipino and Foreign students for the reason of accessibility, user-friendliness, and the tendency of users to brand bias. The reasons presented in quantitative data are strengthened by the themes identified in the qualitative data. The three prevailing themes of Brand Bias, Accessibility, and Accuracy constituted the central theme of User Friendliness. It was identified through the Chi-Square Test that there is no significant difference among respondents' preferences (0.345 P-Value) toward online Translation software. (shrink)

Both Representation Theorem Arguments and Dutch Book Arguments support taking probabilistic coherence as an epistemic norm. Both depend on connecting beliefs to preferences, which are not clearly within the epistemic domain. Moreover, these connections are standardly grounded in questionable definitional/metaphysical claims. The paper argues that these definitional/metaphysical claims are insupportable. It offers a way of reconceiving Representation Theorem arguments which avoids the untenable premises. It then develops a parallel approach to Dutch Book Arguments, and compares the results. In each (...) case preferencedefects serve as a diagnostic tool, indicating purely epistemic defects. (shrink)

We prove a representation theorem for preference relations over countably infinite lotteries that satisfy a generalized form of the Independence axiom, without assuming Continuity. The representing space consists of lexicographically ordered transfinite sequences of bounded real numbers. This result is generalized to preference orders on abstract superconvex spaces.

Jeremy R. Garrett claims that the nature and scope of our rescue duties cannot be properly understood and addressed without reference to social context or institutional background conditions. In my comment I focus not on social or institutional but on psychological background conditions that are also necessary for the conceptualization of rescue cases. These additional conditions are of crucial importance since an entire paradigm of “rescue medicine” is founded, as Garret notices, on the powerful and immediate “impulse to rescue” (Garrett (...) 2015). I understand this “impulse” as the preference toward identified victims, and I argue that it may sometimes distort genuine moral judgments in rescue cases. (shrink)

An important question confronting feminist philosophers is why women are sometimes complicit in their own subordination. The dominant view holds that complicity is best understood in terms of adaptive preferences. This view assumes that agents will naturally gravitate away from subordination and towards flourishing as long as they do not have things imposed on them that disrupt this trajectory. However, there is reason to believe that ‘impositions’ do not explain all of the ways in which complicity can arise. This (...) paper defends a phenomenological account of complicity, which offers an alternative explanation. (shrink)

Inspired by the recent trends in education towards learner autonomy with their emphasis on the interests and desires of the students, and borrowing ideas from philosophy (particularly ethics), the present study is an attempt to investigate the discrepancy in the findings of the studies addressing error correction in L2 writing instruction, and suggest the (oft-neglected) students’ beliefs, interests and wants as what can point the way out of confusion. To this end, a questionnaire was developed and 56 advanced adult EFL (...) learners were asked to complete the questionnaire. The opinions of 20 EFL teachers were also collected using another questionnaire. Twenty-three of the students and 13 of the teachers were then interviewed in an attempt to collect explanations for their answers in the questionnaires. The results indicated that all the learners wanted the errors in their writings to be corrected. About 90 percent of them believed that all the errors in their writings should be corrected and only less than 10 percent of them agreed that there is no need to correct all the errors and that only “important” errors should be rectified. On the contrary, of the teachers who participated in the study, only 20 percent believed that all the errors in the students’ writings should be corrected. While most of the interviewed students attributed their preference of choice to feeling more confident and efficient in learning when they can recognize all the errors in their written assignments, most of the teachers believed that by correcting important errors (and not all errors), learners can get the most of their writings. Given the incongruity between teachers’ and (advanced) students’ beliefs over writing error correction, and considering advanced students as legitimate decision makers for their own learning, some suggestions are offered for EFL writing teachers. -/- . (shrink)

Rational choice theory analyzes how an agent can rationally act, given his or her preferences, but says little about where those preferences come from. Preferences are usually assumed to be fixed and exogenously given. Building on related work on reasons and rational choice, we describe a framework for conceptualizing preference formation and preference change. In our model, an agent's preferences are based on certain "motivationally salient" properties of the alternatives over which the preferences are held. (...) Preferences may change as new properties of the alternatives become salient or previously salient properties cease to be salient. Our approach captures endogenous preferences in various contexts and helps to illuminate the distinction between formal and substantive concepts of rationality, as well as the role of perception in rational choice. (shrink)

Philosophers have rightly condemned lookism—that is, discrimination in favor of attractive people or against unattractive people—in education, the justice system, the workplace and elsewhere. Surprisingly, however, the almost universal preference for attractive romantic and sexual partners has rarely received serious ethical scrutiny. On its face, it’s unclear whether this is a form of discrimination we should reject or tolerate. I consider arguments for both views. On the one hand, a strong case can be made that preferring attractive partners is bad. (...) The idea is that choosing partners based on looks seems essentially similar to other objectionable forms of discrimination. (In particular, the preference for attractive partners is arguably both unfair and harmful to a significant degree.) One can try to resist this conclusion in several ways. I consider three possible replies. The first has to do with the possibility of controlling our partner preferences. The second pertains to attractiveness and “good genes”. The last attempts to link certain aspects of attractiveness to a prospective partner’s personality and values. I argue that the first two replies fail conclusively, while the third only amounts to a limited defense of a particular kind of attractiveness preference. So the idea that we should often avoid preferring attractive partners is compelling. (shrink)

An important objection to preference-satisfaction theories of well-being is that they cannot make sense of interpersonal comparisons. A tradition dating back to Harsanyi :434, 1953) attempts to solve this problem by appeal to people’s so-called extended preferences. This paper presents a new problem for the extended preferences program, related to Arrow’s celebrated impossibility theorem. We consider three ways in which the extended-preference theorist might avoid this problem, and recommend that she pursue one: developing aggregation rules that violate Arrow’s (...) Independence of Irrelevant Alternatives condition. (shrink)

The Action Theory of Exchanges is based on three main assumptions: i) an exchange is motivated by people having convergent preferences, ii) people exchange actions, and iii) offers and acceptances are crucial parts of an exchange and they bring about rights and obligations. The main aim of this paper is to discuss three aspects of this theory to better understand its ontological implications and, possibly, improve it. I first examine the expression “transferring the ownership” by showing an ontological issue (...) behind it; after that, I propose an interpretation that might solve this issue. I then show that convergent preferences are not enough to motivate an exchange; accordingly, one has to introduce two more preferences possessed by the agents. I finally propose a characterization of buying and selling (and buyer and seller) which, in addition to being compatible with the Action Theory of Exchanges, has the advantage of accounting for both monetary and non-monetary exchanges. (shrink)

More philosophical effort is spent articulating evolutionary rationales for the development of belief-like capacities than for precursors of desires or preferences. Nobody, though, seriously expects naturally evolved minds to be disinterested epistemologists. We agree that world-representing states won’t pay their way without supporting capacities that prioritise from an organism’s available repertoire of activities in light of stored (and occurrent) information. Some concede that desire-like states would be one way of solving this problem. Taking preferences as my starting point (...) instead of belief-like states, I defend two conclusions. First, psychologically real preference states, which approximately token expected utilities, have a quite general evolutionary rationale. They are a solution to the problem of efficiently allocating capacities with incompatible uses. This argument is a version of the Environmental Complexity Thesis. Second, preferences can plausibly function and naturally evolve without belief-like states, even though the converse claim is incredible. Preferences, that is, can mediate between discriminations of occurrent states (‘internal’ or ‘external’) and the processes selecting activity without mediation by stored indicative representations. By tokening expected utilities of actions conditional on discriminated state, they can increase the rate at which the ‘right thing’ is done at appropriate times, and they can do this without the support of belief-like, world-representing states. Preferences, even incomplete and noisy sets of them, are a fuel for success that will tend to be favoured when environments are complex in ways that matter to an organism, and when the organisms have complex behavioural repertoires with heterogenous returns and costs. (shrink)