The Bayesian maxim for rational learning could be described as conservative change from one probabilistic belief or credence function to another in response to newinformation. Roughly: ‘Hold fixed any credences that are not directly affected by the learning experience.’ This is precisely articulated for the case when we learn that some proposition that we had previously entertained is indeed true (the rule of conditionalisation). But can this conservative-change maxim be extended to revising one’s credences in response to entertaining propositions or (...) concepts of which one was previously unaware? The economists Karni and Vierø (2013, 2015) make a proposal in this spirit. Philosophers have adopted effectively the same rule: revision in response to growing awareness should not affect the relative probabilities of propositions in one’s ‘old’ epistemic state. The rule is compelling, but only under the assumptions that its advocates introduce. It is not a general requirement of rationality, or so we argue. We provide informal counterexamples. And we show that, when awareness grows, the boundary between one’s ‘old’ and ‘new’ epistemic commitments is blurred. Accordingly, there is no general notion of conservative change in this setting. (shrink)

People with the kind of preferences that give rise to the St. Petersburg paradox are problematic---but not because there is anything wrong with infinite utilities. Rather, such people cannot assign the St. Petersburg gamble any value that any kind of outcome could possibly have. Their preferences also violate an infinitary generalization of Savage's Sure Thing Principle, which we call the *Countable Sure Thing Principle*, as well as an infinitary generalization of von Neumann and Morgenstern's Independence axiom, which we call *Countable (...) Independence*. In violating these principles, they display foibles like those of people who deviate from standard expected utility theory in more mundane cases: they choose dominated strategies, pay to avoid information, and reject expert advice. We precisely characterize the preference relations that satisfy Countable Independence in several equivalent ways: a structural constraint on preferences, a representation theorem, and the principle we began with, that every prospect has a value that some outcome could have. (shrink)

Consequentialists often assume rational monism: the thesis that options are always made rationally permissible by the maximization of the selfsame quantity. This essay argues that consequentialists should reject rational monism and instead accept rational pluralism: the thesis that, on different occasions, options are made rationally permissible by the maximization of different quantities. The essay then develops a systematic form of rational pluralism which, unlike its rivals, is capable of handling both the Newcomb problems that challenge evidential decision theory and the (...) unstable problems that challenge causal decision theory. (shrink)

In this paper, I argue for a new normative theory of rational choice under risk, namely expected comparative utility (ECU) theory. I first show that for any choice option, a, and for any state of the world, G, the measure of the choiceworthiness of a in G is the comparative utility (CU) of a in G—that is, the difference in utility, in G, between a and whichever alternative to a carries the greatest utility in G. On the basis of this (...) principle, I then argue that for any agent, S, faced with any decision under risk, S should rank his or her decision options (in terms of how choiceworthy they are) according to their comparative expected comparative utility (CECU) and should choose whichever option carries the greatest CECU. For any option, a, a’s CECU is the difference between its ECU and that of whichever alternative to a carries the greatest ECU, where a’s ECU is a probability‐weighted sum of a’s CUs across the various possible states of the world. I lastly demonstrate that in some ordinary decisions under risk, ECU theory delivers different verdicts from those of standard decision theory. (shrink)

In this paper, I argue for a new normative theory of rational choice under risk, namely expected comparative utility (ECU) theory. I first show that for any choice option, a, and for any state of the world, G, the measure of the choiceworthiness of a in G is the comparative utility (CU) of a in G—that is, the difference in utility, in G, between a and whichever alternative to a carries the greatest utility in G. On the basis of this (...) principle, I then argue that for any agent, S, faced with any decision under risk, S should rank his or her decision options (in terms of how choiceworthy they are) according to their comparative expected comparative utility (CECU) and should choose whichever option carries the greatest CECU. For any option, a, a's CECU is the difference between its ECU and that of whichever alternative to a carries the greatest ECU, where a's ECU is a probability-weighted sum of a's CUs across the various possible states of the world. I lastly demonstrate that in some ordinary decisions under risk, ECU theory delivers different verdicts from those of standard decision theory. (shrink)

The Internet and social media have opened niches for political exploitation of human dispositions to hyper-alarmed states that amplify perceived threats relative to their objective probabilities of occurrence. Researchers should aim to observe the dynamic “ramping up” of security threat mechanisms under controlled experimental conditions. Such research necessarily begins from a clear model of standard baseline states, and should involve adding treatments to established experimental protocols developed by experimental economists. We review these protocols, which allow for joint estimation of risk (...) preferences and subjective beliefs about probabilities and their distributions. Results we have obtained on such estimates, from populations in various countries, are gathered for comparison. Most people show moderate risk aversion in non-alarmed states. We also find universal heterogeneity in risk preference structures, with substantial sub-samples weighting probabilities in such a way as to display “probability pessimism”, while others make risky choices in accordance with expected utility theory. (shrink)

This paper aims to address the question of how one ought to choose when one is uncertain about what outcomes will result from one’s choices, but when one can nevertheless assign probabilities to the different possible outcomes. These choices are commonly referred to as choices (or decisions) under risk. I assume in this paper that one ought to make instrumentally rational choices—more precisely, one ought to adopt suitable means to one’s morally permissible ends. Expected utility (EU) theory is generally accepted (...) as a normative theory of rational choice under risk, or, more specifically, as a theory of instrumental rationality. According to EU theory, when faced with a decision under risk, one ought to rank one’s options (from least to most choiceworthy) according to their EU and one ought to choose whichever option carries the greatest EU (or one of them in the event that several alternatives are tied). The EU of an option is a probability-weighted sum of each of its possible utilities. In this paper, I argue that EU theory is not the correct theory of instrumental rationality. In its place, I argue for a new theory of instrumental rationality, namely expected comparative utility (ECU) theory. I first show that for any choice option, a, and for any state of the world, G, the measure of the choiceworthiness of a in G is the comparative utility of a in G—that is, the difference in utility, in G, between a and whichever alternative to a carries the greatest utility in G. On the basis of this principle, I then argue, roughly speaking, that for any agent, S, faced with any decision under risk, S ought to rank her options (in terms of how choiceworthy they are) according to their ECU and S ought to choose whichever option carries the greatest ECU (or one of them in the event that several alternatives are tied). For any option, a, a’s ECU is a probability‐weighted sum of a’s comparative utilities across the various possible states of the world. In this paper, I show that in some commonplace decisions under risk, ECU theory delivers different verdicts from those of EU theory. (shrink)

There is a widespread view that in order to be rational we must mostly know what we believe. In the probabilistic tradition this is defended by arguments that a person who failed to have this knowledge would be vulnerable to sure loss, or probabilistically incoherent. I argue that even gross failure to know one's own beliefs need not expose one to sure loss, and does not if we follow a generalization of the standard bridge principle between first-order and second-order beliefs. (...) This makes it possible for a subject to use probabilistic decision theory to manage in a rational way cases of potential failure of this self-knowledge, as we find in implicit bias. Through such cases I argue that it is possible for uncertainty about what our beliefs are to be not only rationally permissible but advantageous. (shrink)

According to the orthodox treatment of risk preferences in decision theory, they are to be explained in terms of the agent's desires about concrete outcomes. The orthodoxy has been criticised both for conflating two types of attitudes and for committing agents to attitudes that do not seem rationally required. To avoid these problems, it has been suggested that an agent's attitudes to risk should be captured by a risk function that is independent of her utility and probability functions. The main (...) problem with that approach is that it suggests that attitudes to risk are wholly distinct from people's (non-instrumental) desires. To overcome this problem, we develop a framework where an agent's utility function is defined over chance propositions (i.e., propositions describing objective probability distributions) as well as ordinary (non-chance) ones, and argue that one should explain different risk attitudes in terms of different forms of the utility function over such propositions. (shrink)

We argue that all comparative expressions in natural language obey a principle that we call Comparability: if x and y are at least as F as themselves, then either x is at least as F as y or y is at least as F as x. This principle has been widely rejected among philosophers, especially by ethicists, and its falsity has been claimed to have important normative implications. We argue that Comparability is needed to explain the goodness of several patterns (...) of inference that seem manifestly valid, that the purported failures of Comparability would have absurd consequences, and that the influential arguments against Comparability are less compelling than they may have initially seemed. (shrink)

This book concerns the foundations of epistemic modality and hyperintensionality and their applications to the philosophy of mathematics. I examine the nature of epistemic modality, when the modal operator is interpreted as concerning both apriority and conceivability, as well as states of knowledge and belief. The book demonstrates how epistemic modality and hyperintensionality relate to the computational theory of mind; metaphysical modality and hyperintensionality; the types of mathematical modality and hyperintensionality; to the epistemic status of large cardinal axioms, undecidable propositions, (...) and abstraction principles in the philosophy of mathematics; to the modal and hyperintensional profiles of the logic of rational intuition; and to the types of intention, when the latter is interpreted as a hyperintensional mental state. Chapter \textbf{2} argues for a novel type of expressivism based on the duality between the categories of coalgebras and algebras, and argues that the duality permits of the reconciliation between modal cognitivism and modal expressivism. I also develop a novel topic-sensitive truthmaker semantics for dynamic epistemic logic, and develop a novel dynamic two-dimensional semantics. Chapter \textbf{3} provides an abstraction principle for epistemic (hyper-)intensions. Chapter \textbf{4} advances a topic-sensitive two-dimensional truthmaker semantics, and provides three novel interpretations of the framework along with the epistemic and metasemantic. Chapter \textbf{5} applies the fixed points of the modal $\mu$-calculus in order to account for the iteration of epistemic states in a single agent, by contrast to availing of modal axiom 4 (i.e. the KK principle). The fixed point operators in the modal $\mu$-calculus are rendered hyperintensional, which yields the first hyperintensional construal of the modal $\mu$-calculus in the literature and the first application of the calculus to the iteration of epistemic states in a single agent instead of the common knowledge of a group of agents. Chapter \textbf{6} advances a solution to the Julius Caesar problem based on Fine's `criterial' identity conditions which incorporate conditions on essentiality and grounding. Chapter \textbf{7} provides a ground-theoretic regimentation of the proposals in the metaphysics of consciousness and examines its bearing on the two-dimensional conceivability argument against physicalism. The topic-sensitive epistemic two-dimensional truthmaker semantics developed in chapters \textbf{2} and \textbf{4} are availed of in order for epistemic states to be a guide to metaphysical states in the hyperintensional setting. -/- Chapters \textbf{8-12} provide cases demonstrating how the two-dimensional hyperintensions of hyperintensional, i.e. topic-sensitive epistemic two-dimensional truthmaker, semantics, solve the access problem in the epistemology of mathematics. Chapter \textbf{8} examines the interaction between my hyperintensional semantics and the axioms of epistemic set theory, large cardinal axioms, the Epistemic Church-Turing Thesis, the modal axioms governing the modal profile of $\Omega$-logic, Orey sentences such as the Generalized Continuum Hypothesis, and absolute decidability. These results yield inter alia the first hyperintensional Epistemic Church-Turing Thesis and hyperintensional epistemic set theories in the literature. Chapter \textbf{9} examines the modal and hyperintensional commitments of abstractionism, in particular necessitism, and epistemic hyperintensionality, epistemic utility theory, and the epistemology of abstraction. I countenance a hyperintensional semantics for novel epistemic abstractionist modalities. I suggest, too, that observational type theory can be applied to first-order abstraction principles in order to make first-order abstraction principles recursively enumerable, i.e. Turing machine computable, and that the truth of the first-order abstraction principle for hyperintensions is grounded in its being possibly recursively enumerable and the machine being physically implementable. Chapter \textbf{10} examines the philosophical significance of hyperintensional $\Omega$-logic in set theory and discusses the hyperintensionality of metamathematics. Chapter \textbf{11} provides a modal logic for rational intuition and provides a hyperintensional semantics. Chapter \textbf{12} avails of modal coalgebras to interpret the defining properties of indefinite extensibility, and avails of hyperintensional epistemic two-dimensional semantics in order to account for the interaction between the interpretational and objective modalities and truthmakers thereof. This yields the first hyperintensional category theory in the literature. I invent a new mathematical trick in which first order structures are treated as categories, and Vopenka's principle can be satisfied because of the elementary embeddings between the categories and generate Vopenka cardinals while bypassing the category of Set in category theory. Chapter \textbf{13} examines modal responses to the alethic paradoxes. Chapter \textbf{14} examines, finally, the modal and hyperintensional semantics for the different types of intention and the relation of the latter to evidential decision theory. (shrink)

According to certain normative theories in epistemology, rationality requires us to be logically omniscient. Yet this prescription clashes with our ordinary judgments of rationality. How should we resolve this tension? In this paper, I focus particularly on the logical omniscience requirement in Bayesian epistemology. Building on a key insight by Hacking :311–325, 1967), I develop a version of Bayesianism that permits logical ignorance. This includes: an account of the synchronic norms that govern a logically ignorant individual at any given time; (...) an account of how we reduce our logical ignorance by learning logical facts and how we should update our credences in response to such evidence; and an account of when logical ignorance is irrational and when it isn’t. At the end, I explain why the requirement of logical omniscience remains true of ideal agents with no computational, processing, or storage limitations. (shrink)

In Richard Bradley’s book, Decision Theory with a Human Face, we have selected two themes for discussion. The first is the Bolker-Jeffrey theory of decision, which the book uses throughout as a tool to reorganize the whole field of decision theory, and in particular to evaluate the extent to which expected utility theories may be normatively too demanding. The second theme is the redefinition strategy that can be used to defend EU theories against the Allais and Ellsberg paradoxes, a strategy (...) that the book by and large endorses, and even develops in an original way concerning the Ellsberg paradox. We argue that the BJ theory is too specific to fulfil Bradley’s foundational project and that the redefinition strategy fails in both the Allais and Ellsberg cases. Although we share Bradley’s conclusion that EU theories do not state universal rationality requirements, we reach it not by a comparison with BJ theory, but by a comparison with the non-EU theories that the paradoxes have heuristically suggested. (shrink)

The problem of how to rationally aggregate probability measures occurs in particular when a group of agents, each holding probabilistic beliefs, needs to rationalise a collective decision on the basis of a single ‘aggregate belief system’ and when an individual whose belief system is compatible with several probability measures wishes to evaluate her options on the basis of a single aggregate prior via classical expected utility theory. We investigate this problem by first recalling some negative results from preference and judgment (...) aggregation theory which show that the aggregate of several probability measures should not be conceived as the probability measure induced by the aggregate of the corresponding expected utility preferences. We describe how McConway’s :410–414, 1981) theory of probabilistic opinion pooling can be generalised to cover the case of the aggregation of infinite profiles of finitely additive probability measures, too; we prove the existence of aggregation functionals satisfying responsiveness axioms à la McConway plus additional desiderata even for infinite electorates. On the basis of the theory of propositional-attitude aggregation, we argue that this is the most natural aggregation theory for probability measures. Our aggregation functionals for the case of infinite electorates are neither oligarchic nor integral-based and satisfy a weak anonymity condition. The delicate set-theoretic status of integral-based aggregation functionals for infinite electorates is discussed. (shrink)

We prove a representation theorem for preference relations over countably infinite lotteries that satisfy a generalized form of the Independence axiom, without assuming Continuity. The representing space consists of lexicographically ordered transfinite sequences of bounded real numbers. This result is generalized to preference orders on abstract superconvex spaces.

Predictable polarization is everywhere: we can often predict how people’s opinions, including our own, will shift over time. Extant theories either neglect the fact that we can predict our own polarization, or explain it through irrational mechanisms. They needn’t. Empirical studies suggest that polarization is predictable when evidence is ambiguous, that is, when the rational response is not obvious. I show how Bayesians should model such ambiguity and then prove that—assuming rational updates are those which obey the value of evidence—ambiguity (...) is necessary and sufficient for the rationality of predictable polarization. The main theoretical result is that there can be a series of such updates, each of which is individually expected to make you more accurate, but which together will predictably polarize you. Polarization results from asymmetric increases in accuracy. This mechanism is not only theoretically possible, but empirically plausible. I argue that cognitive search—searching a cognitively accessible space for a particular item—often yields asymmetrically ambiguous evidence, I present an experiment supporting its polarizing effects, and I use simulations to show how it can explain two of the core causes of polarization: confirmation bias and the group polarization effect. (shrink)

Population axiology concerns how to evaluate populations in terms of their moral goodness, that is, how to order populations by the relations “is better than” and “is as good as”. The task has been to find an adequate theory about the moral value of states of affairs where the number of people, the quality of their lives, and their identities may vary. So far, this field has largely ignored issues about uncertainty and the conditions that have been discussed mostly pertain (...) to the ranking of risk-free outcomes. Most public policy choices, however, are decisions under uncertainty, including policy choices that affect the size of a population. Here, we shall address the question of how to rank population prospects—that is, alternatives that contain uncertainty as to which population they will bring about—by the relations “is better than” and “is as good as”. We start by illustrating how well-known population axiologies can be extended to population prospect axiologies. And we show that new problems arise when extending population axiologies to prospects. In particular, traditional population axiologies lead to prospect-versions of the problems that they praised for avoiding in the risk-free settings. Finally, we identify an intuitive adequacy condition that, we contend, should be satisfied by any population prospect axiology, and show how given this condition, the impossibility theorems in population axiology can be extended to (non-trivial) impossibility theorems for population prospect axiology. (shrink)

A growing number of decision theorists have, in recent years, defended the view that rationality is permissive under risk: Different rational agents may be more or less risk-averse or risk-inclined. This can result in them making different choices under risk even if they value outcomes in exactly the same way. One pressing question that arises once we grant such permissiveness is what attitude to risk we should implement when choosing on behalf of other people. Are we permitted to implement any (...) of the rationally permissible risk attitudes, is there some specific risk attitude that is required when choosing for others, or are we required to defer to the risk attitudes of the people on whose behalf we are choosing? This article elaborates on this question, explains its wider practical and theoretical significance, provides an overview of existing answers, and explores how to go about providing a more systematic account of how to choose on behalf of others in risky contexts. (shrink)

We investigate the conflict between the ex ante and ex post criteria of social welfare in a new framework of individual and social decisions, which distinguishes between two sources of uncertainty, here interpreted as an objective and a subjective source respectively. This framework makes it possible to endow the individuals and society not only with ex ante and ex post preferences, as is usually done, but also with interim preferences of two kinds, and correspondingly, to introduce interim forms of the (...) Pareto principle. After characterizing the ex ante and ex post criteria, we present a first solution to their conflict that extends the former as much possible in the direction of the latter. Then, we present a second solution, which goes in the opposite direction, and is also maximally assertive. Both solutions translate the assumed Pareto conditions into weighted additive utility representations, and both attribute to the individuals common probability values on the objective source of uncertainty, and different probability values on the subjective source. We discuss these solutions in terms of two conceptual arguments, i.e., the by now classic spurious unanimity argument and a novel informational argument labelled complementary ignorance. The paper complies with the standard economic methodology of basing probability and utility representations on preference axioms, but for the sake of completeness, also considers a construal of objective uncertainty based on the assumption of an exogeneously given probability measure. JEL classification: D70; D81. (shrink)

As stochastic independence is essential to the mathematical development of probability theory, it seems that any foundational work on probability should be able to account for this property. Bayesian decision theory appears to be wanting in this respect. Savage’s postulates on preferences under uncertainty entail a subjective expected utility representation, and this asserts only the existence and uniqueness of a subjective probability measure, regardless of its properties. What is missing is a preference condition corresponding to stochastic independence. To fill this (...) significant gap, the article axiomatizes Bayesian decision theory afresh and proves several representation theorems in this novel framework. (shrink)

Conditionalization is one of the central norms of Bayesian epistemology. But there are a number of competing formulations, and a number of arguments that purport to establish it. In this paper, I explore which formulations of the norm are supported by which arguments. In their standard formulations, each of the arguments I consider here depends on the same assumption, which I call Deterministic Updating. I will investigate whether it is possible to amend these arguments so that they no longer depend (...) on it. As I show, whether this is possible depends on the formulation of the norm under consideration. (shrink)

Representation theorems are often taken to provide the foundations for decision theory. First, they are taken to characterize degrees of belief and utilities. Second, they are taken to justify two fundamental rules of rationality: that we should have probabilistic degrees of belief and that we should act as expected utility maximizers. We argue that representation theorems cannot serve either of these foundational purposes, and that recent attempts to defend the foundational importance of representation theorems are unsuccessful. As a result, we (...) should reject these claims, and lay the foundations of decision theory on firmer ground. (shrink)

There are two central questions concerning probability. First, what are its formal features? That is a mathematical question, to which there is a standard, widely (though not universally) agreed upon answer. This answer is reviewed in the next section. Second, what sorts of things are probabilities---what, that is, is the subject matter of probability theory? This is a philosophical question, and while the mathematical theory of probability certainly bears on it, the answer must come from elsewhere. To see why, observe (...) that there are many things in the world that have the mathematical structure of probabilities---the set of measurable regions on the surface of a table, for example---but that one would never mistake for being probabilities. So probability is distinguished by more than just its formal characteristics. The bulk of this essay will be taken up with the central question of what this “more” might be. (shrink)

This paper deals with causal analysis in the social sciences. We first present a conceptual framework according to which causal analysis is based on a rationale of variation and invariance, and not only on regularity. We then develop a formal framework for causal analysis by means of structural modelling. Within this framework we approach causality in terms of exogeneity in a structural conditional model based which is based on (i) congruence with background knowledge, (ii) invariance under a large variety of (...) environmental changes, and (iii) model fit. We also tackle the issue of confounding and show how latent confounders can play havoc with exogeneity. This framework avoids making untestable metaphysical claims about causal relations and yet remains useful for cognitive and action-oriented goals. (shrink)

This paper aims to provide hyperintensional foundations for mathematical platonism. I examine Hale and Wright's (2009) objections to the merits and need, in the defense of mathematical platonism and its epistemology, of the thesis of Necessitism. In response to Hale and Wright's objections to the role of epistemic and metaphysical modalities in providing justification for both the truth of abstraction principles and the success of mathematical predicate reference, I examine the Necessitist commitments of the abundant conception of properties endorsed by (...) Hale and Wright and examined in Hale (2013), and demonstrate how a two-dimensional approach to the epistemology of mathematics is consistent with Hale and Wright's notion of there being non-evidential epistemic entitlement rationally to trust that abstraction principles are true. A choice point that I flag is that between availing of intensional or hyperintensional semantics. The hyperintensional semantic approach that I advance is a topic-sensitive epistemic two-dimensional truthmaker semantics. I countenance a hyperintensional semantics for novel epistemic abstractionist modalities. I suggest that observational type theory can be applied to first-order abstraction principles in order to make abstraction principles recursively enumerable. Epistemic and metaphysical states and possibilities may thus be shown to play a constitutive role in vindicating the reality of mathematical objects and truth, and in providing a conceivability-based route to the truth of abstraction principles as well as other axioms and propositions in mathematics. (shrink)

Pascal’s Wager involves expected utilities. In this chapter, we examine the Wager in light of two main features of expected utility theory: utilities and probabilities. We discuss infinite and finite utilities, and zero, infinitesimal, extremely low, imprecise, and undefined probabilities. These have all come up in recent literature regarding Pascal’s Wager. We consider the problems each creates and suggest prospects for the Wager in light of these problems.

This paper argues that the types of intention can be modeled both as modal operators and via a multi-hyperintensional semantics. I delineate the semantic profiles of the types of intention, and provide a precise account of how the types of intention are unified in virtue of both their operations in a single, encompassing, epistemic space, and their role in practical reasoning. I endeavor to provide reasons adducing against the proposal that the types of intention are reducible to the mental states (...) of belief and desire, where the former state is codified by subjective probability measures and the latter is codified by a utility function. I argue, instead, that each of the types of intention -- i.e., intention-in-action, intention-as-explanation, and intention-for-the-future -- has as its aim the value of an outcome of the agent's action, as derived by her partial beliefs and assignments of utility, and as codified by the value of expected utility in evidential decision theory. (shrink)

The desirability of what actually occurs is often influenced by what could have been. Preferences based on such value dependencies between actual and counterfactual outcomes generate a class of problems for orthodox decision theory, the best-known perhaps being the so-called Allais Paradox. In this paper we solve these problems by extending Richard Jeffrey's decision theory to counterfactual prospects, using a multidimensional possible-world semantics for conditionals, and showing that preferences that are sensitive to counterfactual considerations can still be desirability maximising. We (...) end the paper by investigating the conditions necessary and sufficient for a desirability function to be an expected utility. It turns out that the additional conditions imply highly implausible epistemic principles. (shrink)

Chance Neutrality is the thesis that, conditional on some proposition being true, its chance of being true should be a matter of practical indifference. The aim of this article is to examine whether Chance Neutrality is a requirement of rationality. We prove that given Chance Neutrality, the Principal Principle entails a thesis called Linearity; the centerpiece of von Neumann and Morgenstern’s expected utility theory. With this in mind, we argue that the Principal Principle is a requirement of practical rationality but (...) that Linearity is not and, hence, that Chance Neutrality is not rationally required. (shrink)

We argue that two long-term goals of AI research stand in tension with one another. The first involves creating AI that is safe, where this is understood as solving the problem of value alignment. The second involves creating artificial general intelligence, meaning AI that operates at or beyond human capacity across all or many intellectual domains. Our argument focuses on the human capacity to make what we call “existential choices”, choices that transform who we are as persons, including transforming what (...) we most deeply value or desire. It is a capacity for a kind of value misalignment, in that the values held prior to making such choices can be significantly different from (misaligned with) the values held after making them. Because of the connection to existentialist philosophers who highlight these choices, we call the resulting form of risk “existentialist risk.” It is, roughly, the risk that results from AI taking an active role in authoring its own values rather than passively going along with the values given to it. On our view, human-like intelligence requires a human-like capacity for value misalignment, which is in tension with the possibility of guaranteeing value alignment between AI and humans. (shrink)

Various theories try to give accounts of how measures of this confidence do or ought to behave, both as far as the internal mental consistency of the agent as ...

Our decision-theoretic states are not luminous. We are imperfectly reliable at identifying our own credences, utilities and available acts, and thus can never be more than imperfectly reliable at identifying the prescriptions of decision theory. The lack of luminosity affords decision theory a remarkable opportunity — to issue guidance on the basis of epistemically inaccessible facts. We show how a decision theory can guarantee action in accordance with contingent truths about which an agent is arbitrarily uncertain. It may seem that (...) such advantages would require dubiously adverting to externalist facts that go beyond the internalism of traditional decision theory, but this is not so. Using only the standard repertoire of decision-theoretic tools, we show how to modify existing decision theories to take advantage of this opportunity. These improved decision theories require agents to maximize conditional expected utility — expected utility conditional upon an agent’s actual decision situation. We call such modified decision theories ‘self-confident’. These self-confident decision theories have a distinct advantage over standard decision theories: their prescriptions are better. (shrink)

Even though Patrick Suppes made important contributions to utility theory, his final views on economic choice are quite critical of the expected-utility theories of rational choice. The aim of the present paper is to expose in a unified way his final views on economic choice and freedom. These views are part of his conception of causality and rationality.

Evolutionary reliabilism is the view that natural selection likely favoured reliable cognitive faculties in humans. While ER enjoys some plausibility, Stephen Stich and Alvin Plantinga have presented well-known challenges to the view. Their arguments rely on a common premiss; namely, that natural selection is indifferent to truth. This article shows that this premiss is both imprecise and too weak to support their conclusions and, therefore, that their challenges to ER fail.

In this paper, we defend two claims. First, we argue that a notion of contextuality that has been formalized in physics and psychology is applicable to linguistic contexts. Second, we propose that this formal apparatus is philosophically significant for the epistemology of language because it imposes homogeneous rational constraints on speakers. We propose a Contextuality Principle that explains and articulates these two claims. This principle states that speakers update contextual information by significantly reducing the space of probabilities and variables in (...) a non-commutative way. Some contexts affect other contexts not merely in terms of the information they contain, but also on the basis of their sequential order. In particular, we argue that the Contextuality by Default theory provides a formalism that helps explain the role of contextuality in rational linguistic exchanges. (shrink)

In developing the basis on which climate change should be priced, I do five things. First, I review the ethical foundations for valuing future consumption relative to present consumption (i.e. social discount rates). Second, I report that the criterion for both assessing and prescribing economic policies should not be an economy's GDP, but an inclusive measure of an economy's wealth adjusted for the distribution of wealth. Third, I apply the resulting analysis to the problem of pricing carbon concentration in the (...) atmosphere. I give prominence to future uncertainties. Fourth, I show that the existing models of human behaviour on the basis of which these questions have been analysed by economists have serious deficiencies, in as much as the idea of personhood embodied in them has been built on the psychology of confirmed egotists. Fifth, I sketch the motivations of a social being and show how the altered specification of the human person affects the social price of climate change. (shrink)

In this article, Savage’s theory of decision-making under uncertainty is extended from a classical environment into a non-classical one. The Boolean lattice of events is replaced by an arbitrary ortho-complemented poset. We formulate the corresponding axioms and provide representation theorems for qualitative measures and expected utility. Then, we discuss the issue of beliefs updating and investigate a transition probability model. An application to a simple game context is proposed.

Quantum cognition in decision making is a recent and rapidly growing field. In this paper, we develop an expected utility theory in a context of non-classical uncertainty. We replace the classical state space with a Hilbert space which allows introducing the concept of quantum lottery. Within that framework, we formulate axioms on preferences over quantum lotteries to establish a representation theorem. We show that demanding the consistency of choice behavior conditional on new information is equivalent to the von Neumann–Lüders postulate (...) applied to beliefs. A dynamically consistent quantum-like agent may violate dynamic recursive consistency, however. This feature suggests interesting applications in behavioral economics as we illustrate in an example of persuasion. (shrink)

The results generated by experimentalists in psychology and economics haveled to numerous advances in the study of human decision making under risk.Camerer (1995) and Rabin (1998) provide excellent reviews of the relevantliterature. These results clearly display the gap between normative theoriesof ideal behavior and descriptive theories of observed behavior. The mostprominent result is loss aversion – the observation that a loss is given greatervalue than a gain of an equal size – and the resulting S-shaped utility function.Rabin puts the key (...) point as follows: ``Researchers have identified a pervasive feature of reference dependence: In a wide variety of domains, people are significantly more averse to losses than they are attracted to same size gains''(Rabin 1998, 13–14). In what follows, I will show that the ``wide variety of domains'' is wide indeed. In particular, I will review the effects of the S-shaped utility function on the resolution of the decision to commit a crime, to decision to violate professional ethics, and the decision to participate in a rebellion. (shrink)

This paper presents a theory of conclusions based upon the suggestions of Tukey [21]. The logic offered here is based upon two rules of detachment that occur naturally in probabilistic inference, a traditional rule of acceptance, and a rule of rejection. The rules of detachment provide flexibility: the theory of conclusions can account for both statistical and deductive arguments. The rule of acceptance governs the acceptance of new conclusions, is a variant of the rule of high probability, and is a (...) limiting case of a decision-theoretic rule of acceptance. The rule of rejection governs the removal of previously accepted conclusions on the basis of new evidence. The resulting theory of conclusions is not a decision-theoretic logic but does, through the aforementioned limiting property, provide a line of demarcation between decision and conclusion (i.e., nondecision) logics of acceptance. The theory of conclusions therefore complements decision-theoretic inference. The theory of conclusions presented here satisfies Tukey's desiderata, specifically: (1) conclusions are statements which are accepted on the basis of unusually strong evidence; (2) conclusions are to remain accepted unless and until unusually strong evidence to the contrary arises; (3) conclusions are subject to future rejection, when and if the evidence against them becomes strong enough. Finally, the proferred theory of conclusions has a strong conservative bias, reflecting Tukey's aims. (shrink)

Although it may seem from its formalism that game theory must have sprung from the mind of John von Neumann as a corollary of his work on computers or theoretical physics, it should come as no real surprise to philosophers that game theory is the articulation of a historically developing philosophical conception of rationality in thought and action. The history of ideas about rationality is deeply contradictory at many turns. While there are theories of rationality that claim it is fundamentally (...) social and aims at understanding and molding all facets of human psychological life, game theory takes rationality to be essentially located in individuals and to concern only the means to achieve predetermined ends. Thus, there are some thinkers who have made important contributions to this history who do not appear in the story of game theory at all, among them, Plato, Kant, and Hegel. There is, however, a clear trail to follow linking theories of instrumental rationality from Aristotle to the nineteenth-century marginalist economists and ultimately to von Neumann and Morgenstern and contemporary game theorists, that historically grounds game theory as a model of rational interaction. (shrink)

Searching for information is critical in many situations. In medicine, for instance, careful choice of a diagnostic test can help narrow down the range of plausible diseases that the patient might have. In a probabilistic framework, test selection is often modeled by assuming that people's goal is to reduce uncertainty about possible states of the world. In cognitive science, psychology, and medical decision making, Shannon entropy is the most prominent and most widely used model to formalize probabilistic uncertainty and the (...) reduction thereof. However, a variety of alternative entropy metrics (Hartley, Quadratic, Tsallis, Rényi, and more) are popular in the social and the natural sciences, computer science, and philosophy of science. Particular entropy measures have been predominant in particular research areas, and it is often an open issue whether these divergences emerge from different theoretical and practical goals or are merely due to historical accident. Cutting across disciplinary boundaries, we show that several entropy and entropy reduction measures arise as special cases in a unified formalism, the Sharma–Mittal framework. Using mathematical results, computer simulations, and analyses of published behavioral data, we discuss four key questions: How do various entropy models relate to each other? What insights can be obtained by considering diverse entropy models within a unified framework? What is the psychological plausibility of different entropy models? What new questions and insights for research on human information acquisition follow? Our work provides several new pathways for theoretical and empirical research, reconciling apparently conflicting approaches and empirical findings within a comprehensive and unified information-theoretic formalism. (shrink)

In the 1940s and 1950s thousands of lobotomies were performed on people with mental disorders. These operations were known to be dangerous, but thought to offer great hope. Nowadays, the lobotomies of the 1940s and 1950s are widely condemned. The consensus is that the practitioners who employed them were, at best, misguided enthusiasts, or, at worst, evil. In this paper I employ standard decision theory to understand and assess shifts in the evaluation of lobotomy. Textbooks of medical decision making generally (...) recommend that decisions under risk are made so as to maximise expected utility (MEU) I show that using this procedure suggests that the 1940s and 1950s practice of psychosurgery was justifiable. In making sense of this finding we have a choice: Either we can accept that psychosurgery was justified, in which case condemnation of the lobotomists is misplaced. Or, we can conclude that the use of formal decision procedures, such as MEU, is problematic. (shrink)

A fundamental philosophical question that arises in connection with evolutionary theory is whether the fittest patterns of behavior are always the most rational. Are fitness and rationality fully compatible? When behavioral rationality is characterized formally as in classical decision theory, the question becomes mathematically meaningful and can be explored systematically by investigating whether the optimally fit behavior predicted by evolutionary process models is decision-theoretically coherent. Upon investigation, it appears that in nontrivial evolutionary models the expected behavior is not always in (...) accord with the norms of the standard theory of decision as ordinarily applied. Many classically irrational acts, e.g. betting on the occurrence of one event in the knowledge that the probabilities favor another, can under certain circumstances constitute adaptive behavior.One interesting interpretation of this clash is that the criterion of rationality offered by classical decision theory is simply incorrect (or at least incomplete) as it stands, and that evolutionary theory should be called upon to provide a more generally applicable theory of rationality. Such a program, should it prove feasible, would amount to the logical reduction of the theory of rational choice to evolutionary theory. (shrink)

Philosophy and Phenomenological Research, EarlyView.