We present a framework for epistemic logic, modeling the logical aspects of System 1 and System 2 cognitive processes, as per dual process theories of reasoning. The framework combines non-normal worlds semantics with the techniques of Dynamic Epistemic Logic. It models non-logically-omniscient, but moderately rational agents: their System 1 makes fast sense of incoming information by integrating it on the basis of their background knowledge and beliefs. Their System 2 allows them to slowly, step-wise unpack some of the logical consequences (...) of such knowledge and beliefs, by paying a cognitive cost. The framework is applied to three instances of limited rationality, widely discussed in cognitive psychology: Stereotypical Thinking, the Framing Effect, and the Anchoring Effect. (shrink)

This article proposes a systematic application of recent developments in the logic of preference to a number of topics in deontic logic. The key junction is the well‐known Hansson conditional for dyadic obligations. These conditionals are generalized by pairing them with reasoning about syntactic priority structures. The resulting two‐level approach to obligations is tested first against standard scenarios of contrary‐to‐duty obligations, leading also to a generalization for the Kanger‐Anderson reduction of deontic logic. Next, the priority framework is applied to model (...) two intuitively different sorts of deontic dynamics of obligations, based on information changes and on genuine normative events. In this two‐level setting, we also offer novel takes on vexed issues such as the Chisholm paradox and modelling strong permission. Finally, the priority framework is shown to provide a unifying setting for the study of operations on norms as such, in particular, adding or deleting individual norms, and even merging whole norm systems in different manners. (shrink)

People reason not only in beliefs, but also in intentions, preferences, and other attitudes. They form preferences from existing preferences, or intentions from existing beliefs and intentions, and so on. This often involves choosing between rival conclusions. Building on Broome (Rationality through reasoning, Hoboken, Wiley. https://doi.org/10.1002/9781118609088, 2013) and Dietrich et al. (J Philos 116:585–614. https://doi.org/10.5840/jphil20191161138, 2019), we present a philosophical and formal analysis of reasoning in attitudes, with or without facing choices in reasoning. We give different accounts of choosing, in (...) terms of a conscious activity or a partly subconscious process. Reasoning in attitudes differs fundamentally from reasoning _about_ attitudes, a form of theoretical reasoning in which one discovers rather than forms attitudes. We show that reasoning in attitudes has standard formal properties (such as monotonicity), but is indeterministic, reflecting choice in reasoning. Like theoretical reasoning, it need not follow logical entailment, but for a more radical reason, namely indeterminism. This makes reasoning in attitudes harder to model logically than theoretical reasoning. But it can be studied abstractly, using indeterministic consequence operators. (shrink)

This article proposes a systematic application of recent developments in the logic of preference to a number of topics in deontic logic. The key junction is the well-known Hansson conditional for dyadic obligations. These conditionals are generalized by pairing them with reasoning about syntactic priority structures. The resulting two-level approach to obligations is tested first against standard scenarios of contrary-to-duty obligations, leading also to a generalization for the Kanger-Anderson reduction of deontic logic. Next, the priority framework is applied to model (...) two intuitively different sorts of deontic dynamics of obligations, based on information changes and on genuine normative events. In this two-level setting, we also offer novel takes on vexed issues such as the Chisholm paradox and modelling strong permission. Finally, the priority framework is shown to provide a unifying setting for the study of operations on norms as such, in particular, adding or deleting individual norms, and even merging whole norm systems in different manners. (shrink)

The ambition of the paper is to provide a solution to the problem posed by Von Wright (1999): how is it possible that the two actions, one of producing P and the other of preventing P can have different deontic status, the former being obligatory and the latter being forbidden. The solution for the problem is sought for by an investigation into connections between imperative and deontic logic. First, it is asked whether a solution could be found in Lemmon's (1965) (...) system of "change logic", using his idea on connection between logic of orders being in force and deontic logic. The answer is the negative one. Next, the connection between Lemmon's imperative logic and deontic logic given in Aqvist's paper - "Next" and "Ought" (1965) - is analyzed. Than, the Lemmon's treatment of imperatives is restricted to the natural language imperatives and Aqvist's way of connecting imperative and deontic logic is modified accordingly. Some principles for the natural language imperatives are established (the negation rule ; the law of contraposition for imperative conditionals) and a simple "global" semantics is developed. The notion of "opposite action" is introduced and it is given an important role in semantics. Finally, a solution for von Wright's problem is given. In the closing sections some further topics for investigation are hinted: one of them being the connection between Aqvist's epistemic- imperative conception of interrogatives and "epistemic obligations", the other being formalization of the idea that imperatives create and re-create obligation patterns that can be described in deontic terms. (shrink)

This is the second paper in a two-part series introducing logics for reasoning about the dynamics of knowledge and beliefs. Part I introduced different logical systems that can be used to reason about the knowledge and beliefs of a group of agents. In this second paper, I show how to adapt these logical systems to reason about the knowledge and beliefs of a group of agents during the course of a social interaction or rational inquiry. Inference, communication and observation are (...) typical examples of informative events, which have been subjected to a logical analysis. The main goal of this article is to introduce the key conceptual and technical issues that drive much of the research in this area. (shrink)

The dominant practice of AI alignment assumes (1) that preferences are an adequate representation of human values, (2) that human rationality can be understood in terms of maximizing the satisfaction of preferences, and (3) that AI systems should be aligned with the preferences of one or more humans to ensure that they behave safely and in accordance with our values. Whether implicitly followed or explicitly endorsed, these commitments constitute what we term apreferentistapproach to AI alignment. In this paper, we characterize (...) and challenge the preferentist approach, describing conceptual and technical alternatives that are ripe for further research. We first survey the limits of rational choice theory as a descriptive model, explaining how preferences fail to capture the thick semantic content of human values, and how utility representations neglect the possible incommensurability of those values. We then critique the normativity of expected utility theory (EUT) for humans and AI, drawing upon arguments showing how rational agents need not comply with EUT, while highlighting how EUT is silent on which preferences are normatively acceptable. Finally, we argue that these limitations motivate a reframing of the targets of AI alignment: Instead of alignment with the preferences of a human user, developer, or humanity-writ-large, AI systems should be aligned with normative standards appropriate to their social roles, such as the role of a general-purpose assistant. Furthermore, these standards should be negotiated and agreed upon by all relevant stakeholders. On this alternative conception of alignment, a multiplicity of AI systems will be able to serve diverse ends, aligned with normative standards that promote mutual benefit and limit harm despite our plural and divergent values. (shrink)

Most models of rational action assume that all possible states and actions are pre-defined and that preferences change only when beliefs do. But several decision and game problems lack these features, calling for a dynamic model of preferences: preferences can change when unforeseen possibilities come to light or when there is no specifiable or measurable change in belief. We propose a formally precise dynamic model of preferences that extends an existing static model. Our axioms for updating preferences preserve consistency while (...) minimising change, like Hansson’s :1–28, 1995). But unlike prior models of preference change, ours supports default reasoning with partial preference information, which is essential to handle decision problems where the decision tree isn’t surveyable. We also show that our model avoids problems for other models of preference change discussed in Spohn. (shrink)

This paper presents a logic of preference and functional dependence (LPFD) and its hybrid extension (HLPFD), both of whose sound and strongly complete axiomatization are provided. The decidability of LPFD is also proved. The application of LPFD and HLPFD to modelling cooperative games in strategic form is explored. The resulted framework provides a unified view on Nash equilibrium, Pareto optimality and the core. The philosophical relevance of these game-theoretical notions to discussions of collective agency is made explicit. Some key connections (...) with other logics are also revealed, for example, the coalition logic, the logic of functional dependence and the logic of ceteris paribus preference. (shrink)

The present contribution shows that a Hilbert-style axiomatization for dynamic logic of relation changers is complete for the standard Kripke semantics not by a well-known rewriting technique but by the idea of an auxiliary semantics studied by van Benthem and Wang et al. A key insight of our auxiliary semantics for dynamic logic of relation changers can be described as: “relation changers are bounded morphisms.” Moreover, we demonstrate that this semantic insight can be used to provide a modular cut-free labelled (...) sequent calculus for the logic in the sense that our calculus can be regarded as a natural expansion of a labelled sequent calculus of iteration-free propositional dynamic logic. (shrink)