AI research is being challenged with ensuring that autonomous agents learn to behave ethically, namely in alignment with moral values. Here, we propose a novel way of tackling the value alignment problem as a two-step process. The first step consists on formalising moral values and value aligned behaviour based on philosophical foundations. Our formalisation is compatible with the framework of (Multi-Objective) Reinforcement Learning, to ease the handling of an agent’s individual and ethical objectives. The second step consists in designing an (...) environment wherein an agent learns to behave ethically while pursuing its individual objective. We leverage on our theoretical results to introduce an algorithm that automates our two-step approach. In the cases where value-aligned behaviour is possible, our algorithm produces a learning environment for the agent wherein it will learn a value-aligned behaviour. (shrink)

Whereas geometrical oppositions (logical squares and hexagons) have been so far investigated in many fields of modal logic (both abstract and applied), the oppositional geometrical side of “deontic logic” (the logic of “obligatory”, “forbidden”, “permitted”, . . .) has rather been neglected. Besides the classical “deontic square” (the deontic counterpart of Aristotle’s “logical square”), some interesting attempts have nevertheless been made to deepen the geometrical investigation of the deontic oppositions: Kalinowski (La logique des normes, PUF, Paris, 1972) has proposed a (...) “deontic hexagon” as being the geometrical representation of standard deontic logic, whereas Joerden (jointly with Hruschka, in Archiv für Rechtsund Sozialphilosophie 73:1, 1987), McNamara (Mind 105:419, 1996) and Wessels (Die gute Samariterin. Zur Struktur der Supererogation, Walter de Gruyter, Berlin, 2002) have proposed some new “deontic polygons” for dealing with conservative extensions of standard deontic logic internalising the concept of “supererogation”. Since 2004 a new formal science of the geometrical oppositions inside logic has appeared, that is “ n -opposition theory”, or “NOT”, which relies on the notion of “logical bi-simplex of dimension m ” ( m = n − 1). This theory has received a complete mathematical foundation in 2008, and since then several extensions. In this paper, by using it, we show that in standard deontic logic there are in fact many more oppositional deontic figures than Kalinowski’s unique “hexagon of norms” (more ones, and more complex ones, geometrically speaking: “deontic squares”, “deontic hexagons”, “deontic cubes”, . . ., “deontic tetraicosahedra”, . . .): the real geometry of the oppositions between deontic modalities is composed by the aforementioned structures (squares, hexagons, cubes, . . ., tetraicosahedra and hyper-tetraicosahedra), whose complete mathematical closure happens in fact to be a “deontic 5-dimensional hyper-tetraicosahedron” (an oppositional very regular solid). (shrink)

Continuing prior work by the author, a simple classical system for personal obligation is integrated with a fairly rich system for aretaic (agent-evaluative) appraisal. I then explore various relationships between definable aretaic statuses such as praiseworthiness and blameworthiness and deontic statuses such as obligatoriness and impermissibility. I focus on partitions of the normative statuses generated ("normative positions" but without explicit representation of agency). In addition to being able to model and explore fundamental questions in ethical theory about the connection between (...) blame, praise, permissibility and obligation, this allows me to carefully represent schemes for supererogation and kin. These controversial concepts have provided challenges to both ethical theory and deontic logic, and are among deontic logic's test cases. (shrink)

John Cook Wilson (1849–1915) was Wykeham Professor of Logic at New College, Oxford and the founder of ‘Oxford Realism’, a philosophical movement that flourished at Oxford during the first decades of the 20th century. Although trained as a classicist and a mathematician, his most important contribution was to the theory of knowledge, where he argued that knowledge is factive and not definable in terms of belief, and he criticized ‘hybrid’ and ‘externalist’ accounts. He also argued for direct realism in perception, (...) criticizing both empiricism and idealism, and argued for a moderate nominalist view of universals as being in rebus and only ‘apprehended’ by their particulars. His influence helped swaying Oxford away from idealism and, through figures such as H. A. Prichard, Gilbert Ryle, or J. L. Austin, his ideas were also to some extent at the origin of ‘moral intuitionism’ and ‘ordinary language philosophy’ which defined much of Oxford philosophy until the second half of the twentieth-century. Nevertheless, his name and legacy were all but forgotten for generations after World War II. Still, his views on knowledge are with us today, being in part at work in the writings of philosophers as diverse as John McDowell, Charles Travis, and Timothy Williamson. (shrink)

This paper examines causal theories of reference with respect to how plausible an account they give of non-physical natural kind terms such as ‘gene’ as well as of the truth of the associated theoretical claims. I first show that reference fixism for ‘gene’ fails. By this, I mean the claim that the reference of ‘gene’ was stable over longer historical periods, for example, since the classical period of transmission genetics. Second, I show that the theory of partial reference does not (...) do justice to some widely held realist intuitions about classical genetics. This result is at loggerheads with the explicit goals usually associated with partial theories of reference, which is to defend a realist semantics for scientific terms. Thirdly, I show that, contrary to received wisdom and perhaps contrary to physics and chemistry, neither reference fixism nor partial reference are necessary in order to hold on to scientific realism about biology. I pinpoint the reasons for this in the nature of biological kinds, which do not even remotely resemble natural kinds (i.e., Lockean real essences) as traditionally conceived. (shrink)