As our epistemic ambitions grow, the common and scientific endeavours are becoming increasingly dependent on Machine Learning (ML). The field rests on a single experimental paradigm, which consists of splitting the available data into a training and testing set and using the latter to measure how well the trained ML model generalises to unseen samples. If the model reaches acceptable accuracy, an a posteriori contract comes into effect between humans and the model, supposedly allowing its deployment to target environments. Yet (...) the latter part of the contract depends on human inductive predictions or generalisations, which infer a uniformity between the trained ML model and the targets. The paper asks how we justify the contract between human and machine learning. It is argued that the justification becomes a pressing issue when we use ML to reach ‘elsewheres’ in space and time or deploy ML models in non-benign environments. The paper argues that the only viable version of the contract can be based on optimality (instead of on reliability which cannot be justified without circularity) and aligns this position with Schurz’s optimality justification. It is shown that when dealing with inaccessible/unstable ground-truths (‘elsewheres’ and non-benign targets), the optimality justification undergoes a slight change, which should reflect critically on our epistemic ambitions. Therefore, the study of ML robustness should involve not only heuristics that lead to acceptable accuracies on testing sets. The justification of human inductive predictions or generalisations about the uniformity between ML models and targets should be included as well. Without it, the assumptions about inductive risk minimisation in ML are not addressed in full. (shrink)

Reasoning from inconclusive evidence, or ‘induction’, is central to science and any applications we make of it. For that reason alone it demands the attention of philosophers of science. This Element explores the prospects of using probability theory to provide an inductive logic, a framework for representing evidential support. Constraints on the ideal evaluation of hypotheses suggest that overall support for a hypothesis is represented by its probability in light of the total evidence, and incremental support, or confirmation, indicated by (...) an increased probability given the evidence than otherwise. This proposal is shown to have the capacity to reconstruct many canons of the scientific method and inductive inference. Along the way, significant objections are discussed, such as the challenge from inductive scepticism and the objection that the probabilistic approach makes evidential support arbitrary. (shrink)

To demarcate the limits of experimental knowledge, we probe the limits of what might be called an experiment. By appeal to examples of scientific practice from astrophysics and analogue gravity, we demonstrate that the reliability of knowledge regarding certain phenomena gained from an experiment is not circumscribed by the manipulability or accessibility of the target phenomena. Rather, the limits of experimental knowledge are set by the extent to which strategies for what we call ‘inductive triangulation’ are available: that is, the (...) validation of the mode of inductive reasoning involved in the source-target inference via appeal to one or more distinct and independent modes of inductive reasoning. When such strategies are able to partially mitigate reasonable doubt, we can take a theory regarding the phenomena to be well supported by experiment. When such strategies are able to fully mitigate reasonable doubt, we can take a theory regarding the phenomena to be established by experiment. There are good reasons to expect the next generation of analogue experiments to provide genuine knowledge of unmanipulable and inaccessible phenomena such that the relevant theories can be understood as well supported. This article is part of a discussion meeting issue ‘The next generation of analogue gravity experiments’. (shrink)

This book contains a selection of the papers presented at the Logic, Reasoning and Rationality 2010 conference in Ghent. The conference aimed at stimulating the use of formal frameworks to explicate concrete cases of human reasoning, and conversely, to challenge scholars in formal studies by presenting them with interesting new cases of actual reasoning. According to the members of the Wiener Kreis, there was a strong connection between logic, reasoning, and rationality and that human reasoning is rational in so far (...) as it is based on logic. Later, this belief came under attack and logic was deemed inadequate to explicate actual cases of human reasoning. Today, there is a growing interest in reconnecting logic, reasoning and rationality. A central motor for this change was the development of non-classical logics and non-classical formal frameworks. The book contains contributions in various non-classical formal frameworks, case studies that enhance our apprehension of concrete reasoning patterns, and studies of the philosophical implications for our understanding of the notions of rationality. (shrink)

This groundbreaking, open access volume analyses and compares data practices across several fields through the analysis of specific cases of data journeys. It brings together leading scholars in the philosophy, history and social studies of science to achieve two goals: tracking the travel of data across different spaces, times and domains of research practice; and documenting how such journeys affect the use of data as evidence and the knowledge being produced. The volume captures the opportunities, challenges and concerns involved in (...) making data move from the sites in which they are originally produced to sites where they can be integrated with other data, analysed and re-used for a variety of purposes. The in-depth study of data journeys provides the necessary ground to examine disciplinary, geographical and historical differences and similarities in data management, processing and interpretation, thus identifying the key conditions of possibility for the widespread data sharing associated with Big and Open Data. The chapters are ordered in sections that broadly correspond to different stages of the journeys of data, from their generation to the legitimisation of their use for specific purposes. Additionally, the preface to the volume provides a variety of alternative “roadmaps” aimed to serve the different interests and entry points of readers; and the introduction provides a substantive overview of what data journeys can teach about the methods and epistemology of research. (shrink)

This undergraduate textbook introduces some fundamental issues in philosophy of science for students of philosophy and science students. The book is divided into two parts. Part 1 deals with knowledge and values. Chap. 1 presents the classical conception of knowledge as initiated by the ancient Greeks and elaborated during the development of science, introducing the central concepts of truth, belief and justification. Aspects of the quest for objectivity are taken up in the following two chapters. Moral issues are broached in (...) Chap. 4, which discusses some aspects of the use and abuse of science, taking up the responsibilities of scientists in properly conducting their business and decision-makers in their concerns with the import of science for society. Part 2 contrasts the view of scientific progress as the rejecting of old hypotheses and theories and replacing them with new ones, represented by Karl Popper, with the conception of progress as accumulating knowledge, saving as much as possible from older theories, represented by Pierre Duhem. A concluding chapter defends the natural attitude of taking the theories of modern science to be literally true, i.e. realism, in the face of arguments drawn partly from the history of scientific progress in criticism of this stance. (shrink)

Das Dissertationsprojekt soll eine Verbindung zwischen zwei augenscheinlich separaten Debattensträngen in der kontemporären Wissenschaftstheorie erforschen. Das ist zum einen die Debatte um die humesche Doktrin, der zufolge es keine de-re notwendigen Verbindungen respektive modale Fakten in der natürlichen Welt gibt. Diese Debatte betrifft die Grundlagen der Naturwissenschaften sowie der Natur selbst. Und das ist zum anderen die Debatte um die materiale Theorie der Induktion, welche auf John D. Norton zurückgeht und die Grundlagen der Rationalität und Logik betrifft. Nach dieser Theorie (...) werden induktive Schlüsse qua relevanter, lokaler Hintergrundfakten zuverlässig. Norton bringt viele - in meinen Augen überzeugende - Beispiele für diese Theorie, lässt uns aber im Unklaren darüber, wie diese Hintergrundfakten induktive Schlüsse lizensieren können. Ich werde argumentieren, dass es sich bei diesen relevanten Fakten zumindest in einigen paradigmatischen Fällen um irreduzibel-modale oder modal grundierte Fakten handeln muss, ansonsten können diese die ihnen zugedachte Funktion nicht erfüllen. Infolgedessen steht der Humeanismus vor einer materialen Form des Induktionsproblems. -/- Meine Forschungshypothese lautet, dass es sich bei dem materialen Induktionsproblem um das eigentliche und zentrale Problem des Humeanismus handelt. Zum einen werden viele altbekannte Probleme des Humeanismus durch das materiale Induktionsproblem motiviert und bestärkt. Zum anderen begründet das materiale Induktionsproblem ein neues und tiefgreifendes Problem des Humeanismus. Es stellt sich darin, dass der Humeanismus den empirischen Erfolg unserer verfügbaren wissenschaftlichen und alltäglichen Gesetzesannahmen nicht zirkelfrei erklären kann. Darauf aufbauend formuliere ich ein Super-Wunderargument, das im Kern in einer Inferenz von den bisherigen empirischen Erfolgen unserer verfügbaren Gesetzesannahmen auf die Wahrheit des Anti-Humeanismus besteht. Dieses Argument steht im Zentrum meiner Arbeit. Alles Weitere wird im Kontext dieses Argumentes diskutiert und illustriert. Zu diesen Untersuchungen gehören die schrittweise Motivation des Argumentes durch das materiale Induktionsproblem, die Unterscheidung und Diskussion verschiedener logischer Formen des Argumentes, das Herausarbeiten der Vorteile sowie die Antizipation von möglichen Einwänden gegen das Argument. (shrink)

I begin by making some distinctions between kinds of response to a skeptical claim, the purpose of which is to explain what I mean by a "dissolution" of the problem of induction, and to focus on one of the ways it can be implemented. I then argue that previous attempts to dissolve the problem in this way fail, present mine, and defend it. Finally, I show that the dissolution of the problem doesn't improve our normative situation and may even worsen (...) it. (shrink)

It is important to have an adequate model of uncertainty, since decisions must be made before the uncertainty can be resolved. For instance, flood defenses must be designed before we know the future distribution of flood events. It is standardly assumed that probability theory offers the best model of uncertain information. I think there are reasons to be sceptical of this claim. I criticise some arguments for the claim that probability theory is the only adequate model of uncertainty. In particular (...) I critique Dutch book arguments, representation theorems, and accuracy based arguments. Then I put forward my preferred model: imprecise probabilities. These are sets of probability measures. I offer several motivations for this model of uncertain belief, and suggest a number of interpretations of the framework. I also defend the model against some criticisms, including the so-called problem of dilation. I apply this framework to decision problems in the abstract. I discuss some decision rules from the literature including Levi’s E-admissibility and the more permissive rule favoured by Walley, among others. I then point towards some applications to climate decisions. My conclusions are largely negative: decision making under such severe uncertainty is inevitably difficult. I finish with a case study of scientific uncertainty. Climate modellers attempt to offer probabilistic forecasts of future climate change. There is reason to be sceptical that the model probabilities offered really do reflect the chances of future climate change, at least at regional scales and long lead times. Indeed, scientific uncertainty is multi-dimensional, and difficult to quantify. I argue that probability theory is not an adequate representation of the kinds of severe uncertainty that arise in some areas in science. I claim that this requires that we look for a better framework for modelling uncertainty. (shrink)

When radiocarbon dating techniques were applied to archaeological material in the 1950s they were hailed as a revolution. At last archaeologists could construct absolute chronologies anchored in temporal data backed by immutable laws of physics. This would make it possible to mobilize archaeological data across regions and time-periods on a global scale, rendering obsolete the local and relative chronologies on which archaeologists had long relied. As profound as the impact of 14C dating has been, it has had a long and (...) tortuous history now described as proceeding through three revolutions, each of which addresses distinct challenges of capturing, processing and packaging radiogenic data for use in resolving chronological puzzles with which archaeologists has long wrestled. In practice, mobilizing radiogenic data for archaeological use is a hard-won achievement; it involves multiple transformations that, at each step of the way, depend upon a diverse array of technical expertise and background knowledge. I focus on strategies of triangulation and traceability that establish the integrity of these data and their relevance as anchors for evidential reasoning in archaeology. (shrink)

Eliminative reasoning is a method that has been employed in many significant episodes in the history of science. It has also been advocated by some philosophers as an important means for justifying well-established scientific theories. Arguments for how eliminative reasoning is able to do so, however, have generally relied on a too narrow conception of evidence, and have therefore tended to lapse into merely heuristic or pragmatic justifications for their conclusions. This paper shows how a broader conception of evidence not (...) only can supply the needed justification but also illuminates the methodological significance of eliminative reasoning in a variety of contexts. (shrink)

Philosophical theories of evidence have been on offer, but they are mostly evaluated in terms of all-or-none desiderata — if they fail to meet one of the desiderata, they are not a satisfactory theory. In this thesis, I aim to accomplish three missions. Firstly, I construct a new way of evaluating theories of evidence, which I call a tool-based view. Secondly, I analyse the nature of what I will call the various relevance-mediating vehicles that each theory of evidence employs. Thirdly, (...) I articulate the comparative core of evidential reasoning in the historical sciences, one which is overlooked in major theories of evidence. On the first mission, I endorse a meta-thesis of pluralism on theories of evidence, namely a tool-based view. I regard a theory of evidence as a purpose-specific and setting-sensitive tool which has its own strengths, difficulties and limitations. Among the major theories of evidence I have reviewed, I focus on Achinstein’s explanationist theory, Cartwright’s argument theory and Reiss’s inferentialist account, scrutinising and evaluating them against the purposes they set out and the scope of their applications. On the second mission, I note that there is no such thing as intrinsically ‘being evidence’. Rather, I hold that relevance-mediating vehicles configure data, materials or claims in such ways that some of them are labelled evidence. I identify the relevance-mediating vehicles that the theories of evidence employ. On the final mission, I argue that the likelihoodist account is an appropriate tool for explaining the evidential reasoning in poorly specified settings where likelihoods can be only imprecisely compared. Such settings, I believe, are typical in the historical sciences. Using the reconstruction of proto-sounds in historical linguistics as a case study, I formalise the rationale behind it by means of the law of likelihood. (shrink)

Pluralism about scientific method is more-or-less accepted, but the consequences have yet to be drawn out. Scientists adopt different methods in response to different epistemic situations: depending on the system they are interested in, the resources at their disposal, and so forth. If it is right that different methods are appropriate in different situations, then mismatches between methods and situations are possible. This is most likely to occur due to method bias: when we prefer a particular kind of method, despite (...) that method clashing with evidential context or our aims. To explore these ideas, we sketch a kind of method pluralism which turns on two properties of evidence, before using agent-based models to examine the relationship between methods, epistemic situations, and bias. Based on our results, we suggest that although method bias can undermine the efficiency of a scientific community, it can also be productive through preserving a diversity of evidence. We consider circumstances where method bias could be particularly egregious, and those where it is a potential virtue, and argue that consideration of method bias reveals that community standards deserve a central place in the epistemology of science. (shrink)

*PSA 2016, symposium on “Data in Time: Epistemology of Historical Data” organized by Sabina Leonelli, 5 November 2016* *See published version: "Radiocarbon Dating in Archaeology: Triangulation and Traceability" in Data Journeys in the Sciences (2020) - link below* Archaeologists put a premium on pressing “legacy data” into service, given the notoriously selective and destructive nature of their practices of data capture. Legacy data consist of material and records that been assembled over decades, sometimes centuries, often by means and for purposes (...) long since discredited or superseded. The primary strategies by which archaeologists put the data to work for new purposes are, I argue, secondary retrieval, recontextualization, and experimental modelling. I focus here on a particularly telling and complex example of secondary retrieval: the extraction of new data from old by means of radiocarbon dating. This is by no means a straightforward process of retrieving physical samples from legacy data to which 14C techniques can be applied that can, on their own, decisively settle chronological questions. When Libby’s post-war radiocarbon revolution got under way, it was expected to establish an absolute chronology that would render obsolete the local and relative chronologies on which archaeologists had long relied. Transformative though it has been, bringing these tools of physical dating to bear on archaeological problems has been a long, tortuous process, now described as proceeding through two subsequent radiocarbon revolutions. The second was an extended process of calibration by which 14C chronologies were corrected and refined, often against the very lines of evidence they were meant to displace. The most recent, a “pragmatic Bayesian” approach to archaeological dating, is motivated by concern that, no matter how much it is refined, radiocarbon dating cannot on its own resolve the chronological problems that archaeologists address; the challenge, its advocates argue, is to ‘fully integrate archaeological information with 14C dating in order to address archaeologically relevant timescales and episodes’. This is a genre of “robustness” reasoning that illustrates its epistemic risks as well as its appeal. As recent philosophical debate makes clear, it depends on appeals to the convergence of independent lines of evidence that may have more rhetorical than epistemic force and that may be spurious. Drawing on this philosophical literature I identify a set of conditions that must be met if these risks are to be avoided, all of which are an explicit focus of debate in cases of contestation about and reconciliation of chronologies based on legacy data. (shrink)

I’m often asked why, as a philosopher of science, I study archaeology. Philosophy is so abstract and intellectual, and archaeology is such an earth-bound, data-driven enterprise, what could the connection possibly be? This puzzlement takes a number of different forms. In one memorable exchange in the late 1970s when I was visiting Oxford as a graduate student an elderly don, having inquired politely about my research interests, tartly observed that archaeology isn’t a science, so I couldn’t possibly be writing a (...) dissertation in philosophy of science on archaeology. At job interviews a few years later a standard opening gambit was to ask: “so what’s philosophical about the work you do on archaeology” or, more querulously, “what could possibly be of philosophical interest in archaeology”? And from archaeologists, weary of the “theory wars” that raged through 1980s and 1990s, the standard question was, “What’s the point?! Better to step away from the wrangling about philosophical ‘isms’ and get on with the empirical work that needs doing.”. (shrink)