Obviously medicine should be evidence-based. The issues lie in the details: what exactly counts as evidence? Do certain kinds of evidence carry more weight than others? (And if so why?) And how exactly should medicine be based on evidence? When it comes to these details, the evidence-based medicine (EBM) movement has got itself into a mess – or so it will be argued. In order to start to resolve this mess, we need to go 'back to basics'; and that means (...) turning to the philosophy of science. The theory of evidence, or rather the logic of the interrelations between theory and evidence, has always been central to the philosophy of science – sometimes under the alias of the 'theory of confirmation'. When taken together with a little philosophical commonsense, this logic can help us move towards a position on evidence in medicine that is more sophisticated and defensible than anything that EBM has been able so far to supply. (shrink)

Likelihoodism is the view that the degree of evidential support should be analysed and measured in terms of likelihoods alone. The paper considers and responds to a popular criticism that a likelihoodist framework is too restrictive to guide belief. First, I show that the most detailed and rigorous version of this criticism, as put forward by Gandenberger (2016), is unsuccessful. Second, I provide a positive argument that a broadly likelihoodist framework can accommodate guidance for comparative belief, even when objectively well-grounded (...) prior probabilities are not available. As I show, the shift from non-relational to comparative probabilities opens up a new space for addressing the belief guidance problem for likelihoodism. (shrink)

In the last three decades several cosmological principles and styles of reasoning termed 'anthropic' have been introduced into physics research and popular accounts of the universe and human beings' place in it. I discuss the circumstances of 'fine tuning' that have motivated this development, and what is common among the principles. I examine the two primary principles, and find a sharp difference between these 'Weak' and 'Strong' varieties: contrary to the view of the progenitors that all anthropic principles represent a (...) departure from Copernicanism in cosmology, the Weak Anthropic Principle is an instance of Copernicanism. It has close affinities with the step of Copernicus that Immanuel Kant took himself to be imitating in the 'critical' turn that gave rise to the Critique of Pure Reason. I conclude that the fact that a way of going about natural science mentions human beings is not sufficient reason to think that it is a subjective approach; in fact, it may need to mention human beings in order to be objective. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.

Mitchell & Gronenborn propose that we account for the presence of multiple models of protein structure, each produced in different contexts, through the framework of integrative pluralism. I argue that two interpretations of this framework are available, neither of which captures the relationship between a model and the protein structure it represents or between multiple models of protein structure. Further, it inclines us toward concluding prematurely that models of protein structure are right in their contexts and makes extrapolation of findings (...) from one context to another seem unwarranted. Instead, protein structure determination ought to be understood as modestly monistic. There is one model for every protein in each physicochemical context, and models of the same protein produced in different contexts are compatible with one another. ‘Integrating’ multiple models amounts to extrapolating from one context to another; this is possible because the effect of context on protein folding is relatively weak and predictable. Modest monism better describes the practice of protein structure determination than integrative pluralism and enables greater attention to how context affects protein folding. (shrink)

This dissertation proposes and defends a hybrid view I call Hybrid Impermissivism, which combines the following two theses: Moderate Uniqueness and Credal Permissivism. Moderate Uniqueness says that no evidence could justify both believing a proposition and its negation. However, on Moderate Uniqueness, evidence could justify both believing and suspending judgement on a proposition (hence the adjective “Moderate”). And Credal Permissivism says that more than one credal attitude could be justified on the evidence. Hybrid Impermissisim is developed into a precise theory (...) by using normative bridge principles on how rational belief and credence ought to interact. My overall conclusion is that Hybrid Impermissivism is a coherent, plausible, and conciliatory position and provides a correct characterisation of the requirements of evidence on doxastic attitudes . (shrink)

One might be inclined to assume, given the mouse donning its cover, that the behavior of interest in Nicole Nelson's book Model Behavior (2018) is that of organisms like mice that are widely used as “stand-ins” for investigating the causes of human behavior. Instead, Nelson's ethnographic study focuses on the strategies adopted by a community of rodent behavioral researchers to identify and respond to epistemic challenges they face in using mice as models to understand the causes of disordered human behaviors (...) associated with mental illness. Although Nelson never explicitly describes the knowledge production activities in which her behavioral geneticist research subjects engage as “exemplary”, the question of whether or not these activities constitute “model behavior(s)”—generalizable norms for engaging in scientific research—is one of the many thought-provoking questions raised by her book. As a philosopher of science interested in this question, I take it up here. (shrink)

I examine the role of inference from experiment in theory building. What are the options open to the scientific community when faced with an experimental result that appears to be in conflict with accepted theory? I distinguish, in Laudan's (1977), Nickels's (1981), and Franklin's (1993) sense, between the context of pursuit and the context of justification of a scientific theory. Making this distinction allows for a productive middle position between epistemic realism and constructivism. The decision to pursue a new or (...) a revised theory in response to the new evidence may not be fully rationally determined. Nonetheless, it is possible to distinguish the question of whether there is reason to pursue a theory from the question of whether that theory, once it has been pursued over time, solves a problem of interest to science. I argue that, in this context, there is a solid way to distinguish between the contexts of pursuit and of justification, on the basis of a theory's evidential support and problem-solving ability. (shrink)

My purpose in this chapter is to survey some of the principal approaches to inductive inference in the philosophy of science literature. My first concern will be the general principles that underlie the many accounts of induction in this literature. When these accounts are considered in isolation, as is more commonly the case, it is easy to overlook that virtually all accounts depend on one of very few basic principles and that the proliferation of accounts can be understood as efforts (...) to ameliorate the weaknesses of those few principles. In the earlier sections, I will lay out three inductive principles and the families of accounts of induction they engender. In later sections I will review standard problems in the philosophical literature that have supported some pessimism about induction and suggest that their import has been greatly overrated. In the final sections I will return to the proliferation of accounts of induction that frustrates efforts at a final codification. I will suggest that this proliferation appears troublesome only as long as we expect inductive inference to be subsumed under a single formal theory. If we adopt a material theory of induction in which individual inductions are licensed by particular facts that prevail only in local domains, then the proliferation is expected and not problematic. (shrink)

The discovery of the Higgs particle required a signal of 5σ significance. The rigid application of that condition is a convention that disregards more specific aspects of the given experiment. In particular, it does not account for the characteristics of the look elsewhere effect in the individual experimental context. The paper relates this aspect of data analysis to the question as to what extent theoretical reasoning should be admitted to play a role in the assessment of the significance of empirical (...) data. (shrink)

It is argued that the high degree of trust in the Higgs particle before its discovery raises the question of a Bayesian perspective on data analysis in high energy physics in an interesting way that differs from other suggestions regarding the deployment of Bayesian strategies in the field.

Despite its potential implications for the objectivity of scientific knowledge, the claim that “scientific instruments are perspectival” has received little critical attention. I show that this claim is best understood as highlighting the dependence of instruments on different perspectives. When closely analyzed, instead of constituting a novel epistemic challenge, this dependence can be exploited to mount novel strategies for resolving two old epistemic problems: conceptual relativism and theory-ladeness. The novel content of this article consists in articulating and developing these strategies (...) by introducing two fine-grained notions of perspectives as the key units of analysis: “broad perspectives” and “narrow perspectives.”. (shrink)

The replication crisis has prompted many to call for statistical reform within the psychological sciences. Here we examine issues within Frequentist statistics that may have led to the replication crisis, and we examine the alternative—Bayesian statistics—that many have suggested as a replacement. The Frequentist approach and the Bayesian approach offer radically different perspectives on evidence and inference with the Frequentist approach prioritising error control and the Bayesian approach offering a formal method for quantifying the relative strength of evidence for hypotheses. (...) We suggest that rather than mere statistical reform, what is needed is a better understanding of the different modes of statistical inference and a better understanding of how statistical inference relates to scientific inference. (shrink)

This article critically analyses the concept of evidence in evidence‐based policy, arguing that there is a key problem: there is no existing practicable theory of evidence, one which is philosophically‐grounded and yet applicable for evidence‐based policy. The article critically considers both philosophical accounts of evidence and practical treatments of evidence in evidence‐based policy. It argues that both fail in different ways to provide a theory of evidence that is adequate for evidence‐based policy. The article contributes to the debate about how (...) evidence can and should be used to reduce contingency in science and in policy based on science. (shrink)

Inductive reasoning aims at constructing rules and models of general applicability from a restricted set of observations. Induction is a keystone in natural sciences, and it influences diverse application fields such as engineering, medicine and economics. More generally, induction plays a major role in the way humans learn and operate in their everyday life. The level of reliability that a model achieves depends on how informative the observations are relative to the flexibility of the process by which the model is (...) constructed. When the process is articulated so that the model can incorporate descriptive details and subtleties, a large set of informative observations are required to reliably tune the model, whereas models obtained from simple procedures can be tuned with fewer observations. This article introduces the concept of “dominance”, which refers to the situation in which a reduced subset of observations suffices to reconstruct the model. A mathematical framework is presented to quantify the reliability of learning procedures as a function of the size of the subset of dominant observations. Although limited in scope, we believe that our study can contribute to the understanding of some fundamental mechanisms by which knowledge is generated from observations in inductive reasoning. (shrink)

The present work constitutes an attempt to make explicit those pragmatic norms successfully operating in empirical science. I will first comment on the initial presuppositions of the discussion, in particular, on those concerning the instrumental character of scientific practice and the nature of scientific goals. Then I will depict the moderately naturalistic frame in which, from this approach, the pragmatic norms make sense. Third, I will focus on the specificity of the pragmatic norms, making special emphasis on what I regard (...) as a key idea underlying them, namely, the view, vigorously advocated by classical pragmatists like C. S. Peirce and G. Vailati, that the best test for objectivity is the test of action. Finally, I am going to put forward a tentative list of pragmatic norms that can be abstracted from a careful observation and analysis of scientific practice as provided by current philosophers of experimentation (A. Franklin and F. Steinle among others). The norms will be divided into four classes corresponding to four aspects of science in which they rule, that is, self-correction, prediction, explanation and both experimentation and computation. In the following account, the formulation of those pragmatic norms successfully governing science will be understood as a contribution that scientifically-oriented pragmatism can make to the normative naturalistic project in epistemology. (shrink)

This article examines how problems of validity in empirical social research differ from those in natural science. Specifically, we focus on how some ontological peculiarities of the object of study in social science bear on validity requirements. We consider these issues in experimental validity as well as in test validity because, while both fields hold large intellectual traditions, research tests or questionnaires are less closely connected to natural science methodology than experiments.

Users of sociotechnical systems often have no way to independently verify whether the system output which they use to make decisions is correct; they are epistemically dependent on the system. We argue that this leads to problems when the system is wrong, namely to bad decisions and violations of the norm of practical reasoning. To prevent this from occurring we suggest the implementation of defeaters: information that a system is unreliable in a specific case (undercutting defeat) or independent information that (...) the output is wrong (rebutting defeat). Practically, we suggest to design defeaters based on the different ways in which a system might produce erroneous outputs, and analyse this suggestion with a case study of the risk classification algorithm used by the Dutch tax agency. (shrink)

Whereas an inference (deductive as well as inductive) is usually viewed as being valid in virtue of its argument form, the present paper argues that scientific reasoning is material inference, i.e., justified in virtue of its content. A material inference is licensed by the empirical content embodied in the concepts contained in the premises and conclusion. Understanding scientific reasoning as material inference has the advantage of combining different aspects of scientific reasoning, such as confirmation, discovery, and explanation. This approach explains (...) why these different aspects (including discovery) can be rational without conforming to formal schemes, and why scientific reasoning is local, i.e., justified only in certain domains and contingent on particular empirical facts. The notion of material inference also fruitfully interacts with accounts of conceptual change and psychological theories of concepts. (shrink)

Review essay of The Philosophy of Experimental Biology by Marcel Weber (Cambridge University Press, 2005).

This article outlines a philosophy of science in practice that focuses on the engineering sciences. A methodological issue is that these practices seem to be divided by two different styles of scientific reasoning, namely, causal-mechanistic and mathematical reasoning. These styles are philosophically characterized by what Kuhn called ?disciplinary matrices?. Due to distinct metaphysical background pictures and/or distinct ideas of what counts as intelligible, they entail distinct ideas of the character of phenomena and what counts as a scientific explanation. It is (...) argued that the two styles cannot be reduced to each other. At the same time, although they are incompatible, they must not be regarded as competing. Instead, they produce different kinds of epistemic results, which serve different kinds of epistemic functions. Moreover, some scientific breakthroughs essentially result from relating them. This view of complementary styles of scientific reasoning is supported by pluralism about metaphysical background pictures. (shrink)

The question of where, between theory and experiment, computer simulations (CSs) locate on the methodological map is one of the central questions in the epistemology of simulation (cf. Saam Journal for General Philosophy of Science, 48, 293–309, 2017). The two extremes on the map have them either be a kind of experiment in their own right (e.g. Barberousse et al. Synthese, 169, 557–574, 2009; Morgan 2002, 2003, Journal of Economic Methodology, 12(2), 317–329, 2005; Morrison Philosophical Studies, 143, 33–57, 2009; Morrison (...) 2015; Massimi and Bhimji Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics, 51, 71–81, 2015; Parker Synthese, 169, 483–496, 2009) or just an argument executed with the aid of a computer (e.g. Beisbart European Journal for Philosophy of Science, 2, 395–434, 2012; Beisbart and Norton International Studies in the Philosophy of Science, 26, 403–422, 2012). There exist multiple versions of the first kind of position, whereas the latter is rather unified. I will argue that, while many claims about the ‘experimental’ status of CSs seem unjustified, there is a variant of the first position that seems preferable. In particular I will argue that while CSs respect the logic of (deductively valid) arguments, they neither agree with their pragmatics nor their epistemology. I will then lay out in what sense CSs can fruitfully be seen as experiments, and what features set them apart from traditional experiments nonetheless. I conclude that they should be seen as surrogate experiments, i.e. experiments executed consciously on the wrong kind of system, but with an exploitable connection to the system of interest. Finally, I contrast my view with that of Beisbart (European Journal for Philosophy of Science, 8, 171–204, 2018), according to which CSs are surrogates for experiments, arguing that this introduces an arbitrary split between CSs and other kinds of simulations. (shrink)

Large scale experiments at CERN’s Large Hadron Collider rely heavily on computer simulations, a fact that has recently caught philosophers’ attention. CSs obviously require appropriate modeling, and it is a common assumption among philosophers that the relevant models can be ordered into hierarchical structures. Focusing on LHC’s ATLAS experiment, we will establish three central results here: with some distinct modifications, individual components of ATLAS’ overall simulation infrastructure can be ordered into hierarchical structures. Hence, to a good degree of approximation, hierarchical (...) accounts remain valid at least as descriptive accounts of initial modeling steps. In order to perform the epistemic function Winsberg Model-based reasoning in scientific discovery. Kluwer Academic/plenum Publishers, New York, pp 255–269, 1999) assigns to models in simulation—generate knowledge through a sequence of skillful but non-deductive transformations—ATLAS’ simulation models have to be considered part of a network rather than a hierarchy, in turn making the associated simulation modeling messy rather than motley. Deriving knowledge-claims from this ‘mess’ requires two sources of justification: holistic validation :253–262, 2010; in Carrier M, Nordmann A Science in the context of application. Springer, Berlin, pp 115–130, 2011), and model coherence. As it turns out, the degree of model coherence sets HEP apart from other messy, simulation-intensive disciplines such as climate science, and the reasons for this are to be sought in the historical, empirical and theoretical foundations of the respective discipline. (shrink)

This paper discusses features of an epistemically valuable form of evidence that raise troubles for received and new epistemological treatments of experimental evidence.

Using Jim Woodward's Counterfactual Dependency account as an example, I argue that causal claims about indeterministic systems cannot be satisfactorily analysed as including counterfactual conditionals among their truth conditions because the counterfactuals such accounts must appeal to need not have truth values. Where this happens, counterfactual analyses transform true causal claims into expressions which are not true.

As climate policy decisions are decisions under uncertainty, being based on a range of future climate change scenarios, it becomes a crucial question how to set up this scenario range. Failing to comply with the precautionary principle, the scenario methodology widely used in the Third Assessment Report of the International Panel on Climate Change (IPCC) seems to violate international environmental law, in particular a provision of the United Nations Framework Convention on Climate Change. To place climate policy advice on a (...) sound methodological basis would imply that climate simulations which are based on complex climate models had, in stark contrast to their current hegemony, hardly an epistemic role to play in climate scenario analysis at all. Their main function might actually consist in ‘foreseeing future ozone-holes’. In order to argue for these theses, I explain first of all the plurality of climate models used in climate science by the failure to avoid the problem of underdetermination. As a consequence, climate simulation results have to be interpreted as modal sentences, stating what is possibly true of our climate system. This indicates that climate policy decisions are decisions under uncertainty. Two general methodological principles which may guide the construction of the scenario range are formulated and contrasted with each other: modal inductivism and modal falsificationism. I argue that modal inductivism, being the methodology implicitly underlying the third IPCC report, is severely flawed. Modal falsificationism, representing the sound alternative, would in turn require an overhaul of the IPCC practice. (shrink)

This article discusses how inference to the best explanation can be justified as a practical meta - argument. It is, firstly, justified as a practical argument insofar as accepting the best explanation as true can be shown to further a specific aim. And because this aim is a discursive one which proponents can rationally pursue in — and relative to — a complex controversy, namely maximising the robustness of one’s position, IBE can be conceived, secondly, as a meta - argument. (...) My analysis thus bears a certain analogy to Sellars ’ well - known justification of inductive reasoning ; it is based on recently developed theories of complex argumentation. (shrink)

The quantitative problem of old evidence is the problem of how to measure the degree to which e confirms h for agent A at time t when A regards e as justified at t. Existing attempts to solve this problem have applied the e-difference approach, which compares A's probability for h at t with what probability A would assign h if A did not regard e as justified at t. The quantitative problem has been widely regarded as unsolvable primarily on (...) the grounds that the e-difference approach suffers from intractable problems. Various philosophers have proposed that 'Bayesianism' should be rejected as a research strategy in confirmation theory in part because of the unsolvability of this problem. I develop a version of the e-difference approach which overcomes these problems and possesses various advantages (but also certain limitations). I develop an alternative 'theistic' approach which handles many cases that my development of the e-difference approach does not handle. I conclude with an assessment of the significance of the quantitative problem for Bayesianism and argue that this problem is misunderstood in so far as it is regarded as unsolvable, and in so far as it is regarded as a problem only for Bayesians. (shrink)

Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bio-informatics, where classical methods from mathematical optimization fail. (...) Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo’s learning model (NPT*). (shrink)

Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bioinformatics, where classical methods from mathematical optimization fail. (...) Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo's learning model. (shrink)

There is a debate in Bayesian confirmation theory between subjective and non-subjective accounts of evidence. Colin Howson has provided a counterexample to our non-subjective account of evidence: the counterexample refers to a case in which there is strong evidence for a hypothesis, but the hypothesis is highly implausible. In this article, we contend that, by supposing that strong evidence for a hypothesis makes the hypothesis more believable, Howson conflates the distinction between confirmation and evidence. We demonstrate that Howson’s counterexample fails (...) for a different pair of hypotheses. (shrink)

The underdetermination thesis poses a threat to rational choice of scientific theories. We discuss two arguments for the thesis. One draws its strength from deductivism together with the existence thesis, and the other is defended on the basis of the failure of a reliable inductive method. We adopt a partially subjective/objective pragmatic Bayesian epistemology of science framework, and reject both arguments for the thesis. Thus, in science we are able to reinstate rational choice called into question by the underdetermination thesis.

The notion of a severe test has played an important methodological role in the history of science. But it has not until recently been analyzed in any detail. We develop a generally Bayesian analysis of the notion, compare it with Deborah Mayo’s error-statistical approach by way of sample diagnostic tests in the medical sciences, and consider various objections to both. At the core of our analysis is a distinction between evidence and confirmation or belief. These notions must be kept separate (...) if mistakes are to be avoided; combined in the right way, they provide an adequate understanding of severity. Those who think that the weight of the evidence always enables you to choose between hypotheses “ignore one of the factors (the prior probability) altogether, and treat the other (the likelihood) as though it ...meant something other than it actually does. This is the same mistake as is made by someone who has scruples about measuring the arms of a balance (having only a tape measure at his disposal ...), but is willing to assert that the heavier load will always tilt the balance (thereby implicitly assuming, although without admitting it, that the arms are of equal length!). (Bruno de Finetti, Theory of Probability)2. (shrink)

The article analyses in detail the Meselson–Stahl experiment, identifying two novel difficulties for the crucial experiment account, namely, the fragility of the experimental results and the fact that the hypotheses under scrutiny were not mutually exclusive. The crucial experiment account is rejected in favour of an experimental-mechanistic account of the historical significance of the experiment, emphasizing that the experiment generated data about the biochemistry of DNA replication that is independent of the testing of the semi-conservative, conservative, and dispersive hypotheses. _1_ (...) Introduction _2_ The Meselson–Stahl Experiment _3_ Some Difficulties for the Crucial Experiment Account _3.1_ Additional experiments were required _3.2_ Simplicity considerations are unconvincing _3.3_ The fragility of the experimental results _3.4_ The problematic interpretation of falsifyng results _3.5_ Not all possible hypotheses considered or tested _3.6_ The tested hypotheses were not mutually exclusive _4_ The Historical and Scientific Significance of the Meselson–Stahl Experiment _4.1_ The challenge for the crucial experiment account _4.2_ A mechanistic perspective on the experiment _4.3_ The experimental design and its independence from theoretical speculations _4.4_ The advantages of a ‘bottom-up’ mechanistic account _5_ Conclusion. (shrink)

The paper examines the claim that significance testing violates the Principle of Total Evidence. I argue that p-values violate PTE for two-sided tests but satisfy PTE for one-sided tests invoking a sufficient test statistic independent of the preferred theory of evidence. While the focus of the paper is to evaluate a particular claim about the relationship of significance testing and PTE, I clarify the reading of this methodological principle along the way.

Ockham’s razor is the idea that simpler hypotheses are to be preferred over more complex ones. In the context of medical diagnosis, this is taken to mean that when a patient has multiple symptoms, a single diagnosis should be sought that accounts for all the clinical features, rather than attributing a different diagnosis to each. This paper examines whether diagnostic parsimony can be justified by reference to probability theory. I argue that while attempts to offer universal justifications of diagnostic parsimony (...) fail, a more constrained use of this diagnostic principle can be supported. (shrink)

One important aspect of biological explanation is detailed causal modeling of particular phenomena in limited experimental background conditions. Recognising this allows one to appreciate that a sufficient condition for a reduction in biology is a molecular model of (1) only the demonstrated causal parameters of a biological model and (2) only within a replicable experimental background. These identities—which are ubiquitous in biology and form the basis of ruthless reductions (Bickle, Philosophy and neuroscience: a ruthlessly reductive account, 2003)—are criticised as merely (...) “local” (Sullivan, Synthese 167:511–539, 2009) or “fragmentary” (Schaffner, Synthese, 151(3):377–402, 2006). However, in an instructive case, a biological model is preserved in molecular terms, demonstrating a complex phenomenon that has been successfully reduced. (shrink)

This paper is concerned with the role of rational belief change theory in the philosophical understanding of experimental error. Today, philosophers seek insight about error in the investigation of specific experiments, rather than in general theories. Nevertheless, rational belief change theory adds to our understanding of just such cases: R. A. Fisher’s criticism of Mendel’s experiments being a case in point. After an historical introduction, the main part of this paper investigates Fisher’s paper from the point of view of rational (...) belief change theory: what changes of belief about Mendel’s experiment does Fisher go through and with what justification. It leads to surprising insights about what Fisher had done right and wrong, and, more generally, about the limits of statistical methods in detecting error. (shrink)

Many decades ago Patrick Suppes argued rather convincingly that theoretical hypotheses are not confronted with the direct, raw results of an experiment, rather, they are typically compared with models of data. What exactly is a data model however? And how do the interactions of particles at the subatomic scale give rise to the huge volumes of data that are then moulded into a polished data model? The aim of this paper is to answer these questions by presenting a detailed case (...) study of the construction of data models at the LHCb for testing Lepton Flavour Universality in rare decays of B-mesons. The close examination of the scientific practice at the LHCb leads to the following four main conclusions: raw data in their pure form are practically useless for the comparison of experimental results with theory, and processed data are in some cases epistemically more reliable, real and simulated data are involved in the co-production of the final data model and cannot be easily distinguished, theory-ladenness emerges at three different levels depending on the scope and the purpose for which background theory guides the overall experimental process and the overall process of acquiring and analysing data in high energy physics is too complicated to be fully captured by a generic methodological description of the experimental practice. (shrink)

: Errors in science range along a spectrum from those relatively local to the phenomenon (usually easily remedied in the laboratory) to those more conceptually derived (involving theory or cultural factors, sometimes quite long-term). One may classify error types broadly as material, observational, conceptual or discoursive. This framework bridges philosophical and sociological perspectives, offering a basis for interfield discourse. A repertoire of error types also supports error analytics, a program for deepening reliability through strategies for regulating and probing error.

Probability theory is important because of its relevance for decision making, which also means: its relevance for the single case. The propensity theory of objective probability, which addresses the single case, is subject to two problems: Humphreys’ problem of inverse probabilities and the problem of the reference class. The paper solves both problems by restating the propensity theory using (an objectivist version of) Pearl’s approach to causality and probability, and by applying a decision-theoretic perspective. Contrary to a widely held view, (...) decision making on the basis of given propensities can proceed without a subjective-probability supplement to propensities. (shrink)

According to Fisher, a hypothesis specifying a density function for X is falsified (at the level of significance ) if the realization of X is in the size- region of lowest densities. However, non-linear transformations of X can map low-density into high-density regions. Apparently, then, falsifications can always be turned into corroborations (and vice versa) by looking at suitable transformations of X (Neyman's Paradox). The present paper shows that, contrary to the view taken in the literature, this provides no argument (...) against a theory of statistical falsification. (shrink)

Considerable methodological difficulties abound in neuroimaging, and several philosophers of science have recently called into question the potential of neuroimaging studies to contribute to our knowledge of human cognition. These skeptical accounts suggest that functional hypotheses are underdetermined by neuroimaging data. I apply Mayo’s error-statistical account to clarify the evidential import of neuroimaging data and the kinds of inferences it can reliably support. Thus, we can answer the question “What can we reliably learn from neuroimaging?” and make sense of how (...) this knowledge can contribute to novel construals of cognition. (shrink)

Duhem’s problem arises especially in scientific contexts where the tools and procedures of measurement and analysis are numerous and complex. Several philosophers of cognitive science have cited its manifestations in fMRI as grounds for skepticism regarding the epistemic value of neuroimaging. To address these Duhemian arguments for skepticism, I offer an alternative approach based on Deborah Mayo’s error-statistical account in which Duhem's problem is more fruitfully approached in terms of error probabilities. This is illustrated in examples such as the use (...) of probabilistic brain atlases, comparison of different preprocessing protocols with respect to their error characteristics, and statistical modeling of fMRI data. These examples demonstrate the ways in which we can better understand and formulate the general methodological problem and direct the way toward alternative approaches to neuroimaging in philosophy of cognitive science, in which we can be more balanced and productive in our scrutiny of the epistemic value of neuroimaging studies. (shrink)

Duhem’s problem arises especially in scientific contexts where the tools and procedures of measurement and analysis are numerous and complex. Several philosophers of cognitive science have cited its manifestations in fMRI as grounds for skepticism regarding the epistemic value of neuroimaging. To address these Duhemian arguments for skepticism, I offer an alternative approach based on Deborah Mayo’s error-statistical account in which Duhem's problem is more fruitfully approached in terms of error probabilities. This is illustrated in examples such as the use (...) of probabilistic brain atlases, comparison of different preprocessing protocols with respect to their error characteristics, and statistical modeling of fMRI data. These examples demonstrate the ways in which we can better understand and formulate the general methodological problem and direct the way toward alternative approaches to neuroimaging in philosophy of cognitive science, in which we can be more balanced and productive in our scrutiny of the epistemic value of neuroimaging studies. (shrink)

Several developments for diverse scientific goals, mostly in physics and physiology, had to take place, which eventually gave us fMRI as one of the central research paradigms of contemporary cognitive neuroscience. This technique stands on solid foundations established by the physics of magnetic resonance and the physiology of hemodynamics and is complimented by computational and statistical techniques. I argue, and support using concrete examples, that these foundations give rise to a productive theory-ladenness in fMRI, which enables researchers to identify and (...) control for the types of methodological and inferential errors. Consequently, this makes it possible for researchers to represent and investigate cognitive phenomena in terms of hemodynamic data and for experimental knowledge to grow independently of large scale theories of cognition. (shrink)

Three new versions of Wason’s 2-4-6 rule discovery task incorporating error rates or feedback of uncertainty reduction, inspired by the error-statistical account in philosophy of science, were employed. In experiments 1 and 2, participants were instructed that some experimenter feedback would be erroneous. The results showed that performance was impaired when there was probabilistic error. In experiment 3, participants were given uncertainty reduction feedback as they generated different number triples and the negative effects of probabilistic error were not observed. These (...) findings are informative not only about rule discovery tasks in general but also about contexts of inference under uncertainty. (shrink)