Cultural phylogenetics has made remarkable progress by relying on methods originally developed in biology. But biological and cultural evolution do not always proceed according to the same principles. So what, if anything, could justify the use of phylogenetic methods to reconstruct the evolutionary history of culture? In this paper, we describe models used to assess the reliability of inference methods and show how these models play an underappreciated role in addressing that question. The notion of reliability is of course central (...) to these models. As we explain, a common way of understanding reliability is in terms of low error rates. A careful look at case studies in cultural phylogenetics suggests that reliability models partly corroborate this understanding of reliability but also raises points of tension. We conclude by hinting at a few ways forward. (shrink)

The 1980s, it is often claimed, was the decade when experimentation finally became a philosophical topic. This was the responsibility, the claim continues, of one particular movement within philosophy of science, called “new experimentalism.” The aim of this article is to complicate this historical narrative. We argue that in the 1980s, the study of experimentation was carried out not by one movement with one particular aim but rather in a diverse and open-ended way by people with different aims and backgrounds. (...) We then argue that from the late 1990s onward, this diversity disappeared and made room for disciplinary divisions—questions concerning experimentation became philosophical, others sociological, and so on. The reason for this, we claim, was that science and technology studies, philosophy of technology, and philosophy of science took over aspects of the 1980s study of experimentation. In this way, we argue, these elements became institutionalized, whereas others were forgotten. The importance of this process of institutionalization is illustrated by means of a discussion of other, similar approaches to the philosophy of experimentation that have not been able to ensure continuity because they did not find an institutional home. (shrink)

The modern abundance and prominence of data have led to the development of “data science” as a new field of enquiry, along with a body of epistemological reflections upon its foundations, methods, and consequences. This article provides a systematic analysis and critical review of significant open problems and debates in the epistemology of data science. We propose a partition of the epistemology of data science into the following five domains: (i) the constitution of data science; (ii) the kind of enquiry (...) that it identifies; (iii) the kinds of knowledge that data science generates; (iv) the nature and epistemological significance of “black box” problems; and (v) the relationship between data science and the philosophy of science more generally. (shrink)

In the quest to discover the neural bases of cognition, rigorous behavioral tools are equally as important as sophisticated tools for neural intervention. This paper evaluates several episodes in the development of a novel behavioral tool for rodent cognitive testing, the rodent touchscreen operant chamber. Using conceptual tools on offer in the philosophical literature on exploratory experimentation and control, I illuminate how optimization of this behavioral tool and an understanding of the causal knowledge it may be used to generate historically (...) has involved dynamic interplay between community-driven exploratory practices operating in parallel with causal hypothesis-driven research. (shrink)

Sometimes inquirers may rationally pursue a theory even when the available evidence does not favor that theory over others. Features of a theory that favor pursuing it are known as considerations of promise or pursuitworthiness. Examples of such reasons include that a theory is testable, that it has a useful associated analogy, and that it suggests new research and experiments. These reasons need not be evidence in favor of the theory. This raises the question: what kinds of reasons are provided (...) by pursuitworthiness considerations? Are they epistemic reasons or practical reasons? I argue that pursuitworthiness considerations are a kind of non-evidential epistemic reason, which I call an inquisitive reason. In support of this, I first point out two important similarities between the traditional pursuitworthiness considerations discussed in philosophy of science, which I call promise reasons, and certain social epistemic reasons that I call social inquisitive reasons. Specifically, both kinds of reason (1) favor pursuing a theory in a non-evidential way, and (2) concern promoting successful inquiry. I then propose recognition of a new category of normative reason: inquisitive reasons. This category contains both promise and social inquisitive reasons. Finally, I argue that inquisitive reasons share three essential features with previously recognized epistemic reasons: a connection to epistemic aims, explanatory independence, and the presence of a specific right-kind/wrong-kind reasons distinction. Each of these features have been used to argue that evidence should be treated as part of a distinct, independent domain of epistemic normativity. Since inquisitive reasons share these features, they too should be considered part of this independent epistemic domain. Thus, inquisitive reasons, including pursuitworthiness considerations, are epistemic reasons. (shrink)

This dissertation is about human knowledge of reality. In particular, it argues that scientific knowledge is bounded by historically available instruments and theories; nevertheless, the use of several independent instruments and theories can provide access to the persistent potentialities of reality. The replicability of scientific observations and experiments allows us to obtain explorable evidence of robust entities and properties. The dissertation includes seven chapters. It also studies three cases – namely, Higgs bosons and hypothetical Ϝ-particles (section 2.4), the Ptolemaic and (...) Kepler model of the planets (section 6.7), and the special theory of relativity (chapter 7). -/- Chapter 1 is the introduction of the dissertation. Chapter 2 clarifies the notion of the real on the basis of two concepts: persistence and resistance. These concepts enable me to explain my ontological belief in the real potentialities of human-independent things and the implications of this view for the perceptual and epistemological levels of discussion. On the basis of the concept of “overlapping perspectives”, chapter 3 argues that entity realism and perspectivism are complementary. That is, an entity that manifests itself through several experimental/observational methods is something real, but our knowledge of its nature is perspectival. Critically studying the recent views of entity realism, chapter 4 extends the discussion of entity realism and provides a criterion for the reality of property tokens. Chapter 5, in contrast, develops the perspectival aspects of my view on the basis of the phenomenological-hermeneutical approaches to the philosophy of science. This chapter also elaborates my view of empirical evidence, as briefly expressed in sections 2.5 and 4.5. Chapter 6 concerns diachronic theoretical perspectives. It first explains my view of progress, according to which current perspectives are broader than past ones. Second, it argues that the successful explanations and predictions of abandoned theories can be accounted for from our currently acceptable perspectives. The case study of Ptolemaic astronomy supports the argument of this chapter. Chapter 7 serves as the conclusion of the dissertation by applying the central themes of the previous chapters to the case study of special relativity theory. I interpret frame-dependent properties, such as length and time duration, and the constancy of the speed of light according to realist perspectivism. (shrink)

While the term “reactivity” has come to be associated with specific phenomena in the social sciences, having to do with subjects’ awareness of being studied, this paper takes a broader stance on this concept. I argue that reactivity is a ubiquitous feature of the psychological subject matter and that this fact is a precondition of experimental research, while also posing potential problems for the experimenter. The latter are connected to the worry about distorted data and experimental artifacts. But what are (...) experimental artifacts and what is the most productive way of dealing with them? In this paper, I approach these questions by exploring the ways in which experimenters in psychology simultaneously exploit and suppress the reactivity of their subject matter in order to produce experimental data that speak to the question or subject matter at hand. Highlighting the artificiality of experimental data, I raise the question of what distinguishes a genuine experimental result from an experimental artifact. My analysis construes experimental results as the outcomes of inferences from the data that take material background assumptions as auxiliary premises. Artifacts occur when one or more of these background assumptions are false, such that the data do not reliably serve the purposes they were generated for. I conclude by laying out the ways in which my analysis of data quality is relevant to, and informed by, recent debates about the replicability of experimental results. (shrink)

This thesis has two goals. Firstly, we consider the problem of model selection for the purposes of prediction. In modern science predictive mathematical models are ubiquitous and can be found in such diverse fields as weather forecasting, economics, ecology, mathematical psychology, sociology, etc. It is often the case that for a given domain of inquiry there are several plausible models, and the issue then is how to discriminate between them – this is the problem of model selection. We consider approaches (...) to model selection that are used in classical [also known as frequentist] statistics, and fashionable in recent years methods of Akaike Information Criterion [AIC] and Bayes Information Criterion [BIC], the latter being a part of a broader Bayesian approach. We show the connection between AIC and BIC, and provide comparison of performance of these methods. Secondly, we consider some philosophical arguments that arise within the setting of the model selection approaches investigated in the first part. These arguments aim to provide counterexamples to the epistemic thesis of scientific realism, viz., that predictively successful scientific theories are approximately true, and to the idea that truth and predictive accuracy go together. We argue for the following claims: 1) that none of the criticisms brought forward in the philosophical literature against the AIC methodology are devastating, and AIC remains a viable method of model selection; 2) that the BIC methodology likewise survives the numerous criticisms; 3) that the counterexamples to scientific realism that ostensibly arise within the framework of model selection are flawed; 4) that in general the model selection methods discussed in this thesis are neutral with regards to the issue of scientific realism; 5) that a plurality of methodologies should be applied to the problem of model selection with full awareness of the foundational issues that each of these methodologies has. (shrink)

The history of statistics is filled with many controversies, in which the prime focus has been the difference in the “interpretation of probability” between Fre- quentist and Bayesian theories. Many philosophical arguments have been elabo- rated to examine the problems of both theories based on this dichotomized view of statistics, including the well-known stopping-rule problem and the catch-all hy- pothesis problem. However, there are also several “hybrid” approaches in theory, practice, and philosophical analysis. This poses many fundamental questions. This paper (...) reviews three cases and argues that the interpretation problem of probabil- ity is insufficient to begin a philosophical analysis of the current issues in the field of statistics. A novel viewpoint is proposed to examine the relationship between the stopping-rule problem and the catch-all hypothesis problem. (shrink)

The anti-metaphysical argument against scientific realism is the following: Knowledge of unobservable entities implies metaphysical knowledge; There is no metaphysical knowledge. Therefore, there is no knowledge of unobservable entities. This argument has strangely received little attention in the profuse literature on scientific realism. This paper claims that the AMA is logically more fundamental than both the pessimistic meta-induction and the underdetermination argument. The second and main claim of this paper is that the instrumentalists’ use of AMA is incoherent. The gist (...) of my argument is that experimental knowledge requires minimally metaphysical knowledge, and that minimally metaphysical knowledge—when associated with empirical knowledge—suffices to yield a minimal knowledge of the unobservable. I then examine and reject two possible responses: minimally metaphysical instrumentalism and algebraic instrumentalism. (shrink)

The debates between Bayesian, frequentist, and other methodologies of statistics have tended to focus on conceptual justifications, sociological arguments, or mathematical proofs of their long run properties. Both Bayesian statistics and frequentist (“classical”) statistics have strong cases on these grounds. In this article, we instead approach the debates in the “Statistics Wars” from a largely unexplored angle: simulations of different methodologies’ performance in the short to medium run. We conducted a large number of simulations using a straightforward decision problem based (...) around tossing a coin with unknown bias and then placing bets. In this simulation, we programmed four players, inspired by Bayesian statistics, frequentist statistics, Jon Williamson’s version of Objective Bayesianism, and a player who simply extrapolates from observed frequencies to general frequencies. The last player functions as a benchmark: a statistical methodology should at least outperform a crude form of induction. We focused on the performance of these methodologies in guiding the players towards good decisions. Unlike an earlier simulation study of this type, we found no systematic difference in performance between the Bayesian and frequentist players, provided the Bayesian used a flat prior and the frequentist used a low confidence level. Unlike that study, we were able to use Big Data methods to mitigate problems of random error in the simulation results. The Williamsonian player, who is a novel element of our study, also had no systematic differences in their performance, provided that they use a low confidence level. These players performed similarly even in the very short run, when players were making different decisions. Our study indicates that all three methodologies should be taken seriously by philosophers and practitioners of statistics. However, the frequentist and Williamsonian performed poorly when their confidence levels were high, and the Bayesian was surprisingly harmed by biased priors, providing some unexpected lessons for these methodologies when facing this type of decision problem. (shrink)

We show that if among the tested hypotheses the number of true hypotheses is not equal to the number of false hypotheses, then Neyman-Pearson theory of testing hypotheses does not warrant minimal epistemic reliability. We also argue that N-P does not protect from the possible negative effects of the pragmatic value-laden unequal setting of error probabilities on N-P’s epistemic reliability. Most importantly, we argue that in the case of a negative impact no methodological adjustment is available to neutralize it, so (...) in such cases the discussed pragmatic-value-ladenness of N-P inevitably compromises the goal of attaining truth. (shrink)

Ian Hacking’s Representing and Intervening is often credited as being one of the first works to focus on the role of experimentation in philosophy of science, catalyzing a movement which is sometimes called the “philosophy of experiment” or “new experimentalism”. In the 1980s, a number of other movements and scholars also began focusing on the role of experimentation and instruments in science. Philosophical study of experimentation has thus seemed to be an invention of the 1980s whose central figure is Hacking. (...) This article aims to assess this historical claim, made by Hacking himself as well as others. It does so first by highlighting how a broader perspective on the history of philosophy reveals this invention narrative to be incorrect, since experimentation was a topic of interest for earlier philosophers. Secondly, the article evaluates a revision of this historical claim also made by some philosophers of experiment: the rediscovery narrative, which frames Hacking and others as having rediscovered the work of these earlier authors. This second narratives faces problems as well. Therefore we develop a third narrative which we call the contextualist narrative. Rather than considering experimentation in an essentialist manner as a fixed research object that is either present or not in the work of specific authors, experimentation should be addressed through a narrative that asks in what way it becomes a philosophical problem for certain authors and for what purpose. Such contextualization enables a repositioning of Hacking’s philosophy of experiment in relation to the specific debates in which he intervened, such as the realism-antirealism debate, the Science Wars and the debate on incommensurability. (shrink)

The practice of HARKing---hypothesizing after results are known---is commonly maligned as undermining the reliability of scientific findings. There are several accounts in the literature as to why HARKing undermines the reliability of findings. We argue that none of these is right and that the correct account is a Bayesian one. HARKing can indeed decrease the reliability of scientific findings, but it can also increase it; which effect HARKing produces depends on the difference of the prior odds of hypotheses characteristically selected (...) ex ante and ex post to observing data. Further, we show how misdiagnosis of HARKing can lead to misprescription in the context of the replication crisis. (shrink)

Ian Hacking instigated a revolution in 20th century philosophy of science by putting experiments (“interventions”) at the top of a philosophical agenda that historically had focused nearly exclusively on representations (“theories”). In this paper, I focus on a set of conceptual tools Hacking (1992) put forward to understand how laboratory sciences become stable and to explain what such stability meant for the prospects of unity of science and kind discovery in experimental science. I first use Hacking’s tools to understand sources (...) of instability and disunity in rodent behavioral neuroscience. I then use them to understand recent grass-roots collaborative open science initiatives aimed at establishing stability in this research area and tease out some implications for unity of science and kind creation and discovery in cognitive neuroscience. -/- . (shrink)

The use of multiple means of determination to “triangulate” on the existence and character of a common phenomenon, object, or result has had a long tradition in science but has seldom been a matter of primary focus. As with many traditions, it is traceable to Aristotle, who valued having multiple explanations of a phenomenon, and it may also be involved in his distinction between special objects of sense and common sensibles. It is implicit though not emphasized in the distinction between (...) primary and secondary qualities from Galileo onward. It is arguably one of several conceptions involved in Whewell’s method of the “consilience of inductions” (Laudan 1971) and is to be found in several places in Peirce. (From M. Brewer and B. Collins, eds., (1981); Scientific Inquiry in the Social Sciences (a festschrift for Donald T. Campbell), San Francisco: Jossey-Bass, pp. 123–162.). (shrink)

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but not always, epistemically pernicious. Our argument requires a novel understanding of Bayesianism, since a standard criticism of Bayesian confirmation theory is that it cannot represent the influence of biased methods. We then turn to pre-analysis plans, a methodological device used to mitigate p-hacking. Some say that (...) pre-analysis plans are epistemically meritorious while others deny this, and in practice pre-analysis plans are often violated. We resolve this debate with a modest defence of pre-analysis plans. Further, we argue that pre-analysis plans can be epistemically relevant even if the plan is not strictly followed—and suggest that allowing for flexible pre-analysis plans may be the best available policy option. (shrink)

Scientists represent their world, grouping and organizing phenomena into classes by means of concepts. Philosophers of science have historically been interested in the nature of these concepts, the criteria that inform their application and the nature of the kinds that the concepts individuate. They also have sought to understand whether and how different systems of classification are related and more recently, how investigative practices shape conceptual development and change. Our aim in this paper is to provide a critical overview of (...) some of the key developments in this philosophical literature and identify some interesting issues it raises about the prospects of the so-called “special sciences”, including psychiatry, psychology, and the mind-brain sciences more generally, to discover natural kinds. (shrink)

Large scale experiments at CERN’s Large Hadron Collider rely heavily on computer simulations, a fact that has recently caught philosophers’ attention. CSs obviously require appropriate modeling, and it is a common assumption among philosophers that the relevant models can be ordered into hierarchical structures. Focusing on LHC’s ATLAS experiment, we will establish three central results here: with some distinct modifications, individual components of ATLAS’ overall simulation infrastructure can be ordered into hierarchical structures. Hence, to a good degree of approximation, hierarchical (...) accounts remain valid at least as descriptive accounts of initial modeling steps. In order to perform the epistemic function Winsberg Model-based reasoning in scientific discovery. Kluwer Academic/plenum Publishers, New York, pp 255–269, 1999) assigns to models in simulation—generate knowledge through a sequence of skillful but non-deductive transformations—ATLAS’ simulation models have to be considered part of a network rather than a hierarchy, in turn making the associated simulation modeling messy rather than motley. Deriving knowledge-claims from this ‘mess’ requires two sources of justification: holistic validation :253–262, 2010; in Carrier M, Nordmann A Science in the context of application. Springer, Berlin, pp 115–130, 2011), and model coherence. As it turns out, the degree of model coherence sets HEP apart from other messy, simulation-intensive disciplines such as climate science, and the reasons for this are to be sought in the historical, empirical and theoretical foundations of the respective discipline. (shrink)

The question of where, between theory and experiment, computer simulations (CSs) locate on the methodological map is one of the central questions in the epistemology of simulation (cf. Saam Journal for General Philosophy of Science, 48, 293–309, 2017). The two extremes on the map have them either be a kind of experiment in their own right (e.g. Barberousse et al. Synthese, 169, 557–574, 2009; Morgan 2002, 2003, Journal of Economic Methodology, 12(2), 317–329, 2005; Morrison Philosophical Studies, 143, 33–57, 2009; Morrison (...) 2015; Massimi and Bhimji Studies in History and Philosophy of Science Part B: Studies in History and Philosophy of Modern Physics, 51, 71–81, 2015; Parker Synthese, 169, 483–496, 2009) or just an argument executed with the aid of a computer (e.g. Beisbart European Journal for Philosophy of Science, 2, 395–434, 2012; Beisbart and Norton International Studies in the Philosophy of Science, 26, 403–422, 2012). There exist multiple versions of the first kind of position, whereas the latter is rather unified. I will argue that, while many claims about the ‘experimental’ status of CSs seem unjustified, there is a variant of the first position that seems preferable. In particular I will argue that while CSs respect the logic of (deductively valid) arguments, they neither agree with their pragmatics nor their epistemology. I will then lay out in what sense CSs can fruitfully be seen as experiments, and what features set them apart from traditional experiments nonetheless. I conclude that they should be seen as surrogate experiments, i.e. experiments executed consciously on the wrong kind of system, but with an exploitable connection to the system of interest. Finally, I contrast my view with that of Beisbart (European Journal for Philosophy of Science, 8, 171–204, 2018), according to which CSs are surrogates for experiments, arguing that this introduces an arbitrary split between CSs and other kinds of simulations. (shrink)

Biased research occurs frequently in the sciences. In this paper, I will focus on one particular kind of biased research: research that is subject to sponsorship bias. I will address the following epistemological question: what precisely is epistemically wrong with biased research of this kind? I will defend the evidential account of epistemic wrongness: that is, research affected by sponsorship bias is epistemically wrong if and only if the researchers in question make false claims about the evidential support of some (...) hypothesis H by data E. I will argue that the evidential account captures the epistemic wrongness of three paradigmatic types of sponsorship bias. (shrink)

The French physicist Jean Baptiste Perrin is widely credited with providing the conclusive argument for atomism. The most well-known part of Perrin’s argument is his description of thirteen different procedures for determining Avogadro’s number (N)–the number of atoms, ions, and molecules contained in a gram-atom, gram-ion, and gram-mole of a substance, respectively. Because of its success in ending the atomism debates Perrin’s argument has been the focus of much philosophical interest. The various philosophers, however, have reached different conclusions, not only (...) about the argument’s general rationale but also the role that the multiple determination of N played in it. This paper emphasizes the historical development of Perrin’s experimental work in order to understand the role that the multiple determination of molecular magnitudes played in his argument for molecular reality. It claims that Perrin used the multiple determination strategy to put forward an exceptionally strong no-coincidence argument to argue for both the correctness of the values for the molecular magnitudes determined and the validity of the auxiliary assumptions upon which the different determinations were based. The historicist approach also allows the identification of the elements responsible for the epistemic strength of Perrin’s no-coincidence argument. (shrink)

I propose a framework that explicates and distinguishes the epistemic roles of data and models within empirical inquiry through consideration of their use in scientific practice. After arguing that Suppes’ characterization of data models falls short in this respect, I discuss a case of data processing within exploratory research in plant phenotyping and use it to highlight the difference between practices aimed to make data usable as evidence and practices aimed to use data to represent a specific phenomenon. I then (...) argue that whether a set of objects functions as data or models does not depend on intrinsic differences in their physical properties, level of abstraction or the degree of human intervention involved in generating them, but rather on their distinctive roles towards identifying and characterizing the targets of investigation. The paper thus proposes a characterization of data models that builds on Suppes’ attention to data practices, without however needing to posit a fixed hierarchy of data and models or a highly exclusionary definition of data models as statistical constructs. (shrink)

We introduce a new type of pluralism about biological function that, in contrast to existing, demonstrates a practical integration among the term’s different meanings. In particular, we show how to generalize Sandra Mitchell’s notion of integrative pluralism to circumstances where multiple epistemic tools of the same type are jointly necessary to solve scientific problems. We argue that the multiple definitions of biological function operate jointly in this way based on how biologists explain the evolution of protein function. To clarify how (...) our account relates to existing views, we introduce a general typology for monist and pluralist accounts along with standardized criteria for judging which is best supported by evidence. (shrink)

This article examines how problems of validity in empirical social research differ from those in natural science. Specifically, we focus on how some ontological peculiarities of the object of study in social science bear on validity requirements. We consider these issues in experimental validity as well as in test validity because, while both fields hold large intellectual traditions, research tests or questionnaires are less closely connected to natural science methodology than experiments.

Abstract : A measurement result is never absolutely accurate: it is affected by an unknown “measurement error” which characterizes the discrepancy between the obtained value and the “true value” of the quantity intended to be measured. As a consequence, to be acceptable a measurement result cannot take the form of a unique numerical value, but has to be accompanied by an indication of its “measurement uncertainty”, which enunciates a state of doubt. What, though, is the value of measurement uncertainty? What (...) is its numerical value: how does one calculate it? What is its epistemic value: how one should interpret a measurement result? Firstly, we describe the statistical models that scientists make use of in contemporary metrology to perform an uncertainty analysis, and we show that the issue of the interpretation of probabilities is vigorously debated. This debate brings out epistemological issues about the nature and function of physical measurements, metrologists insisting in particular on the subjective aspect of measurement. Secondly, we examine the philosophical elaboration of metrologists in their technical works, where they criticize the use of the notion of “true value” of a physical quantity. We then challenge this elaboration and defend such a notion. The third part turns to a specific use of measurement uncertainty in order to address our thematic from the perspective of precision physics, considering the activity of the adjustments of physical constants. In the course of this activity, physicists have developed a dynamic conception of the accuracy of their measurement results, oriented towards a future progress of knowledge, and underlining the epistemic virtues of a never-ending process of identification and correction of measurement errors. (shrink)

Pierre Duhem’s influential argument for holism relies on a view of the role that background theory plays in testing: according to this still common account of “auxiliary hypotheses,” elements of background theory serve as truth-apt premises in arguments for or against a hypothesis. I argue that this view is mistaken. Rather than serving as truth-apt premises in arguments, auxiliary hypotheses are employed as “epistemic tools”: instruments that perform specific tasks in connecting our theoretical questions with the world but that are (...) not premises in arguments. On the resulting picture, the acceptability of an auxiliary hypothesis depends not on its truth but on contextual factors such as the task or purpose it is put to and the other tools employed alongside it. (shrink)

Several developments for diverse scientific goals, mostly in physics and physiology, had to take place, which eventually gave us fMRI as one of the central research paradigms of contemporary cognitive neuroscience. This technique stands on solid foundations established by the physics of magnetic resonance and the physiology of hemodynamics and is complimented by computational and statistical techniques. I argue, and support using concrete examples, that these foundations give rise to a productive theory-ladenness in fMRI, which enables researchers to identify and (...) control for the types of methodological and inferential errors. Consequently, this makes it possible for researchers to represent and investigate cognitive phenomena in terms of hemodynamic data and for experimental knowledge to grow independently of large scale theories of cognition. (shrink)

The remarkable transition from helpless infant to sophisticatedfive-year-old has long captured the attention of scholars interested inthe discovery of knowledge. To explain these achievements, developmentalpsychologists often compare children's discovery procedures to those ofprofessional scientists. For the child to be qualified as a ``littlescientist'', however, intellectual development must be shown to derivefrom rational hypothesis selection in the face of evidence. In thepresent paper we focus on one dimension of rational theory-choice,namely, the relation between hypothesis confirmation and evidencediversity. Psychological research suggests cultural (...) variability inappreciating evidence diversity and lack of such appreciation by youngchildren. Before reaching conclusions about the ``little scientist''thesis, however, it is essential to normatively analyze the diversityissue. We undertake such an analysis within a Bayesianperspective. (shrink)

The replication crisis has prompted many to call for statistical reform within the psychological sciences. Here we examine issues within Frequentist statistics that may have led to the replication crisis, and we examine the alternative—Bayesian statistics—that many have suggested as a replacement. The Frequentist approach and the Bayesian approach offer radically different perspectives on evidence and inference with the Frequentist approach prioritising error control and the Bayesian approach offering a formal method for quantifying the relative strength of evidence for hypotheses. (...) We suggest that rather than mere statistical reform, what is needed is a better understanding of the different modes of statistical inference and a better understanding of how statistical inference relates to scientific inference. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.

Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, (...) and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

Classical statistical inferences have been criticised for various reasons. To assess the soundness of such criticisms is a very important task because they are widely used in everyday scientific research. This is one of the reasons why the philosophy of statistics is an exciting field of study. In this paper, I focus on two such criticisms. The first one claims that the use of the p-value violates the principle of total evidence. It is a thesis that has been defended by (...) Elliott Sober and Bengt Autzen. The second one says that the result of classical tests does not only depend on the data but on the sampling plan of the experimenter also. The underlying criticism of course is that the sampling plan is not part of the evidence and that classical tests therefore violate PTE. The intentions of the experimenter should not affect the result of an inference. My aim is to show that both criticisms are unsound. Doing so, I hope to clarify the concept of p-value and the nature of the evidence in classical statistical tests. The point of my paper is to show that the identification of the evidence on which those criticisms rest is inadequate. (shrink)

When the results of an experiment appears to disconfirm a hypothesis, how does one know whether it’s the hypothesis, or rather some auxiliary hypothesis or assumption, that is at fault? Philosophers’ answers to this question, now known as “Duhem’s problem,” have differed widely. Despite these differences, we affirm Duhem’s original position that the logical structure of this problem alone does not allow a solution. A survey of philosophical approaches to Duhem’s problem indicates that what allows any philosopher, or scientists for (...) that matter, to solve this problem is the addition of epistemic information that guides their assignment of praise and blame after a negative test. We therefore advocate a distinction between the logical and epistemic formulations of Duhem’s problem, the latter relying upon additional relevant information about the system being tested. Recognition of the role of this additional information suggests that some proposed solutions to the epistemic form of Duhem’s problem are preferable over others. (shrink)

Subjective Bayesianism is a major school of uncertain reasoning and statistical inference. It is often criticized for a lack of objectivity: it opens the door to the influence of values and biases, evidence judgments can vary substantially between scientists, it is not suited for informing policy decisions. My paper rebuts these concerns by connecting the debates on scientific objectivity and statistical method. First, I show that the above concerns arise equally for standard frequentist inference with null hypothesis significance tests. Second, (...) the criticisms are based on specific senses of objectivity with unclear epistemic value. Third, I show that Subjective Bayesianism promotes other, epistemically relevant senses of scientific objectivity—most notably by increasing the transparency of scientific reasoning. (shrink)

Statistical reasoning is an integral part of modern scientific practice. In The Seven Pillars of Statistical Wisdom Stephen Stigler presents seven core ideas, or pillars, of statistical thinking and the historical developments of each of these pillars, many of which were concurrent with developments in biology. Here we focus on Stigler’s fifth pillar, regression, and his discussion of how regression to the mean came to be thought of as a solution to a challenge for the theory of natural selection. Stigler (...) argues that the purely mathematical phenomenon of regression to the mean provides a resolution to a problem for Darwin’s evolutionary theory. Thus, he argues that the resolution to the problem for Darwin’s theory is purely mathematical, rather than causal. We show why this argument is problematic. (shrink)

Evidential holism begins with something like the claim that “it is only jointly as a theory that scientific statements imply their observable consequences.” This is the holistic claim that Elliott Sober tells us is an “unexceptional observation”. But variations on this “unexceptional” claim feature as a premise in a series of controversial arguments for radical conclusions, such as that there is no analytic or synthetic distinction that the meaning of a sentence cannot be understood without understanding the whole language of (...) which it is a part and that all knowledge is empirical knowledge. This paper is a survey of what evidential holism is, how plausible it is, and what consequences it has. Section 1 will distinguish a range of different holistic claims, Sections 2 and 3 explore how well motivated they are and how they relate to one another, and Section 4 returns to the arguments listed above and uses the distinctions from the previous sections to identify holism's role in each case. (shrink)

The philosophical or theoretical commitments informing psychological research are sometimes characterized, even by theoretical psychologists themselves, as nonempirical, outside the bounds of methodological consideration, and/or nonrational. We argue that this characterization is incoherent. We illustrate our concern by analogy with problematic appeals to Kuhn’s work that have been influential in theoretical psychology. Following the contemporary pragmatist tradition, we argue that our philosophical/theoretical commitments are part of our larger webs of belief, and that for any of these beliefs to have meaning (...) their content must be informed by our practical engagement with the world, i.e., they are based on empirical evidence, broadly construed. It is this empirical basis that allows us to recognize our commitments at all and rationally to assess and criticize them when necessary. We conclude by demonstrating a rational assessment of the philosophical/theoretical commitments underlying a recent study in the social psychology of religion. (shrink)

Although sciences are often conceptualized in terms of theory confirmation and hypothesis testing, an equally important dimension of scientific reasoning is the structure of problems that guide inquiry. This problem structure is evident in several concepts central to evolutionary developmental biology (Evo-devo)—constraints, modularity, evolvability, and novelty. Because problems play an important role in biological practice, they should be included in biological pedagogy, especially when treating the issue of scientific controversy. A key feature of resolving controversy is synthesizing methodologies from different (...) biological disciplines to generate empirically adequate explanations. Concentrating on problem structure illuminates this interdisciplinarity in a way that is often ignored when science is taught only from the perspective of theory or hypothesis. These philosophical considerations can assist life science educators in their continuing quest to teach biology to the next generation. -/- . (shrink)

According to influential accounts of scientific method, such as critical rationalism, scientific knowledge grows by repeatedly testing our best hypotheses. But despite the popularity of hypothesis tests in statistical inference and science in general, their philosophical foundations remain shaky. In particular, the interpretation of non-significant results—those that do not reject the tested hypothesis—poses a major philosophical challenge. To what extent do they corroborate the tested hypothesis, or provide a reason to accept it? Popper sought for measures of corroboration that could (...) adequately answer this question. According to Popper, corroboration is different from probability-raising, and grounded in the predictive success and testability of a hypothesis. As such, corroboration becomes an indicator of the scientific value of a hypothesis and guides our practical preferences over hypotheses that have been subjected to severe tests. This article proves two impossibility results for corroboration measures based on statistical relevance. The generality of these results shows that Popper’s qualitative characterization of corroboration must be misguided. I explore what a more promising and scientifically useful concept of corroboration could look like. (shrink)

To study climate change, scientists employ computer models, which approximate target systems with various levels of skill. Given the imperfection of climate models, how do scientists use simulations to generate knowledge about the causes of observed climate change? Addressing a similar question in the context of biological modelling, Levins (1966) proposed an account grounded in robustness analysis. Recent philosophical discussions dispute the confirmatory power of robustness, raising the question of how the results of computer modelling studies contribute to the body (...) of evidence supporting hypotheses about climate change. Expanding on Staley’s (2004) distinction between evidential strength and security, and Lloyd’s (2015) argument connecting variety-of-evidence inferences and robustness analysis, I address this question with respect to recent challenges to the epistemology robustness analysis. Applying this epistemology to case studies of climate change, I argue that, despite imperfections in climate models, and epistemic constraints on variety-of-evidence reasoning and robustness analysis, this framework accounts for the strength and security of evidence supporting climatological inferences, including the finding that global warming is occurring and its primary causes are anthropogenic. (shrink)

I argue that scientific realism, insofar as it is only committed to those scientific posits of which we have causal knowledge, is immune to Kyle Stanford’s argument from unconceived alternatives. This causal strategy is shown not to repeat the shortcomings of previous realist responses to Stanford’s argument. Furthermore, I show that the notion of causal knowledge underlying it can be made sufficiently precise by means of conceptual tools recently introduced into the debate on scientific realism. Finally, I apply this strategy (...) to the case of Jean Perrin’s experimental work on the atomic hypothesis, disputing Stanford’s claim that the problem of unconceived alternatives invalidates a realist interpretation of this historical episode. 1 Stanford’s Argument from Unconceived Alternatives2 Previous Attempts to Undermine the Problem of Unconceived Alternatives2.1 The plausibility of unconceived alternatives2.2 The distinctness of unconceived alternatives2.3 The induction from past to present3 Causal Knowledge as a Criterion for the Realist3.1 How Chakravartty’s proposal differs from earlier causal strategies3.2 Causal realism and the detection/auxiliary distinction4 Causal Realism, Unconceived Alternatives, and the Atomic Hypothesis4.1 Perrin and the philosophers: some initial observations4.2 Roush and Stanford on Perrin4.3 From Brownian motion to the reality of atoms4.4 What we know about atoms5 Conclusion. (shrink)

As climate policy decisions are decisions under uncertainty, being based on a range of future climate change scenarios, it becomes a crucial question how to set up this scenario range. Failing to comply with the precautionary principle, the scenario methodology widely used in the Third Assessment Report of the International Panel on Climate Change (IPCC) seems to violate international environmental law, in particular a provision of the United Nations Framework Convention on Climate Change. To place climate policy advice on a (...) sound methodological basis would imply that climate simulations which are based on complex climate models had, in stark contrast to their current hegemony, hardly an epistemic role to play in climate scenario analysis at all. Their main function might actually consist in ‘foreseeing future ozone-holes’. In order to argue for these theses, I explain first of all the plurality of climate models used in climate science by the failure to avoid the problem of underdetermination. As a consequence, climate simulation results have to be interpreted as modal sentences, stating what is possibly true of our climate system. This indicates that climate policy decisions are decisions under uncertainty. Two general methodological principles which may guide the construction of the scenario range are formulated and contrasted with each other: modal inductivism and modal falsificationism. I argue that modal inductivism, being the methodology implicitly underlying the third IPCC report, is severely flawed. Modal falsificationism, representing the sound alternative, would in turn require an overhaul of the IPCC practice. (shrink)

Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bioinformatics, where classical methods from mathematical optimization fail. (...) Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo's learning model. (shrink)

The function and legitimacy of values in decision making is a critically important issue in the contemporary analysis of science. It is particularly relevant for some of the more application-oriented areas of science, specifically decision-oriented science in the field of regulation of technological risks. Our main objective in this paper is to assess the diversity of roles that non-cognitive values related to decision making can adopt in the kinds of scientific activity that underlie risk regulation. We start out, first, by (...) analyzing the issue of values with the help of a framework taken from the wider philosophical debate on science and values. Second, we study the principal conceptualizations used by scholars who have applied them to numerous case studies. Third, we appraise the links between those conceptualizations and learning processes in decision-oriented science. In this, we recur to the concept of methodological learning, i.e., learning about the best methodologies for generating knowledge that is useful for science-based regulatory decisions. The main result of our analysis is that non-cognitive values can contribute to methodological improvements in science in three principal ways: as basis for critical analysis, for contextualizing methodologies, and for establishing the burden of proof. (shrink)

In this article, I argue that arguments from the history of science against scientific realism, like the arguments advanced by P. Kyle Stanford and Peter Vickers, are fallacious. The so-called Old Induction, like Vickers's, and New Induction, like Stanford's, are both guilty of confirmation bias—specifically, of cherry-picking evidence that allegedly challenges scientific realism while ignoring evidence to the contrary. I also show that the historical episodes that Stanford adduces in support of his New Induction are indeterminate between a pessimistic and (...) an optimistic interpretation. For these reasons, these arguments are fallacious, and thus do not pose a serious challenge to scientific realism. (shrink)

There has been a probabilistic turn in contemporary cognitive science. Far and away, most of the work in this vein is Bayesian, at least in name. Coinciding with this development, philosophers have increasingly promoted Bayesianism as the best normative account of how humans ought to reason. In this paper, we make a push for exploring the probabilistic terrain outside of Bayesianism. Non-Bayesian, but still probabilistic, theories provide plausible competitors both to descriptive and normative Bayesian accounts. We argue for this general (...) idea via recent work on explanationist models of updating, which are fundamentally probabilistic but assign a substantial, non-Bayesian role to explanatory considerations. (shrink)