Prediction in Science

In this paper, I critically evaluate several related, provocative claims made by proponents of data-intensive science and “Big Data” which bear on scientific methodology, especially the claim that scientists will soon no longer have any use for familiar concepts like causation and explanation. After introducing the issue, in section 2, I elaborate on the alleged changes to scientific method that feature prominently in discussions of Big Data. In section 3, I argue that these methodological claims are in tension with a (...) prominent account of scientific method, often called “Inference to the Best Explanation” (IBE). Later on, in section 3, I consider an argument against IBE that will be congenial to proponents of Big Data, namely the argument due to Roche and Sober (2013) that “explanatoriness is evidentially irrelevant”. This argument is based on Bayesianism, one of the most prominent general accounts of theory-confirmation. In section 4, I consider some extant responses to this argument, especially that of Climenhaga (2017). In section 5, I argue that Roche and Sober’s argument does not show that explanatory reasoning is dispensable. In section 6, I argue that there is good reason to think explanatory reasoning will continue to prove indispensable in scientific practice. Drawing on Cicero’s oft-neglected De Divinatione, I formulate what I call the “Ciceronian Causal-nomological Requirement”, (CCR), which states roughly that causal-nomological knowledge is essential for relying on correlations in predictive inference. I defend a version of the CCR by appealing to the challenge of “spurious correlations”, chance correlations which we should not rely upon for predictive inference. In section 7, I offer some concluding remarks. (shrink)

There is a middle ground of imperfect knowledge in fields like medicine and the social sciences. It stands between our day-to-day relatively certain knowledge obtained from ordinary basic observation of regularities in our world and our knowledge from well-validated theories in the physical sciences. -/- The latter enable reliable prediction a great deal of the time of the happening of events never before experienced. The former enable prediction only of what has happened before and beyond that of educated guesses which (...) may sometimes prove right and others not when we test them. -/- The imperfection of our knowledge between those limits is a consequence of complexity. -/- Reductionist empiricism fails when faced with complexity but we all still have to live in a complex world where reductionist science cannot help us devise reliable theories from which we can predict the behaviour of the world around us. We cannot predict reliably. We can only monitor actively and manage actively the world around us if we want to try to control our environment. We have a limited prediction horizon. -/- Science and empiricism work well if we want to send Voyager I and II over 3 billion miles away but not for most other things. -/- In medicine how and when to apply probabilistic, conjectural, incomplete medical theories and explanations requires professional expertise, intuition and judgement (non scientific knowledge) which is essential. Medical diagnosis is a skill of predicting from knowledge of what has happened before that the past will recur in the current patient applying expertise and intuition from knowledge and experience of prior cases and probabilistic medical research and theory. The physician is left to an educated guess as to how the future will develop for the particular individual patient the focus of his or her current attention. (shrink)

Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove hypotheses on the basis of those results without acknowledging this process in their research report (Kerr, 1998). In the present article, I discuss three forms of HARKing: (1) using current results to construct post hoc hypotheses that are then reported as if they were a priori hypotheses; (2) retrieving hypotheses from a post hoc literature search and reporting them as a (...) priori hypotheses; and (3) failing to report a priori hypotheses that are unsupported by the current results. These three types of HARKing are often characterized as being bad for science and a potential cause of the current replication crisis. In the present article, I use insights from the philosophy of science to present a more nuanced view. Specifically, I identify the conditions under which each of these three types of HARKing is most and least likely to be bad for science. I conclude with a brief discussion about the ethics of each type of HARKing. (shrink)

In this paper, I examine Cicero’s oft-neglected De Divinatione, a dialogue investigating the legitimacy of the practice of divination. First, I offer a novel analysis of the main arguments for divination given by Quintus, highlighting the fact that he employs two logically distinct argument forms. Next, I turn to the first of the main arguments against divination given by Marcus. Here I show, with the help of modern probabilistic tools, that Marcus’ skeptical response is far from the decisive, proto-naturalistic assault (...) on superstition that it is sometimes portrayed to be. Then, I offer an extended analysis of the second of the main arguments against divination given by Marcus. Inspired by Marcus’ second main argument, I formulate, explicate, and defend a substantive principle of scientific methodology that I call the “Ciceronian Causal-Nomological Requirement” (CCR). Roughly, this principle states that causal knowledge is essential for relying on correlations in predictive inference. Although I go on to argue that Marcus’ application of the CCR in his debate with Quintus is dialectically inadequate, I conclude that De Divinatione deserves its place in Cicero’s philosophical corpus, and that ultimately, its significance for the history and philosophy of science ought to be recognized. (shrink)

We identify several ongoing debates related to implicit measures, surveying prominent views and considerations in each debate. First, we summarize the debate regarding whether performance on implicit measures is explained by conscious or unconscious representations. Second, we discuss the cognitive structure of the operative constructs: are they associatively or propositionally structured? Third, we review debates whether performance on implicit measures reflects traits or states. Fourth, we discuss the question of whether a person’s performance on an implicit measure reflects characteristics of (...) the person who is taking the test or characteristics of the situation in which the person is taking the test. Finally, we survey the debate about the relationship between implicit measures and (other kinds of) behavior. (shrink)

Several authors have claimed that prediction is essentially impossible in the general theory of relativity, the case being particularly strong, it is said, when one fully considers the epistemic predicament of the observer. Each of these claims rests on the support of an underdetermination argument and a particular interpretation of the concept of prediction. I argue that these underdetermination arguments fail and depend on an implausible explication of prediction in the theory. The technical results adduced in these arguments can be (...) related to certain epistemic issues, but can only be misleadingly or mistakenly characterized as related to prediction. (shrink)

In their critique of Klein (2014a), Trafimow and Earp present two theses. First, they argue that, contra Klein, a well-specified theory is not a necessary condition for successful replication. Second, they contend that even when there is a well-specified theory, replication depends more on auxiliary assumptions than on theory proper. I take issue with both claims, arguing that (a) their first thesis confuses a material conditional (what I said) with a modal claim (T&E’s misreading of what I said), and (b) (...) their second thesis has the unfortunate consequence of refuting their first thesis. (shrink)

It is taken for granted that the explanation of the Universe’s space-time dimension belongs to the host of the arguments that exhibit the superiority of modern (inflationary) cosmology over the standard model. In the present paper some doubts are expressed . They are based upon the fact superstring theory is too formal to represent genuine unification of general relativity and quantum field theory. Neveretheless, the fact cannot exclude the opportunity that in future the superstring theory can become more physical. Hence (...) this paper does not aim to query neither string cosmology, nor superstring theory; it asks for “tolerance in the matters cosmological”. It advices the researchers not to dwell on the common way of unification and to take into consideration the other ways as well. (shrink)

Even though social scientists continue to discuss the problems posed by self-fulfilling and self-frustrating predictions, philosophers of science have ignored the topic since the 1970s. Back then, the prevailing view was that the methodological problems posed by reflexive predictions are either minor or easily avoided. I believe that this consensus was premature, ultimately relying on an overly narrow understanding of the phenomenon. I present an improved way to understand reflexive predictions (framed in probabilistic terms) and show that, once such predictions (...) are understood this way, the methodological problems they pose may turn out to be neither minor nor easily avoided. (shrink)

WE AIM HERE to outline a theory of evidence for use. More specifically we lay foundations for a guide for the use of evidence in predicting policy effectiveness in situ, a more comprehensive guide than current standard offerings, such as the Maryland rules in criminology, the weight of evidence scheme of the International Agency for Research on Cancer (IARC), or the US ‘What Works Clearinghouse’. The guide itself is meant to be well-grounded but at the same time to give practicable (...) advice, that is, advice that can be used by policy-makers not expert in the natural and social sciences, assuming they are well-intentioned and have a reasonable but limited amount of time and resources available for searching out evidence and deliberating. (shrink)

From the early-1950s on, F.A. Hayek was concerned with the development of a methodology of sciences that study systems of complex phenomena. Hayek argued that the knowledge that can be acquired about such systems is, in virtue of their complexity (and the comparatively narrow boundaries of human cognitive faculties), relatively limited. The paper aims to elucidate the implications of Hayek’s methodology with respect to the specific dimensions along which the scientist’s knowledge of some complex phenomena may be limited. Hayek’s fallibilism (...) was an essential (if not always explicit) aspect of his arguments against the defenders of both socialism ([1935] 1948, [1940] 1948) and countercyclical monetary policy ([1975] 1978); yet, despite the fact that his conceptions of both complex phenomena and the methodology appropriate to their investigation imply that ignorance might beset the scientist in multiple respects, he never explicated all of these consequences. The specificity of a scientific prediction depends on the extent of the scientist’s knowledge concerning the phenomena under investigation. The paper offers an account of the considerations that determine the extent to which a theory’s implications prohibit the occurrence of particular events in the relevant domain. This theory of “predictive degree” both expresses and – as the phenomena of scientific prediction are themselves complex in Hayek’s sense – exemplifies the intuition that the specificity of a scientific prediction depends on the relevant knowledge available. (shrink)

There are different kinds of uncertainty. I outline some of the various ways that uncertainty enters science, focusing on uncertainty in climate science and weather prediction. I then show how we cope with some of these sources of error through sophisticated modelling techniques. I show how we maintain confidence in the face of error.

The thesis of theory-ladenness of observations, in its various guises, is widely considered as either ill-conceived or harmless to the rationality of science. The latter view rests partly on the work of the proponents of New Experimentalism who have argued, among other things, that experimental practices are efficient in guarding against any epistemological threat posed by theory-ladenness. In this paper I show that one can generate a thesis of theory-ladenness for experimental practices from an influential New Experimentalist account. The notion (...) I introduce for this purpose is the concept of ‘theory-driven data reliability judgments’, according to which theories which are sought to be tested with a particular set of data guide reliability judgments about those very same data. I provide various prominent historical examples to show that TDRs are used by scientists to resolve data conflicts. I argue that the rationality of the practices which employ TDRs can be saved if the independent support of the theories driving TDRs is construed in a particular way. (shrink)

Philosophy can shed light on mathematical modeling and the juxtaposition of modeling and empirical data. This paper explores three philosophical traditions of the structure of scientific theory—Syntactic, Semantic, and Pragmatic—to show that each illuminates mathematical modeling. The Pragmatic View identifies four critical functions of mathematical modeling: (1) unification of both models and data, (2) model fitting to data, (3) mechanism identification accounting for observation, and (4) prediction of future observations. Such facets are explored using a recent exchange between two groups (...) of mathematical modelers in plant biology. Scientific debate can arise from different modeling philosophies. (shrink)

Selectionist evolutionary theory has often been faulted for not making novel predictions that are surprising, risky, and correct. I argue that it in fact exhibits the theoretical virtue of predictive capacity in addition to two other virtues: explanatory unification and model fitting. Two case studies show the predictive capacity of selectionist evolutionary theory: parallel evolutionary change in E. coli, and the origin of eukaryotic cells through endosymbiosis.