Case Study research is characterized by the employment of multiple data gathering methods. In this paper, I examine the concurrent use of participant observation and qualitative interviews. The question I examine is: what is the rationale behind their combination in case study research? In the literature on case study research, the two most common reasons for using multiple methods appeal to comprehensiveness and convergent confirmation respectively. I argue that there is a third significant, yet overlooked, way to motivate the joint (...) use of participant observation and qualitative interviews: the methods may generate complementary evidence and this puts the researcher in a better position to confirm that her data manifest central epistemic values and so are suitable as basis for providing an adequate answer to her research question. I refer to this as the rationale of blended epistemic value validation. (shrink)

A particular tradition in medicine claims that a variety of evidence is helpful in determining whether an observed correlation is causal. In line with this tradition, it has been claimed that establishing a causal claim in medicine requires both probabilistic and mechanistic evidence. This claim has been put forward by Federica Russo and Jon Williamson. As a result, it is sometimes called the Russo–Williamson thesis. In support of this thesis, Russo and Williamson appeal to the practice of the International Agency (...) for Research on Cancer. However, this practice presents some problematic cases for the Russo–Williamson thesis. One response to such cases is to argue in favour of reforming these practices. In this paper, we propose an alternative response according to which such cases are in fact consistent with the Russo–Williamson thesis. This response requires maintaining that there is a role for mechanism-based extrapolation in the practice of the IARC. However, the response works only if this mechanism-based extrapolation is reliable, and some have argued against the reliability of mechanism-based extrapolation. Against this, we provide some reasons for believing that reliable mechanism-based extrapolation is going on in the practice of the IARC. The reasons are provided by appealing to the role of robustness analysis. (shrink)

This paper applies conceptual engineering to deal with four objections that have been levelled against operationalism in psychology. These objections are: operationalism leads to harmful proliferation of concepts, operationalism goes hand-in-hand with untenable antirealism, operationalism leads to arbitrariness in scientific concept formation, and operationalism is incompatible with the usual conception of scientific measurement. Relying on a formulation of three principles of conceptual engineering, I will argue that there is a useful form of operationalism that does not fall prey to these (...) four objections. (shrink)

William Whewell’s philosophy of science is often overlooked as a relic of 19th century Whiggism. I argue however that his view – suitably modified – can contribute to contemporary philosophy of science, particularly to debates around scientific progress. The reason Whewell’s view needs modification is that he makes the following problematic claim: as science progresses, it reveals necessarily truths and thereby grants a glimpse of the mind of God. Modifying Whewell’s view will involve reinventing his notion of necessary truth as (...) the pragmatist notion of superassertibility. And, if scientific progress does not uncover necessary truths, then it does not reveal the mind of God. The result is an outline of an account of scientific progress that is piecemeal and fallibilist in nature, yet at the same time maintains key Whewellian themes of consilience and the unity of science. (shrink)

One important strategy for dealing with error in our methods is triangulation, or the use multiple methods to investigate the same object. Current accounts of triangulation assume that its primary function is to provide a confirmatory boost to hypotheses beyond what confirmation of each method alone could produce. Yet, researchers often use multiple methods to examine new constructs about which they are uncertain. For example, social psychologists use multiple indirect measures to provide convergent evidence about implicit attitudes, but how to (...) characterize implicit attitudes is an open question. To make sense of triangulation under uncertainty about constructs, I suggest two changes: first, triangulation can serve multiple epistemic functions, including some that are non-confirmatory, and second, researchers should assess the epistemic risk in claims about evidence and the acceptance/rejection of hypotheses. (shrink)

Robustness arguments hold that hypotheses are more likely to be true when they are confirmed by diverse kinds of evidence. Robustness arguments require the confirming evidence to be independent. We identify two kinds of independence appealed to in robustness arguments: ontic independence —when the multiple lines of evidence depend on different materials, assumptions, or theories—and probabilistic independence. Many assume that OI is sufficient for a robustness argument to be warranted. However, we argue that, as typically construed, OI is not a (...) sufficient independence condition for warranting robustness arguments. We show that OI evidence can collectively confirm a hypothesis to a lower degree than individual lines of evidence, contrary to the standard assumption undergirding usual robustness arguments. We employ Bayesian networks to represent the ideal empirical scenario for a robustness argument and a variety of ways in which empirical scenarios can fall short of this ideal. (shrink)

Amalgamating evidence from heterogeneous sources and across levels of inquiry is becoming increasingly important in many pure and applied sciences. This special issue provides a forum for researchers from diverse scientific and philosophical perspectives to discuss evidence amalgamation, its methodologies, its history, its pitfalls, and its potential. We situate the contributions therein within six themes from the broad literature on this subject: the variety-of-evidence thesis, the philosophy of meta-analysis, the role of robustness/sensitivity analysis for evidence amalgamation, its bearing on questions (...) of extrapolation and external validity of experiments, its connection with theory development, and its interface with causal inference, especially regarding causal theories of cancer. (shrink)

Derived measurements involve problems of coordination. Conducting them often requires detailed theoretical assumptions about their target, while such assumptions can lack sources of evidence that are independent from these very measurements. In this paper, I defend two claims about problems of coordination. I motivate both by a novel case study on a central measurement problem in the history of physical geodesy: the determination of the earth's ellipticity. First, I argue that the severity of problems of coordination varies according to scientists' (...) predictive and experimental control over perturbations of the measurement process. Second, I identify a methodology by which scientists can solve hard problems of coordination and gradually increase their predictive control over perturbations. I dub this methodology ‘operational pluralism’ since it is driven by the introduction of alternative measurement operations that involve different physical indicators. (shrink)

I argue that diversity and pluralism are valuable not just for science but for philosophy of science. Given the partiality and perspectivism of representation, pluralism preserving integration can...

The results of econometric modeling are fragile in the sense that minor changes in estimation techniques or sample can lead to statistical models that support inconsistent causal hypotheses. The fragility of econometric results undermines making conclusive inferences from the empirical literature. I argue that the program of evidential pluralism, which originated in the context of medicine and encapsulates to the normative reading of the Russo-Williamson Thesis that causal claims need the support of both difference-making and mechanistic evidence, offers a ground (...) for resolving empirical disagreements. I analyze a recent econometric controversy regarding the tax elasticity of cigarette consumption and smoking intensity. Both studies apply plausible estimation techniques but report inconsistent results. I show that mechanistic evidence allows for discriminating econometric models representing genuine causal relations from accidental dependencies in data. Furthermore, I discuss the differences between biological and social mechanisms and mechanistic evidence across the disciplines. I show that economists mainly rely on mathematical models to represent possible mechanisms. Still, claiming the actuality of the represented mechanisms requires establishing that crucial assumptions of these models are descriptively adequate. I exemplify my approach to assessing the quality of mechanistic evidence in economics with an analysis of two models of rational addiction. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Varied evidence confirms more strongly than less varied evidence, ceteris paribus. This epistemological Variety of Evidence Thesis enjoys widespread intuitive support. We put forward a novel explication of one notion of varied evidence and the Variety of Evidence Thesis within Bayesian models of scientific inference by appealing to measures of entropy. Our explication of the Variety of Evidence Thesis holds in many of our models which also pronounce on disconfirmatory and discordant evidence. We argue that our models pronounce rightly. Against (...) a backdrop of failures of the Variety of Evidence Thesis, the intuitive case for the Variety of Evidence Thesis emerges strengthened. Our models do however not support the general case for the thesis since our explication of it fails to hold in certain cases. The parameter space of this failure is explored and an explanation for the failure is offered. (shrink)

The intuitive Variety of Evidence Thesis states that, ceteris paribus, more varied evidence for a hypothesis confirms it more strongly than less varied evidence. Recent Bayesian analyses have raised serious doubts in its validity. Claveau suggests the existence of a novel type of counter-example to this thesis: a gradual increase in source independence can lead to a decrease in hypothesis confirmation. I show that Claveau’s measure of gradual source independence suffers from two unsuspected types of inconsistencies. I hence put forward (...) a more natural measure of gradual source independence which is not plagued by inconsistencies. Claveau’s counter-examples to the variety of evidence thesis disappear with the measure I suggest. I hence argue that my measure is preferable and that this thesis does at least not seem to be troubled by Claveau’s arguments. (shrink)

This paper deals with the evidential value of neuroeconomic experiments for the triangulation of economically relevant phenomena. We examine the case of social preferences, which involves bringing together evidence from behavioural experiments, neuroeconomic experiments, and observational studies from other social sciences. We present an account of triangulation and identify the conditions under which neuroeconomic evidence is diverse in the way required for successful triangulation. We also show that the successful triangulation of phenomena does not necessarily afford additional confirmation to general (...) theories about those phenomena. (shrink)

This paper considers the importance of unification in the context of developing scientific theories. I argue that unifying hypotheses are not valuable simply because they are supported by multiple lines of evidence. Instead, they can be valuable because they guide experimental research in different domains in such a way that the results from those experiments inform the scope of the theory being developed. I support this characterization by appealing to the early development of quantum theory. I then draw some comparisons (...) with discussions of robustness reasoning. (shrink)

This paper considers the importance of unification in the context of developing scientific theories. I argue that unifying hypotheses are not valuable simply because they are supported by multiple lines of evidence. Instead, they can be valuable because they guide experimental research in different domains in such a way that the results from those experiments inform the scope of the theory being developed. I support this characterization by appealing to the early development of quantum theory. I then draw some comparisons (...) with discussions of robustness reasoning. (shrink)

This article is a comparative study between predictive processing (PP, or predictive coding) and cognitive dissonance (CD) theory. The theory of CD, one of the most influential and extensively studied theories in social psychology, is shown to be highly compatible with recent developments in PP. This is particularly evident in the notion that both theories deal with strategies to reduce perceived error signals. However, reasons exist to update the theory of CD to one of “predictive dissonance.” First, the hierarchical PP (...) framework can be helpful in understanding varying nested levels of CD. If dissonance arises from a cascade of downstream and lateral predictions and consequent prediction errors, dissonance can exist at a multitude of scales, all the way up from sensory perception to higher order cognitions. This helps understand the previously problematic dichotomy between “dissonant cognitive relations” and “dissonant psychological states,” which are part of the same perception-action process while still hierarchically distinct. Second, since PP is action-oriented, it can be read to support recent action-based models of CD. Third, PP can potentially help us understand the recently speculated evolutionary origins of CD. Here, the argument is that responses to CD can instill meta-learning which serves to prevent the overfitting of generative models to ephemeral local conditions. This can increase action-oriented ecological rationality and enhanced capabilities to interact with a rich landscape of affordances. The downside is that in today’s world where social institutions such as science a priori separate noise from signal, some reactions to predictive dissonance might propagate ecologically unsound (underfitted, confirmation-biased) mental models such as climate denialism. (shrink)

Social scientists use many different methods, and there are often substantial disagreements about which method is appropriate for a given research question. In response to this uncertainty about the relative merits of different methods, W. E. B. Du Bois advocated for and applied “methodological triangulation”. This is to use multiple methods simultaneously in the belief that, where one is uncertain about the reliability of any given method, if multiple methods yield the same answer that answer is confirmed more strongly than (...) it could have been by any single method. Against this, methodological purists believe that one should choose a single appropriate method and stick with it. Using tools from voting theory, we show Du Boisian methodological triangulation to be more likely to yield the correct answer than purism, assuming the scientist is subject to some degree of diffidence about the relative merits of the various methods. This holds even when in fact only one of the methods is appropriate for the given research question. (shrink)

The 2011 Nobel Prize in Physics was awarded to researchers from the Supernova Cosmology Project and the High-z Supernova Search Team for the discovery of the accelerating expansion of the universe. In this paper, I provide a historical analysis of the supernova cosmology evidence put forward by these teams for the accelerating universe, in terms of an iterative model of scientific progress developed by Hasok Chang in the context of his study of the development of measurement standards. I argue, using (...) the key concept of epistemic iteration, that the iterative model adequately accounts for evidence production in experimental science as well. In order to apply Chang’s model to the experimental evidence for the accelerating universe, I introduce the concept of endorsement as a particular mode of progress, and argue that supernova scientists produced an endorsed measurement system to claim evidence for their discovery. Furthermore, I show that the credibility of the evidence was not based on a particular measurement, rather, what proved to be decisive was the “robust consistency” of many individual results. (shrink)

Natural kinds, real kinds, or, following J.S Mill simply, Kinds, are thought to be an important asset for scientific realists in the non-fundamental (or “special”) sciences. Essential natures are less in vogue. I show that the realist would do well to couple her Kinds with essential natures in order to strengthen their epistemic and ontological credentials. I argue that these essential natures need not however be intrinsic to the Kind’s members; they may be historical. I concentrate on assessing the merits (...) of historical essential natures in a paradigm case of Kinds in the non-fundamental sciences: species. I specify two basic jobs for essential natures: 1) offering individuation criteria, and 2) providing a causal explanation of the Kind’s multiple projectable properties. I argue that at least in the case of species historical essences are fit for both tasks. The principled resistance to Kinds with historical essences should also be cleared. (shrink)

In a recent article in this Journal, Fumagalli argues that economists are provisionally justified in resisting prominent calls to integrate neural variables into economic models of choice. In other articles, various authors engage with Fumagalli’s argument and try to substantiate three often-made claims concerning neuroeconomic modelling. First, the benefits derivable from neurally informing some economic models of choice do not involve significant tractability costs. Second, neuroeconomic modelling is best understood within Marr’s three-level of analysis framework for information-processing systems. And third, (...) neural findings enable choice modellers to confirm the causal relevance of variables posited by competing economic models, identify causally relevant variables overlooked by existing models, and explain observed behavioural variability better than standard economic models. In this paper, I critically examine these three claims and respond to the related criticisms of Fumagalli’s argument. Moreover, I qualify and extend Fumagalli’s account of how trade-offs between distinct modelling desiderata hamper neuroeconomists’ attempts to improve economic models of choice. I then draw on influential neuroeconomic studies to argue that even the putatively best available neural findings fail to substantiate current calls for a neural enrichment of economic models. (shrink)

In recent years, several authors have called to ground descriptive and normative decision theory on neuro-psychological measures of utility. In this paper, I combine insights from the best available neuro-psychological findings, leading philosophical conceptions of welfare and contemporary decision theory to rebut these prominent calls. I argue for two claims of general interest to philosophers, choice modellers and policy makers. First, severe conceptual, epistemic and evidential problems plague ongoing attempts to develop accurate and reliable neuro-psychological measures of utility. And second, (...) even if these problems are solved, neuro-psychological measures of utility lack the potential to inform welfare analyses and policy evaluations. (shrink)

This paper provides a philosophical assessment of leading theory-based, evidence-based and coherentist approaches to the definition and the measurement of well-being. It then builds on this assessment to articulate a reformed division of labor for the science of well-being and argues that this reformed division of labor can improve on the proffered approaches by combining the most plausible tenets of theory-based approaches with the most plausible tenets of coherentist approaches. This result does not per se exclude the possibility that theory-based (...) and coherentist approaches may be independently improved or amended in the years to come. Still, together with the challenges that affect these approaches, it strengthens the case for combining the most plausible tenets of those approaches. (shrink)

Recently Kenneth Kendler and Peter Zachar have raised doubts about the correspondence theory of truth and scientific realism in psychopathology. They argue that coherentist or pragmatist approaches to truth are better suited for understanding the reality of psychiatric disorders. In this article, I show that rejecting realism based on the correspondence theory is deeply problematic: It makes psychopathology categorically different from other sciences, and results in an implausible view of scientific discovery and progress. As an alternative, I suggest a robustness-based (...) approach that can accommodate the significance of coherence and pragmatic factors without rejecting scientific realism and the correspondence theory of truth. (shrink)

Although scientific realism is the default position in the life sciences, philosophical accounts of realism are geared towards physics and run into trouble when applied to fields such as biology or neuroscience. In this paper, I formulate a new robustness-based version of entity realism, and show that it provides a plausible account of realism for the life sciences that is also continuous with scientific practice. It is based on the idea that if there are several independent ways of measuring, detecting (...) or deriving something, then we are justified in believing that it is real. I also consider several possible objections to robustness-based entity realism, discuss its relationship to ontic structural realism, and show how it has the potential to provide a novel response to the pessimistic induction argument. (shrink)

This paper explores an emerging sub-field of both empirical bioethics and experimental philosophy, which has been called “experimental philosophical bioethics” (bioxphi). As an empirical discipline, bioxphi adopts the methods of experimental moral psychology and cognitive science; it does so to make sense of the eliciting factors and underlying cognitive processes that shape people’s moral judgments, particularly about real-world matters of bioethical concern. Yet, as a normative discipline situated within the broader field of bioethics, it also aims to contribute to substantive (...) ethical questions about what should be done in a given context. What are some of the ways in which this aim has been pursued? In this paper, we employ a case study approach to examine and critically evaluate four strategies from the recent literature by which scholars in bioxphi have leveraged empirical data in the service of normative arguments. (shrink)

Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

Diversity of evidence is widely claimed to be crucial for evidence amalgamation to have distinctive epistemic merits. Bayesian epistemologists capture this idea in the variety-of-evidence thesis: ceteris paribus, the strength of confirmation of a hypothesis by an evidential set increases with the diversity of the evidential elements in that set. Yet, formal exploration of this thesis has shown that it fails to be generally true. This article demonstrates that the thesis fails in even more circumstances than recent results would lead (...) us to expect. Most importantly, it can fail whatever the chance that the evidential sources are unreliable. Our results hold for two types of degrees of variety: reliability independence and testable aspect independence. We conclude that the variety-of-evidence thesis can, at best, be interpreted as an exception-prone rule of thumb. (shrink)

Diversity of evidence is widely claimed to be crucial for evidence amalgamation to have distinctive epistemic merits. Bayesian epistemologists capture this idea in the variety-of-evidence thesis: ceteris paribus, the strength of confirmation of a hypothesis by an evidential set increases with the diversity of the evidential elements in that set. Yet, formal exploration of this thesis has shown that it fails to be generally true. This article demonstrates that the thesis fails in even more circumstances than recent results would lead (...) us to expect. Most importantly, it can fail whatever the chance that the evidential sources are unreliable. Our results hold for two types of degrees of variety: reliability independence and testable aspect independence. We conclude that the variety-of-evidence thesis can, at best, be interpreted as an exception-prone rule of thumb. (shrink)

This paper proposes an extended version of the interventionist account for causal inference in the practical context of biological mechanism research. This paper studies the details of biological mechanism researchers’ practices of assessing the evidential legitimacy of experimental data, arguing why quantity and variety are two important criteria for this assessment. Because of the nature of biological mechanism research, the epistemic values of these two criteria result from the independence both between the causation of data generation and the causation in (...) question and between different interventions, not techniques. The former independence ensures that the interventions in the causation in question are not affected by the causation that is responsible for data generation. The latter independence ensures the reliability of the final mechanisms not only in the empirical but also the formal aspects. This paper first explores how the researchers use quantity to check the effectiveness of interventions, where they at the same time determine the validity of the difference-making revealed by the results of interventions. Then, this paper draws a distinction between experimental interventions and experimental techniques, so that the reliability of mechanisms, as supported by the variety of evidence, can be safely ensured in the probabilistic sense. The latter process is where the researchers establish evidence of the mechanisms connecting the events of interest. By using case studies, this paper proposes to use ‘intervention’ as the fruitful connecting point of literature between evidence and mechanisms. (shrink)

We argue that the epistemic functions of replication in science are best understood by their role in assessing kinds of experimental error. Direct replications serve to assess the reliability of an experiment through its precision: the presence and degree of random error. Conceptual replications serve to assess the validity of an experiment through its accuracy: the presence and degree of systematic errors. To illustrate the aptness of this view, we examine the Hubble constant controversy in astronomy, showing how astronomers have (...) responded to the concordances and discordances in their results by carrying out the different kinds of replication that we identify, with the aim of establishing a precise, accurate value for the Hubble constant. We contrast our view with Machery’s “re-sampling” account of replicability, which maintains that replications only assess reliability. (shrink)