How can philosophy of science be of more practical use? One thing we can do is provide practicable advice about how to determine when one empirical claim is relevant to the truth of another; i.e., about evidential relevance. This matters especially for evidence-based policy, where advice is thin—and misleading—about how to tell what counts as evidence for policy effectiveness. This paper argues that good efficacy results (as in randomized controlled trials), which are all the rage now, are only a very (...) small part of the story. To tell what facts are relevant for judging policy effectiveness, we need to construct causal scenarios about will happen when the policy is implemented. (shrink)

Sections include: experiments and generalised causal inference; statistical conclusion validity and internal validity; construct validity and external validity; quasi-experimental designs that either lack a control group or lack pretest observations on the outcome; quasi-experimental designs that use both control groups and pretests; quasi-experiments: interrupted time-series designs; regresssion discontinuity designs; randomised experiments: rationale, designs, and conditions conducive to doing them; practical problems 1: ethics, participation recruitment and random assignment; practical problems 2: treatment implementation and attrition; generalised causal inference: a grounded theory; (...) generalised causal inference: methods for single studies; generalised causal inference: methods for multiple studies; a critical assessment of our assumptions. (shrink)

In the 1950s and 1960s, an interfield interaction between molecular biologists and biochemists integrated important discoveries about the mechanism of protein synthesis. This extended discovery episode reveals two general reasoning strategies for eliminating gaps in descriptions of the productive continuity of mechanisms: schema instantiation and forward chaining/backtracking. Schema instantiation involves filling roles in an overall framework for the mechanism. Forward chaining and backtracking eliminate gaps using knowledge about types of entities and their activities. Attention to mechanisms highlights salient features of (...) this historical episode while providing general reasoning strategies for mechanism discovery. (shrink)

Evidence-Based Medicine is a relatively new movement that seeks to put clinical med- icine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence-the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs (randomized controlled trials).

Evidence-Based Medicine is a relatively new movement that seeks to put clinical medicine on a firmer scientific footing. I take it as uncontroversial that medical practice should be based on best evidence—the interesting questions concern the details. This paper tries to move towards a coherent and unified account of best evidence in medicine, by exploring in particular the EBM position on RCTs.

Woodward's long awaited book is an attempt to construct a comprehensive account of causation explanation that applies to a wide variety of causal and explanatory claims in different areas of science and everyday life. The book engages some of the relevant literature from other disciplines, as Woodward weaves together examples, counterexamples, criticisms, defenses, objections, and replies into a convincing defense of the core of his theory, which is that we can analyze causation by appeal to the notion of manipulation.

I present an alternative account of causation in the biomedical and social sciences according to which the meaning of causal claims is given by their inferential relations to other claims. Specifically, I will argue that causal claims are inferentially related to certain evidential claims as well as claims about explanation, prediction, intervention and responsibility. I explain in some detail what it means for a claim to be inferentially related to another and finally derive some implication of the proposed account for (...) the epistemology, semantics and metaphysics of causation. (shrink)

Two approaches to evidential reasoning compete in the biomedical and social sciences: the experimental and the pragmatist. Whereas experimentalism has received considerable philosophical analysis and support since the times of Bacon and Mill, pragmatism about evidence has been neither articulated nor defended. The overall aim is to fill this gap and develop a theory that articulates the latter. The main ideas of the theory will be illustrated and supported by a case study on the smoking/lung cancer controversy in the 1950s.

The experimental approach in economics is a driving force behind some of the most exciting developments in the field. The 'experimental revolution' was based on a series of bold philosophical premises which have remained until now mostly unexplored. This book provides the first comprehensive analysis and critical discussion of the methodology of experimental economics, written by a philosopher of science with expertise in the field. It outlines the fundamental principles of experimental inference in order to investigate their power, scope and (...) limitations. The author demonstrates that experimental economists have a lot to gain by discussing openly the philosophical principles that guide their work, and that philosophers of science have a lot to learn from their ingenious techniques devised by experimenters in order to tackle difficult scientific problems. (shrink)

The aim of this paper is to introduce the instrumental variables technique to the discussion about causal inference in econometrics. I show that it may lead to causally incorrect conclusions unless some fairly strong causal background assumptions are made, assumptions which are usually left implicit by econometricians. These assumptions are very similar to, albeit not identical with, James Woodward's definition of an ‘intervention’. I discuss similarities and differences of the two points of view and argue that—understood as a practical method (...) of causal inference—the set presented here is superior. (shrink)

Published research findings are sometimes refuted by subsequent evidence, says Ioannidis, with ensuing confusion and disappointment.

Comparative process tracing is the best analysis of extrapolation inferences in the philosophical and scientific literature so far. In this essay I examine some similarities and differences between comparative process tracing and former attempts to capture the logic of extrapolation, such as the analogical approach. I show that these accounts are not different in spirit, although comparative process tracing supersedes previous proposals in terms of analytical detail. I also examine some qualms about the possibility of drawing extrapolation inferences in the (...) social sciences and conclude by suggesting that there may be cases of extrapolation without process tracing. (shrink)

Experimental “localism” stresses the importance of context‐specific knowledge, and the limitations of universal theories in science. I illustrate Latour's radical approach to localism and show that it has some unpalatable consequences, in particular the suggestion that problems of external validity (or how to generalize experimental results to nonlaboratory circumstances) cannot be solved. In the last part of the paper I try to sketch a solution to the problem of external validity by extending Mayo's error‐probabilistic approach.

Philosophers of science increasingly believe that much of science is concerned with understanding the mechanisms responsible for the production of natural phenomena. An adequate understanding of scientific research requires an account of how scientists develop and test models of mechanisms. This paper offers a general account of the nature of mechanical models, discussing the representational relationship that holds between mechanisms and their models as well as the techniques that can be used to test and refine such models. The analysis is (...) supported by study of two competing models of a mechanism of speech perception. (shrink)

What is the correct concept behind measures of inflation? Does money cause business activity or is it the other way around? Shall we stimulate growth by raising aggregate demand or rather by lowering taxes and thereby providing incentives to produce? Policy-relevant questions such as these are of immediate and obvious importance to the welfare of societies. The standard approach in dealing with them is to build a model, based on economic theory, answer the question for the model world and then (...) apply the results to economic phenomena outside. Data come in, if at all, only in testing a limited number of the model's consequences. Despite some critical voices, economic methodology too has by and large subscribed to a "theory first" approach to applied economics. Error in Economics systematically develops an alternative to the theory-based orthodoxy. It places the methodical study of evidence at the centre of the scientific enterprise and thus provides a foundation for a methodology of evidence-based economics. But the book does not stop at the truism that claims should be based on the best available evidence. Rather, detailed studies in the areas of measurement, causal inference and policy analysis show what it means for a claim to be evidence-based in the context of a concrete case. The examples discussed concern topics as diverse as consumer price indices, radio spectrum auctions, the transmission mechanism, natural experiments on minimum wages and the evaluation of counterfactuals for policy. Error in Economics is essential reading for economic methodologists, philosophers of science and anyone interested in how claims about socio-economic matters are validated. (shrink)

In this book, Reiss argues in favor of a tight fit between evidence, concept and purpose in our causal investigations in the sciences. There is no doubt that the sciences employ a vast array of techniques to address causal questions such as controlled experiments, randomized trials, statistical and econometric tools, causal modeling and thought experiments. But how do these different methods relate to each other and to the causal inquiry at hand? Reiss argues that there is no "gold standard" in (...) settling causal issues against which other methods can be measured. Rather, the various methods of inference tend to be good only relative to certain interpretations of the word "cause", and each interpretation, in turn, helps to address some salient purpose but not others. The main objective of this book is to explore the metaphysical and methodological consequences of this view in the context of numerous cases studies from the natural and social sciences. (shrink)

"This is a wonderful book! In "How Scientists Explain Disease," Paul Thagard offers us a delightful essay combining science, its history, philosophy, and sociology.

Inferences like these are known as extrapolations.

_Brute Science_ investigates whether biomedical research using animals is, in fact, scientifically justified. Hugh LaFollette and Niall Shanks examine the issues in scientific terms using the models that scientists themselves use. They argue that we need to reassess our use of animals and, indeed, rethink the standard positions in the debate.

Objectives To determine whether parachutes are effective in preventing major trauma related to gravitational challenge. Design Systematic review of randomised controlled trials. Data sources: Medline, Web of Science, Embase, and the Cochrane Library databases; appropriate internet sites and citation lists. Study selection: Studies showing the effects of using a parachute during free fall. Main outcome measure Death or major trauma, defined as an injury severity score > 15. Results We were unable to identify any randomised controlled trials of parachute intervention. (...) Conclusions As with many interventions intended to prevent ill health, the effectiveness of parachutes has not been subjected to rigorous evaluation by using randomised controlled trials. Advocates of evidence based medicine have criticised the adoption of interventions evaluated by using only observational data. We think that everyone might benefit if the most radical protagonists of evidence based medicine organised and participated in a double blind, randomised, placebo controlled, crossover trial of the parachute. (shrink)