The claims of randomized controlled trials to be the gold standard rest on the fact that the ideal RCT is a deductive method: if the assumptions of the test are met, a positive result implies the appropriate causal conclusion. This is a feature that RCTs share with a variety of other methods, which thus have equal claim to being a gold standard. This article describes some of these other deductive methods and also some useful non-deductive methods, including the hypothetico-deductive method. (...) It argues that with all deductive methods, the benefit that the conclusions follow deductively in the ideal case comes with a great cost: narrowness of scope. This is an instance of the familiar trade-off between internal and external validity. RCTs have high internal validity but the formal methodology puts severe constraints on the assumptions a target population must meet to justify exporting a conclusion from the test population to the target. The article reviews one such set of assumptions to show the kind of knowledge required. The overall conclusion is that to draw causal inferences about a target population, which method is best depends case-by-case on what background knowledge we have or can come to obtain. There is no gold standard. (shrink)

Experimental “localism” stresses the importance of context‐specific knowledge, and the limitations of universal theories in science. I illustrate Latour's radical approach to localism and show that it has some unpalatable consequences, in particular the suggestion that problems of external validity (or how to generalize experimental results to nonlaboratory circumstances) cannot be solved. In the last part of the paper I try to sketch a solution to the problem of external validity by extending Mayo's error‐probabilistic approach.

Recent accounts of scientific method suggest that a model, or analogy, for an axiomatized theory is another theory, or postulate set, with an identical calculus. The present paper examines five central theses underlying this position. In the light of examples from physical science it seems necessary to distinguish between models and analogies and to recognize the need for important revisions in the position under study, especially in claims involving an emphasis on logical structure and similarity in form between theory and (...) analogy. While formal considerations are often relevant in the employment of an analogy they are neither as extensive as proponents of this viewpoint suggest, nor are they in most cases sufficient for allowing analogies to fulfill the roles imputed to them. Of major importance, and what these authors generally fail to consider, are physical similarities between analogue and theoretical object. Such similarities, which are characteristic in varying degrees of most analogies actually employed, play an important role in affording a better understanding of concepts in the theory and also in the development of the theoretical assumptions. (shrink)

This paper discusses the so-called non-interference assumption (NIA) grounding causal inference in trials in both medicine and the social sciences. It states that for each participant in the experiment, the value of the potential outcome depends only upon whether she or he gets the treatment. Drawing on methodological discussion in clinical trials and laboratory experiments in economics, I defend the necessity of partial forms of blinding as a warrant of the NIA, to control the participants’ expectations and their strategic interactions (...) with the experimenter. (shrink)

Randomized controlled trials (RCTs) are widely taken as the gold standard for establishing causal conclusions. Ideally conducted they ensure that the treatment ‘causes’ the outcome—in the experiment. But where else? This is the venerable question of external validity. I point out that the question comes in two importantly different forms: Is the specific causal conclusion warranted by the experiment true in a target situation? What will be the result of implementing the treatment there? This paper explains how the probabilistic theory (...) of causality implies that RCTs can establish causal conclusions and thereby provides an account of what exactly that causal conclusion is. Clarifying the exact form of the conclusion shows just what is necessary for it to hold in a new setting and also how much more is needed to see what the actual outcome would be there were the treatment implemented. (shrink)

This paper discusses the so-called non-interference assumption (NIA) grounding causal inference in trials in both medicine and the social sciences. It states that for each participant in the experiment, the value of the potential outcome depends only upon whether she or he gets the treatment. Drawing on methodological discussion in clinical trials and laboratory experiments in economics, I defend the necessity of partial forms of blinding as a warrant of the NIA, to control the participants’ expectations and their strategic interactions (...) with the experimenter. (shrink)

A theory of analogy must describe how the meaning of an analogy is derived from the meanings of its parts. In the structure‐mapping theory, the interpretation rules are characterized as implicit rules for mapping knowledge about a base domain into a target domain. Two important features of the theory are (a) the rules depend only on syntactic properties of the knowledge representation, and not on the specific content of the domains; and (b) the theoretical framework allows analogies to be distinguished (...) cleanly from literal similarity statements, applications of abstractions, and other kinds of comparisons.Two mapping principles are described: (a) Relations between objects, rather than attributes of objects, are mapped from base to target; and (b) The particular relations mapped are determined by systematicity, as defined by the existence of higher‐order relations. (shrink)