Introduction to Synthese SI: Systematicity: The Nature of Science?

(No abstract is available for this citation).

This article examines how problems of validity in empirical social research differ from those in natural science. Specifically, we focus on how some ontological peculiarities of the object of study in social science bear on validity requirements. We consider these issues in experimental validity as well as in test validity because, while both fields hold large intellectual traditions, research tests or questionnaires are less closely connected to natural science methodology than experiments.

This article addresses some recent tendencies in economic methodology defined as a philosophy of science for economics. I review the problem of normative/positive distinction in methodology and argue that normativity in its past forms is intolerable today but is, at the same time, indispensable for methodological inquiry. Using recent texts by Mirowski and Nik-Khah and by Alexandrova and Northcott on the applications of auction theory as a case study, I compare in more detail various approaches to economic methodology inspired by (...) the science and technology studies (STS) and philosophy of science literatures, respectively. On the basis of this comparison, I show that the STS programme in economic methodology may prove fruitful in the future, but there is still a place for more aprioristic philosophical thinking. Methodology and history of economics also play a fundamental role that goes beyond the descriptive analysis of STS and offer conceptual clarification paired with normative concerns provided by philosophers of science. (shrink)

It is sometimes argued that experimental economists do not have to worry about external validity so long as the design sticks closely to a theoretical model. This position mistakes the model for the theory. As a result, applied economics designs often study phenomena distinct from their stated objects of inquiry. Because the implemented models are abstract, they may provide improbable analogues to their stated subject matter. This problem is exacerbated by the relational character of the social world, which also sets (...) epistemic limits for the social science laboratory more generally. (shrink)

ABSTRACTThe Imperative of Responsibility, by the German philosopher Hans Jonas, is a work that aspires to a re-foundation of ethics based on an analysis of the contemporary world as well as on a prediction about the fate of globalized humanity. Through a discussion of the fundamental concepts of Jonas’ work, the essay shows that the central themes of his research, which are still very relevant today, should be addressed by moving from the ethical level to that of ontology and social (...) ontology in particular. To this end, the paper offers a definition of transgenerational action that aims to replace Jonas’ use of prevision. The transgenerational action is here considered as a particular type of social action: that which enables societies to exist over time. Finally, the essay proposes an essential taxonomy of transgenerational actions, showing how working on this notion might lead to a consciously utopian and positive social model. (shrink)

En este artículo presentamos las principales corrientes de la Filosofía Experimental y atendemos a una de las críticas más severas a la que se ha sometido este reciente programa de renovación metodológica. Según Antti Kauppinen la Filosofía Experimental está condenada al fracaso porque no puede obtener mediante sus métodos el tipo de intuiciones que interesan a los filósofos –las intuiciones robustas del hablante competente. Aun aceptando parte de las críticas de Kauppinen, en este artículo sostenemos, en primer lugar, que la (...) supuesta incapacidad de la Filosofía Experimental para acceder a las intuiciones robustas de los hablantes tiene que ver en gran medida con los métodos experimentales empleados hasta ahora por los filósofos experimentales. En segundo lugar, defendemos que el proyecto de reforma llevado a cabo desde la Filosofía Experimental resultará viable solo si se adoptan una serie de consejos metodológicos procedentes de la economía experimental. Únicamente entonces podrán los experimentalistas responder con éxito a la objeción de Kauppinen. (shrink)

Le projet philosophique puise ses sources dans la volonté de proposer une explication rationnelle des phénomènes naturels et culturels qui constituent le monde dans lequel l’être humain prend place. Il a servi de trame culturelle à l’Occident et amené le déploiement d’appareils conceptuels où l’on distingue théorie et pratique. On doit toutefois reconnaître qu’une philosophie théorique peut avoir une portée pratique et l’inverse, puisque toute pratique suppose un ancrage théorique pour légitimer la connaissance et les systèmes normatifs à partir desquels (...) les explications sont avancées. Cela fait dire à certains que la distinction est désormais surannée et qu’une théorie philosophique réunifiée s’impose. Que l’on soit tenant de la tradition ou des nouvelles approches, la philosophie pratique s’impose désormais comme un passage obligé pour réfléchir les problèmes et articuler de nouvelles théories faisant écho à l’état actuel de notre monde. Le présent ouvrage revient sur la notion de philosophie pratique afin d’en faire voir les différentes acceptions et manières de la mobiliser pour réfléchir à des problèmes actuels. (shrink)

Economists and biologists have proposed a distinction between two mechanisms – “strong” and “weak” reciprocity – that may explain the evolution of human sociality. Weak reciprocity theorists emphasize the benefits of long-term cooperation and the use of low-cost strategies to deter free-riders. Strong reciprocity theorists, in contrast, claim that cooperation in social dilemma games can be sustained by costly punishment mechanisms, even in one-shot and finitely repeated games. To support this claim, they have generated a large body of evidence concerning (...) the willingness of experimental subjects to punish uncooperative free-riders at a cost to themselves. In this article, I distinguish between a “narrow” and a “wide” reading of the experimental evidence. Under the narrow reading, punishment experiments are just useful devices to measure psychological propensities in controlled laboratory conditions. Under the wide reading, they replicate a mechanism that supports cooperation also in “real-world” situations outside the laboratory. I argue that the wide interpretation must be tested using a combination of laboratory data and evidence about cooperation “in the wild.” In spite of some often-repeated claims, there is no evidence that cooperation in the small egalitarian societies studied by anthropologists is enforced by means of costly punishment. Moreover, studies by economic and social historians show that social dilemmas in the wild are typically solved by institutions that coordinate punishment, reduce its cost, and extend the horizon of cooperation. The lack of field evidence for costly punishment suggests important constraints about what forms of cooperation can or cannot be sustained by means of decentralised policing. (shrink)

Neuroscience is a laboratory-based science that spans multiple levels of analysis from molecular genetics to behavior. At every level of analysis experiments are designed in order to answer empirical questions about phenomena of interest. Understanding the nature and structure of experimentation in neuroscience is fundamental for assessing the quality of the evidence produced by such experiments and the kinds of claims that are warranted by the data. This article provides a general conceptual framework for thinking about evidence and experimentation in (...) neuroscience with a particular focus on two research areas: cognitive neuroscience and cognitive neurobiology. (shrink)

Descriptive accounts of the nature of explanation in neuroscience and the global goals of such explanation have recently proliferated in the philosophy of neuroscience and with them new understandings of the experimental practices of neuroscientists have emerged. In this paper, I consider two models of such practices; one that takes them to be reductive; another that takes them to be integrative. I investigate those areas of the neuroscience of learning and memory from which the examples used to substantiate these models (...) are culled, and argue that the multiplicity of experimental protocols used in these research areas presents specific challenges for both models. In my view, these challenges have been overlooked largely because philosophers have hitherto failed to pay sufficient attention to fundamental features of experimental practice. I demonstrate that when we do pay attention to such features, evidence for reduction and integrative unity in neuroscience is simply not borne out. I end by suggesting some new directions for the philosophy of neuroscience that pertain to taking a closer look at the nature of neuroscientific experiments. (shrink)

In this paper we discuss James Buchanan’s contribution in the narrow domain of understanding committee voting under majority rule. We then go on to discuss Charles Plott’s seminal experimental work on the topic that sparked a wave of public choice experimental work. However, given Plott’s claims that Buchanan influenced him significantly, it is puzzling that his work with Morris Fiorina explores a question outside of those which Buchanan and Tullock found interesting. We suggest several ways to resolve this tension. Our (...) chapter concludes by discussing a lacuna in the experimental public choice literature in which Buchanan was particularly interested—logrolling, or vote trading. (shrink)

Unlike any other field, the science of morality has drawn attention from an extraordinarily diverse set of disciplines. An interdisciplinary research program has formed in which economists, biologists, neuroscientists, psychologists, and even philosophers have been eager to provide answers to puzzling questions raised by the existence of human morality. Models and simulations, for a variety of reasons, have played various important roles in this endeavor. Their use, however, has sometimes been deemed as useless, trivial and inadequate. The role of models (...) in the science of morality has been vastly underappreciated. This omission shall be remedied here, offering a much more positive picture on the contributions modelers made to our understanding of morality. (shrink)

This paper evaluates Nancy Cartwright’s critique of economic models. Cartwright argues that economics fails to build relevant “nomological machines” able to isolate capacities. In this paper, I contend that many economic models are not used as nomological machines. I give some evidence for this claim and build on an inferential and pragmatic approach to economic modeling. Modeling in economics responds to peculiar inferential norms where a “good” model is essentially a model that enhances our knowledge about possible worlds. As a (...) consequence, models and experiments are very different knowledge-producing devices, at least in economics. (shrink)

Are the recent findings of Behavioural Game Theory (BGT) on unselfish behaviours relevant for the progress of game theory? Is the methodology of BGT, centred around the attempt to study theoretically players’ utility functions in the light of the feedback that experimental evidence can produce on the theory, a satisfactory one? Or is the creation of various types of ‘social preferences’ just wasteful tinkering? This article compares BGT with the methodology of Rational Game Theory (RGT). BGT is viewed as a (...) more promising and constructive approach, with regard to the relationship between experimental data and theoretical modelling. However, I also argue that today RGT and BGT are closer to one another than often thought. (shrink)

The history of economic thought witnessed several prominent economists who took seriously models and concepts in physics for the elucidation and prediction of economic phenomena. Econophysics is an emerging discipline at the intersection of heterodox economics and the physics of complex systems, with practitioners typically engaged in two overlapping but distinct methodological programs. The first is to export mathematical methods used in physics for the purposes of studying economic phenomena. The second is to export mechanisms in physics into economics. A (...) conclusion is drawn that physics transfer is often justified at the level of mathematical transfer but unjustified at the level of mechanistic transfer. (shrink)

In this discussion note I clarify the motivation behind my original paper "Social Mechanisms, Causal Inference and the Policy Relevance of Social Science." I argue that one of the tasks of philosophers of social science is to draw attention to methodological problems that are often forgotten or overlooked. Then I show that my original paper does not make the mistake or fallacy that Daniel Steel suggests in his comment on it. Key Words: social mechanisms • causal inference • social policy.

(No abstract is available for this citation).

How should institutions be designed that “work” in bringing about desirable social outcomes? I study a case of successful institutional design—the redesign of the National Resident Matching Program...

In the human sciences, experimental research is used to establish causal relationships. However, the extrapolation of these results to the target population can be problematic. To facilitate extrapolation, we propose to use the statistical technique Latent Class Regression Analysis in combination with the analogical reasoning theory for extrapolation. This statistical technique can identify latent classes that differ in the effect of X on Y. In order to extrapolate by means of analogical reasoning, one can characterize the latent classes by a (...) combination of features, and then compare these features to features of the target. (shrink)

In this paper, Isuggest that placebo effects, as we know them today, should be understood as experimental phenomena, low-level regularities whose causal structure is grasped through particular experimental designs with little theoretical guidance. Focusing on placebo interventions with needles for pain reduction -one of the few placebo regularities that seems to arise in meta-analytical studies- I discuss the extent to which it is possible to decompose the different factors at play through more fine-grained randomized clinical trials. My sceptical argument is (...) twofold. On the one hand, I argue that experiments alone are not enough to standardize interventions, and that it is necessary to include theories. On the other hand, I argue that the social interactions that seem to be part of placebo effects are difficult, if not impossible, to blind. Therefore, the measurement biases arising from the participants’ reactivity to the experimental setup cannot be controlled for. Further decomposition of placebo effects requires a theoretical account of the existing experimental regularities that may guide further tests. (shrink)

In this paper, we argue for the centrality of prediction in the use of computational models in science. We focus on the consequences of the irreversibility of computational models and on the conditional or ceteris paribus, nature of the kinds of their predictions. By irreversibility, we mean the fact that computational models can generally arrive at the same state via many possible sequences of previous states. Thus, while in the natural world, it is generally assumed that physical states have a (...) unique history, representations of those states in a computational model will usually be compatible with more than one possible history in the model. We describe some of the challenges involved in prediction and retrodiction in computational models while arguing that prediction is an essential feature of non-arbitrary decision making. Furthermore, we contend that the non-predictive virtues of computational models are dependent to a significant degree on the predictive success of the models in question. (shrink)

This article examines methodological individualism in terms of the theory that invariance under intervention is the signal feature of generalizations that serve as a basis for causal explanation. This theory supports the holist contention that macro-level generalizations can explain, but it also suggests a defense of methodological individualism on the grounds that greater range of invariance under intervention entails deeper explanation. Although this individualist position is not threatened by multiple-realizability, an argument for it based on rational choice theory is called (...) into question by experimental results concerning preference reversals. Key Words: methodological individualism • mechanisms • explanation • invariance • preference reversal. (shrink)

External validity is typically regarded as the downside of case study research by methodologists and social scientists; case studies, however, are often aimed at drawing lessons that are generalizable to new contexts. The gap between the generalizability potential of case studies and the research goals demands closer scrutiny. I suggest that the conclusion that case study research is weak in external validity follows from a set of assumptions that I term the "traditional view," which are disputable at best. In this (...) view, external validity is treated as a matter of mere representativeness. I argue that it is best understood instead as a problem of inference and that the emphasis should be placed on the comparability of the study rather than on the typicality of the case. By making case studies highly comparable, their external validity can be reliably and efficiently assessed and, in this way, their generalizability potential enhanced. (shrink)

A shared problem across the sciences is to make sense of correlational data coming from observations and/or from experiments. Arguably, this means establishing when correlations are causal and when they are not. This is an old problem in philosophy. This paper, narrowing down the scope to quantitative causal analysis in social science, reformulates the problem in terms of the validity of statistical models. Two strategies to make sense of correlational data are presented: first, a 'structural strategy', the goal of which (...) is to model and test causal structures that explain correlational data; second, a 'manipulationist or interventionist strategy', that hinges upon the notion of invariance under intervention. It is argued that while the former can offer a solution the latter cannot. (shrink)

This paper defends the naïve thesis that the method of experiment has per se an epistemic superiority over the method of computer simulation, a view that has been rejected by some philosophers writing about simulation, and whose grounds have been hard to pin down by its defenders. I further argue that this superiority does not come from the experiment’s object being materially similar to the target in the world that the investigator is trying to learn about, as both sides of (...) dispute over the epistemic superiority thesis have assumed. The superiority depends on features of the question and on a property of natural kinds that has been mistaken for material similarity. Seeing this requires holding other things equal in the comparison of the two methods, thereby exposing that, under the conditions that will be specified, the simulation is necessarily epistemically one step behind the corresponding experiment. Practical constraints like feasibility and morality mean that scientists do not often face an other-things- equal comparison when they choose between experiment and simulation. Nevertheless, I argue, awareness of this superiority and of the general distinction between experiment and simulation is important for maintaining motivation to seek answers to new questions. (shrink)

This paper aims (a) to provide characterizations of realism and instrumentalism that are philosophically interesting and applicable to economics; and (b) to defend instrumentalism against realism as a methodological stance in economics. Starting point is the observation that ‘all models are false’, which, or so I argue, is difficult to square with the realist's aim of truth, even if the latter is understood as ‘partial’ or ‘approximate’. The three cheers in favour of instrumentalism are: (1) Once we have usefulness, truth (...) is redundant. (2) There is something disturbing about causal structure. (3) It's better to do what one can than to chase rainbows. (shrink)

A recent movement in the social sciences and philosophy of the social sciences focuses on mechanisms as a central analytical unit. Starting from a pluralist perspective on the aims of the social sciences, I argue that there are a number of important aims to which knowledge about mechanisms—whatever their virtues relative to other aims—contributes very little at best and that investigating mechanisms is therefore a methodological strategy with fairly limited applicability. Key Words: social science • mechanisms • explanation • critical (...) realism • methodology. (shrink)

Francesco Guala once wrote that ‘The problem of extrapolation is a minor scandal in the philosophy of science’. This paper agrees with the statement, but for reasons different from Guala’s. The scandal is not, or not any longer, that the problem has been ignored in the philosophy of science. The scandal is that framing the problem as one of external validity encourages poor evidential reasoning. The aim of this paper is to propose an alternative—an alternative which constitutes much better evidential (...) reasoning about target systems of interest, and which makes do without consideration of external validity. (shrink)

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)

A number of recent discussions comparing computer simulation and traditional experimentation have focused on the significance of “materiality.” I challenge several claims emerging from this work and suggest that computer simulation studies are material experiments in a straightforward sense. After discussing some of the implications of this material status for the epistemology of computer simulation, I consider the extent to which materiality (in a particular sense) is important when it comes to making justified inferences about target systems on the basis (...) of experimental results. (shrink)

Can purely predictive models be useful in investigating causal systems? I argue ‘yes’. Moreover, in many cases not only are they useful, they are essential. The alternative is to stick to models or mechanisms drawn from well-understood theory. But a necessary condition for explanation is empirical success, and in many cases in social and field sciences such success can only be achieved by purely predictive models, not by ones drawn from theory. Alas, the attempt to use theory to achieve explanation (...) or insight without empirical success therefore fails, leaving us with the worst of both worlds – neither prediction nor explanation. Best go with empirical success by any means necessary. I support these methodological claims via case studies of two impressive feats of predictive modelling: opinion polling of political elections, and weather forecasting. (shrink)

While the history and methodology of laboratory experiments in economics have been extensively studied by philosophers, those of field experiments have not attracted much attention until recently. What is the historical context in which field experiments have been advocated? And what are the methodological rationales for conducting experiments in the field as opposed to in the lab? This article addresses these questions by combining historical and methodological perspectives. In terms of history, we show that the movement toward field experiments in (...) economics has two distinct roots. One is the general orientation of medical and social sciences to evidence-based policy evaluation, which gave rise to randomized field experiments in economics. The other is an awareness of several methodological limitations of lab experiments in economics, which required practitioners to get out of the lab and into the field. In these senses, the movement is a consequence of influences from both outside and inside economics: the general evidence-based trend in policy science and an internal methodological development of experimental economics. In terms of methodology, we show that these two roots resulted in two somewhat different notions of “external validity” as methodological rationales of field experiment. Finally, we suggest that analysis of experiments as exhibits highlights a methodological strategy in which both strands complement each other. (shrink)

The growing acceptance and success of experimental economics has increased the interest of researchers in tackling philosophical and methodological challenges to which their work increasingly gives rise. I sketch some general issues that call for the combined expertise of experimental economists and philosophers of science, of experiment, and of inductive‐statistical inference and modeling. †To contact the author, please write to: 235 Major Williams, Virginia Tech, Blacksburg, VA 24061‐0126; e‐mail: [email protected].

The predictive inadequacy of the social sciences is well documented, and philosophers have sought to diagnose it. This paper examines Brian Epstein’s recent diagnosis. He argues that the social sciences treat the social world as entirely composed of individual people. Instead, social scientists should recognize that material, non-individualistic entities determine the social world, as well. First, I argue that Epstein’s argument both begs the question against his opponents and is not sufficiently charitable. Second, I present doubts that his proposal will (...) improve predictive success for the social sciences, which I support with Edith Penrose’s resource-based theory of the firm. (shrink)

This paper argues that an important type of experiment-target inference, extrapolating causal effects, requires models to be successful. Focusing on extrapolation in Evidence-Based Policy, it is ar...

The Dictator Game, one of the best-known designs in experimental social science, has been extensively criticized, and declared by some to be defunct, on the grounds that its results are the product of a research artefact. Critics of the DG argue that the behaviour observed in the game is not the outcome of genuine pro-social preferences but must, instead, be interpreted as a response to the cues given by the experimental design, where these cues signal that the game is about (...) ‘sharing’. Despite this criticism, the DG continues to be extensively used, and some have defended its validity as an instrument capable of measuring the role of social pressure and social norms against economic motivations. This article examines the assumptions implicit in the claim that the DG results are artefactual and spells out the conditions under which the game can be used to test hypotheses about pro-social... (shrink)

The experimental revolution in the social sciences is one of the most significant methodological shifts undergone by the field since the ‘quantitative revolution’ in the nineteenth century. One of the often valued features of social science experimentation is precisely the fact that there are clear methodological rules regarding hypothesis testing that come from the methods of the natural sciences and from the methodology of RCTs in the biomedical sciences, and that allow for the adjudication among contentious causal claims. We examine (...) critically this claim and argue that some current understandings of the practices that surround social science experimentation overestimate the degree to which experiments can actually fulfil this role as “objective” adjudicators, by neglecting the importance of shared background knowledge or assumptions and of consensus regarding the validity of the constructs involved in an experiment. We take issue with the way the distinction between internal and external validity is often used to comment on the inferential import of experiments, used both among practitioners and among philosophers of science. We describe the ways in which the more common use of the internal/external distinction differs from Cook and Campbell’s original methodological project, in which construct validity and the four-fold validity typology were all important in assessing the inferential import of experiments. We argue that the current uses of the labels internal and external, as applied to experimental validity, help to encroach a simplistic view on the inferential import of experiments that, in turn, misrepresents their capacity to provide objective knowledge about the causal relations between variables. (shrink)

A series of recent debates in experimental economics have associated demand effects with the artificiality of the experimental setting and have linked it to the problem of external validity. In this paper, we argue that these associations can be misleading, partly because of the ambiguity with which “artificiality” has been defined, but also because demand effects and external validity are related in complex ways. We argue that artificiality may be directly as well as inversely correlated with demand effects. We also (...) distinguish between the demand effects of experimentation and the reactions that they may trigger and that might endanger experimental validity. We conclude that economists should pay more attention to the way in which subjects construe the experimental task and learn to exploit subjects’ reactivity to expectations in their experiments. (shrink)

It is often said that computer simulations generate new knowledge about the empirical world in the same way experiments do. My aim is to make sense of such a claim. I first show that the similarities between computer simulations and experiments do not allow them to generate new knowledge but invite the simulationist to interact with simulations in an experimental manner. I contend that, nevertheless, computer simulations and experiments yield new knowledge under the same epistemic circumstances, independently of any features (...) they may share. (shrink)

Proponents of evidence-based medicine and some philosophers of science seem to agree that knowledge of mechanisms can help solve the problem of applying results of controlled studies to target populations (‘the problem of extrapolation’). We describe the problem of extrapolation, characterize mechanisms, and outline how mechanistic knowledge might be used to solve the problem. Our main thesis is that there are four often overlooked problems with using mechanistic knowledge to solve the problem of extrapolation. First, our understanding of mechanisms is (...) often (and arguably, likely to remain) incomplete. Secondly, knowledge of mechanisms is not always applicable outside the tightly controlled laboratory conditions in which it is gained. Thirdly, mechanisms can behave paradoxically. Fourthly, as Daniel Steel points out, using mechanistic knowledge faces the problem of the ‘extrapolator’s circle’. At the same time, when the problems with mechanistic knowledge have been addressed, such knowledge can and should be used to mitigate (nothing can entirely solve) the problem of extrapolation. (shrink)

Can human social cognitive processes and social motives be grasped by the methods of experimental economics? Experimental studies of strategic cognition and social preferences contribute to our understanding of the social aspects of economic decisions making. Yet, papers in this issue argue that the social aspects of decision-making introduce several difficulties for interpreting the results of economic experiments. In particular, the laboratory is itself a social context, and in many respects a rather distinctive one, which raises questions of external validity.

This article examines, experimentally, whether inequality affects the social capital of trust in non-market and market settings. We consider three experimental treatments, one with equality, one with inequality but no knowledge of the income of other agents, and one with inequality and knowledge. Inequality, particularly when it is known, has a corrosive effect on trusting behaviours in this experiment. Agents appear to be less sensitive to known relative income differentials in markets than they are in the non-market settings, but trust (...) in markets appears generally more vulnerable to the introduction of inequality than in the non-market setting. (shrink)

This paper discusses the development of the field of economic methodology during the last few decades emphasizing the early influence of the "shelf" of Popperian philosophy and the division between neoclassical and heterodox economics. It argues that the field of methodology has recently adopted a more naturalistic approach focusing primarily on the "new pluralist" subfields of experimental economics, behavioral economics, neuroeconomics, and related subjects.