If payoffs are tickets for binary lotteries, which involve only two money prizes, then rationality requires expected value maximization in tickets. This payoff scheme was increasingly used to induce risk neutrality in experiments. The experiment presented here involved lottery choice and evaluation tasks. One subject group was paid in binary lottery tickets, another directly in money. Significantly greater deviations from risk neutral behavior are observed with binary lottery payoffs. This discrepancy increases when subjects have easy access to the alternatives' expected (...) values and mean absolute deviations. Behavioral regularities are observed at least as often as with direct money payoffs. (shrink)

Modern empiricism has been conditioned in large part by two dogmas. One is a belief in some fundamental cleavage between truths which are analytic, or grounded in meanings independently of matters of fact, and truth which are synthetic, or grounded in fact. The other dogma is reductionism: the belief that each meaningful statement is equivalent to some logical construct upon terms which refer to immediate experience. Both dogmas, I shall argue, are ill founded. One effect of abandoning them is, as (...) we shall see, a blurring of the supposed boundary between speculative metaphysics and natural science. Another effect is a shift toward pragmatism. (shrink)

Once upon a time, logic was the philosopher’s tool for analyzing scientific reasoning. Nowadays, probability and statistics have largely replaced logic, and their most popular application—Bayesianism—has replaced the qualitative deductive relationship between a hypothesis h and evidence e with a quantitative measure of h’s probability in light of e.

This target article is concerned with the implications of the surprisingly different experimental practices in economics and in areas of psychology relevant to both economists and psychologists, such as behavioral decision making. We consider four features of experimentation in economics, namely, script enactment, repeated trials, performance-based monetary payments, and the proscription against deception, and compare them to experimental practices in psychology, primarily in the area of behavioral decision making. Whereas economists bring a precisely defined “script” to experiments for participants to (...) enact, psychologists often do not provide such a script, leaving participants to infer what choices the situation affords. By often using repeated experimental trials, economists allow participants to learn about the task and the environment; psychologists typically do not. Economists generally pay participants on the basis of clearly defined performance criteria; psychologists usually pay a flat fee or grant a fixed amount of course credit. Economists virtually never deceive participants; psychologists, especially in some areas of inquiry, often do. We argue that experimental standards in economics are regulatory in that they allow for little variation between the experimental practices of individual researchers. The experimental standards in psychology, by contrast, are comparatively laissez-faire. We believe that the wider range of experimental practices in psychology reflects a lack of procedural regularity that may contribute to the variability of empirical findings in the research fields under consideration. We conclude with a call for more research on the consequences of methodological preferences, such as the use on monetary payments, and propose a “do-it-both-ways” rule regarding the enactment of scripts, repetition of trials, and performance-based monetary payments. We also argue, on pragmatic grounds, that the default practice should be not to deceive participants. Key Words: behavioral decision making; cognitive illusions; deception; experimental design; experimental economics; experimental practices; financial incentives; learning; role playing. (shrink)

In psychology, deception is commonly used to increase experimental control. Yet, its use has provoked concerns that it raises participants' suspicions, prompts second-guessing of experimenters' true intentions, and ultimately distorts behavior and endangers the control it is meant to achieve. Over time, these concerns regarding the methodological costs of the use of deception have been subjected to empirical analysis. We review the evidence stemming from these studies.

The answer in a nutshell is: Yes, five years ago, but nobody has noticed. Nobody noticed because the majority of social scientists subscribe to one of the following views: (1) the ‘anomalous’ behaviour observed in standard prisoner’s dilemma or ultimatum game experiments has refuted standard game theory a long time ago; (2) game theory is flexible enough to accommodate any observed choices by ‘refining’ players’ preferences; or (3) it is just a piece of pure mathematics (a tautology). None of these (...) views is correct. This paper defends the view that GT as commonly understood is not a tautology, that it suffers from important (albeit very recently discovered) empirical anomalies, and that it is not flexible enough to accommodate all the anomalies in its theoretical framework. It also discusses the experiments that finally refuted game theory, and concludes trying to explain why it took so long for experimental game theorists to design experiments that could adequately test the theory. (shrink)

Experimental “localism” stresses the importance of context‐specific knowledge, and the limitations of universal theories in science. I illustrate Latour's radical approach to localism and show that it has some unpalatable consequences, in particular the suggestion that problems of external validity (or how to generalize experimental results to nonlaboratory circumstances) cannot be solved. In the last part of the paper I try to sketch a solution to the problem of external validity by extending Mayo's error‐probabilistic approach.