How should we react to the contention that there is empirical evidence showing that many judge Gettier cases to be cases of knowledge, contrary to the verdict of most analytical philosophers about these cases? I argue that there is no single answer to this question. The discussion is set inside a view about how to view the role and significance of intuitive responses to some of philosophy's famous thought experiments. One take-home message is that experimental philosophy and conceptual analysis are (...) not as far apart as is often thought. (shrink)

Edmund Gettier is Professor Emeritus at the University of Massachusetts, Amherst. This short piece, published in 1963, seemed to many decisively to refute an otherwise attractive analysis of knowledge. It stimulated a renewed effort, still ongoing, to clarify exactly what knowledge comprises.

In a recent paper Weinberg (2007) claims that there is an essential mark of trustworthiness which typical sources of evidence as perception or memory have, but philosophical intuitions lack, namely that we are able to detect and correct errors produced by these “hopeful” sources. In my paper I will argue that being a hopeful source isn't necessary for providing us with evidence. I then will show that, given some plausible background assumptions, intuitions at least come close to being hopeful, if (...) they are reliable. If this is true, Weinberg's new challenge comes down to the claim that philosophical intuitions are not reliable since they are significantly unstable. In the second part of my paper I will argue that and why the experimentally established instability of folk intuitions about philosophical cases does not show that philosopher's expert intuitions about these cases are instable. (shrink)

Recent third person approaches to thought experiments and conceptual analysis through the method of surveys are motivated by and motivate skepticism about the traditional first person method. I argue that such surveys give no good ground for skepticism, that they have some utility, but that they do not represent a fundamentally new way of doing philosophy, that they are liable to considerable methodological difficulties, and that they cannot be substituted for the first person method, since the a priori knowledge which (...) is our object in conceptual analysis can be acquired only from the first person standpoint. (shrink)

Appeals to intuitions as evidence in philosophy are challenged by experimental philosophers and other critics. A common response to experimental philosophical criticisms is to hold that only professional philosophers? intuitions count as evidence in philosophy. This ?expert intuitions defence? is inadequate for two reasons. First, recent studies indicate significant variability in professional philosophers? intuitions. Second, the academic literature on professional intuitions gives us reasons to doubt that professional philosophers develop truth-apt intuitions. The onus falls on those who mount the expert (...) intuitions defence to meet these objections because it is implicitly being claimed that training and practice caused professional philosophers to acquire reliably accurate intuitions and we are owed an account of how this transformation takes place. A possible response to this situation is to attempt to reform philosophical practice to improve the quality of intuitions. Another possible response, advocated here, is to avoid appeals to intuitions as evidence. (shrink)

This chapter contains sections titled: Notes and References.

Skepticism about the epistemic value of intuition in theoretical and philosophical inquiry has recently been bolstered by empirical research suggesting that people’s concrete-case intuitions are vulnerable to irrational biases (e.g., the order effect). What is more, skeptics argue that we have no way to ‘‘calibrate” our intuitions against these biases and no way of anticipating intuitional instability. This paper challenges the skeptical position, introducing data from two studies that suggest not only that people’s concrete-case intuitions are often stable, but also (...) that people have introspective awareness of this stability, providing a promising means by which to assess the epistemic value of our intuitions. (shrink)

This article offers a critique of research practices typical of experimental philosophy. To that end, it presents a review of methodological issues that have proved crucial to the quality of research in the biobehavioral sciences. It discusses various shortcomings in the experimental philosophy literature related to (1) the credibility of self-report questionnaires, (2) the validity and reliability of measurement, (3) the adherence to appropriate procedures for sampling, random assignment, and handling of participants, and (4) the meticulousness of study reporting. It (...) argues that the future standing of experimental philosophy will hinge upon improvements in research methods. (shrink)

A striking feature of the traditional armchair method of philosophy is the use of imaginary examples: for instance, of Gettier cases as counterexamples to the justified true belief analysis of knowledge. The use of such examples is often thought to involve some sort of a priori rational intuition, which crude rationalists regard as a virtue and crude empiricists as a vice. It is argued here that, on the contrary, what is involved is simply an application of our general cognitive capacity (...) to handle counterfactual conditionals, which is not exclusively a priori and is not usefully conceived as a form of rational intuition. It is explained how questions of metaphysical possibility and necessity are equivalent to questions about counterfactuals, and the epistemology of the former (in particular, the role of conceiving or imagining) is a special case of the epistemology of the latter. A non-imaginary Gettier case is presented in order to show how little difference it makes. (shrink)

Abstract: Some proponents of “experimental philosophy” criticize philosophers' use of thought experiments on the basis of evidence that the verdicts vary with truth-independent factors. However, their data concern the verdicts of philosophically untrained subjects. According to the expertise defence, what matters are the verdicts of trained philosophers, who are more likely to pay careful attention to the details of the scenario and track their relevance. In a recent article, Jonathan M. Weinberg and others reply to the expertise defence that there (...) is no evidence for such expertise. They now receive a reply in this article, which argues that they have misconstrued the dialectical situation. Since they have produced no evidence that philosophical training is less efficacious for thought experimentation than for other cognitive tasks for which they acknowledge that it produces genuine expertise, such as informal argumentation, they have produced no evidence for treating the former more sceptically than the latter. (shrink)

A striking feature of the traditional armchair method of philosophy is the use of imaginary examples: for instance, of Gettier cases as counterexamples to the justified true belief analysis of knowledge. The use of such examples is often thought to involve some sort of a priori rational intuition, which crude rationalists regard as a virtue and crude empiricists as a vice. It is argued here that, on the contrary, what is involved is simply an application of our general cognitive capacity (...) to handle counterfactual conditionals, which is not exclusively a priori and is not usefully conceived as a form of rational intuition. It is explained how questions of metaphysical possibility and necessity are equivalent to questions about counterfactuals, and the epistemology of the former (in particular, the role of conceiving or imagining) is a special case of the epistemology of the latter. A non-imaginary Gettier case is presented in order to show how little difference it makes. (shrink)

It has become increasingly popular to respond to experimental philosophy by suggesting that experimental philosophers haven’t been studying the right kind of thing. One version of this kind of response, which we call the reflection defense, involves suggesting both that philosophers are interested only in intuitions that are the product of careful reflection on the details of hypothetical cases and the key concepts involved in those cases, and that these kinds of philosophical intuitions haven’t yet been adequately studied by experimental (...) philosophers. Of course, as a defensivemove, thisworks only if reflective intuitions are immune from the kinds of problematic effects that form the basis of recent experimental challenges to philosophy’s intuition-deploying practices. If they are not immune to these kinds of effects, then the fact that experimental philosophers have not had the right kind of thing in their sights would provide little comfort to folks invested in philosophy’s intuition-deploying practices. Here we provide reasons to worry that even reflective intuitions can display sensitivity to the same kinds of problematic effects, although possibly in slightly different ways. As it turns out, being reflective might sometimes just mean being wrong in a different way. (shrink)

Using empirical evidence to attack intuitions can be epistemically dangerous, because various of the complaints that one might raise against them (e.g., that they are fallible; that we possess no non-circular defense of their reliability) can be raised just as easily against perception itself. But the opponents of intuition wish to challenge intuitions without at the same time challenging the rest of our epistemic apparatus. How might this be done? Let us use the term “hopefulness” to refer to the extent (...) to which we possess a good capacity for the detection and correction of the errors of any fallible source of evidence. I argue that we should not trust putative sources of evidence that are substantially lacking in hopefulness (even if they are basically reliable), and that we are indeed already operating under such a norm in our ordinary and scientific practices. I argue further that the philosophical practice of the appeal to intuitions is, in these terms, badly hopeless... (shrink)

Recent experimental philosophy arguments have raised trouble for philosophers' reliance on armchair intuitions. One popular line of response has been the expertise defense: philosophers are highly-trained experts, whereas the subjects in the experimental philosophy studies have generally been ordinary undergraduates, and so there's no reason to think philosophers will make the same mistakes. But this deploys a substantive empirical claim, that philosophers' training indeed inculcates sufficient protection from such mistakes. We canvass the psychological literature on expertise, which indicates that people (...) are not generally very good at reckoning who will develop expertise under what circumstances. We consider three promising hypotheses concerning what philosophical expertise might consist in: (i) better conceptual schemata; (ii) mastery of entrenched theories; and (iii) general practical know-how with the entertaining of hypotheticals. On inspection, none seem to provide us with good reason to endorse this key empirical premise of the expertise defense. (shrink)

Armchair philosophers have questioned the significance of recent work in experimental philosophy by pointing out that experiments have been conducted on laypeople and undergraduate students. To challenge a practice that relies on expert intuitions, so the armchair objection goes, one needs to demonstrate that expert intuitions rather than those of ordinary people are sensitive to contingent facts such as cultural, linguistic, socio-economic, or educational background. This article does exactly that. Based on two empirical studies on populations of 573 and 203 (...) trained philosophers, respectively, it demonstrates that expert intuitions vary dramatically according to at least one contingent factor, namely, the linguistic background of the expert: philosophers make different intuitive judgments if their native language is English rather than Dutch, German, or Swedish. These findings cast doubt on the common armchair assumption that philosophical theories based on armchair intuitions are valid beyond the linguistic background against which they were developed. (shrink)

Recently psychologists and experimental philosophers have reported findings showing that in some cases ordinary people's moral intuitions are affected by factors of dubious relevance to the truth of the content of the intuition. Some defend the use of intuition as evidence in ethics by arguing that philosophers are the experts in this area, and philosophers' moral intuitions are both different from those of ordinary people and more reliable. We conducted two experiments indicating that philosophers and non-philosophers do indeed sometimes have (...) different moral intuitions, but challenging the notion that philosophers have better or more reliable intuitions. (shrink)

In this paper we propose to argue for two claims. The first is that a sizeable group of epistemological projects – a group which includes much of what has been done in epistemology in the analytic tradition – would be seriously undermined if one or more of a cluster of empirical hypotheses about epistemic intuitions turns out to be true. The basis for this claim will be set out in Section 2. The second claim is that, while the jury is (...) still out, there is now a substantial body of evidence suggesting that some of those empirical hypotheses are true. Much of this evidence derives from an ongoing series of experimental studies of epistemic intuitions that we have been conducting. A preliminary report on these studies will be presented in Section 3. In light of these studies, we think it is incumbent on those who pursue the epistemological projects in question to either explain why the truth of the hypotheses does not undermine their projects, or to say why, in light of the evidence we will present, they nonetheless assume that the hypotheses are false. In Section 4, which is devoted to Objections and Replies, we’ll consider some of the ways in which defenders of the projects we are criticizing might reply to our challenge. Our goal, in all of this, is not to offer a conclusive argument demonstrating that the epistemological projects we will be criticizing are untenable. Rather, our aim is to shift the burden of argument. (shrink)

How do people decide which claims should be considered mere beliefs and which count as knowledge? Although little is known about how people attribute knowledge to others, philosophical debate about the nature of knowledge may provide a starting point. Traditionally, a belief that is both true and justified was thought to constitute knowledge. However, philosophers now agree that this account is inadequate, due largely to a class of counterexamples (termed ‘‘Gettier cases’’) in which a person’s justified belief is true, but (...) only due to luck. We report four experiments examining the effect of truth, justification, and ‘‘Gettiering’’ on people’s knowledge attributions. These experiments show that: (1) people attribute knowledge to others only when their beliefs are both true and justified; (2) in contrast to contemporary philosophers, people also attribute knowledge to others in Gettier situations; and (3) knowledge is not attributed in one class of Gettier cases, but only because the agent’s belief is based on ‘‘apparent’’ evidence. These findings suggest that the lay concept of knowledge is roughly consistent with the traditional account of knowledge as justified true belief, and also point to a major difference between the epistemic intuitions of laypeople and those of philosophers. (shrink)

The topic is experimental philosophy as a naturalistic movement, and its bearing on the value of intuitions in philosophy. This paper explores first how the movement might bear on philosophy more generally, and how it might amount to something novel and promising. Then it turns to one accomplishment repeatedly claimed for it already: namely, the discrediting of armchair intuitions as used in philosophy.

In recent years a new discussion on the nature of philosophical expertise has emerged: whether philosophers possess a special kind of expertise, what such expertise would entail, how to measure it, and related concerns. The aim of the present article is to clarify certain related points across these debates in the hope of paving a clearer path forward, by addressing the following. (1) The expertise defense, which seems central to many discussions on methodology and expertise, has been misconstrued at times. (...) (2) Questions of expertise and methodology could be separated more clearly. (3) The study of expertise may be important in its own right; however, there may be good reasons to give priority to methodological concerns. (4) Finally, when viewed in light of methodological concerns, a new project emerges when engaging with recent contributions to the expertise debate. The present article attempts a brief outline of this project. (shrink)

Many philosophers appeal to intuitions to support some philosophical views. However, there is reason to be concerned about this practice as scientific evidence has documented systematic bias in philosophically relevant intuitions as a function of seemingly irrelevant features (e.g., personality). One popular defense used to insulate philosophers from these concerns holds that philosophical expertise eliminates the influence of these extraneous factors. Here, we test this assumption. We present data suggesting that verifiable philosophical expertise in the free will debate-as measured by (...) a reliable and validated test of expert knowledge-does not eliminate the influence of one important extraneous feature (i.e., the heritable personality trait extraversion) on judgments concerning freedom and moral responsibility. These results suggest that, in at least some important cases, the expertise defense fails. Implications for the practice of philosophy, experimental philosophy, and applied ethics are discussed. (shrink)

If explicit cognition about morality promotes moral behavior then one might expect ethics professors to behave particularly well. However, professional ethicists' behavior has never been empirically studied. The present research examined the rates at which ethics books are missing from leading academic libraries, compared to other philosophy books similar in age and popularity. Study 1 found that relatively obscure, contemporary ethics books of the sort likely to be borrowed mainly by professors and advanced students of philosophy were actually about 50% (...) more likely to be missing than non-ethics books. Study 2 found that classic (pre-1900) ethics books were about twice as likely to be missing. (shrink)

Are the moral intuitions of philosophers more reliable than the intuitions of people who are not philosophically trained? According to what has become known as ‘the expertise defence’, the answer is in the affirmative. This answer has been sustained by drawing on analogies to expertise in other fields. However, in this article it is argued that the analogies presuppose two assumptions – the causal assumption and the quality assumption – which are not satisfied in relation to philosophical expertise. Thus, it (...) is suggested that there are reasons to be sceptical with regard to the expertise defence. (shrink)

Intuitively, there is a difference between knowledge and mere belief. Contemporary philosophical work on the nature of this difference has focused on scenarios known as “Gettier cases.” Designed as counterexamples to the classical theory that knowledge is justified true belief, these cases feature agents who arrive at true beliefs in ways which seem reasonable or justified, while nevertheless seeming to lack knowledge. Prior empirical investigation of these cases has raised questions about whether lay people generally share philosophers’ intuitions about these (...) cases, or whether lay intuitions vary depending on individual factors (e.g. ethnicity) or factors related to specific types of Gettier cases (e.g. cases that include apparent evidence). We report an experiment on lay attributions of knowledge and justification for a wide range of Gettier Cases and for a related class of controversial cases known as Skeptical Pressure cases, which are also thought by philosophers to elicit intuitive denials of knowledge. Although participants rated true beliefs in Gettier and Skeptical Pressure cases as being justified, they were significantly less likely to attribute knowledge for these cases than for matched true belief cases. This pattern of response was consistent across different variations of Gettier cases and did not vary by ethnicity or gender, although attributions of justification were found to be positively related to measures of empathy. These findings therefore suggest that across demographic groups, laypeople share similar epistemic concepts with philosophers, recognizing a difference between knowledge and justified true belief. (shrink)

Recent work in experimental philosophy has indicated that intuitions may be subject to several forms of bias, thereby casting doubt on the viability of intuition as an evidential source in philosophy. A common reply to these findings is the ‘expertise defense’ – the claim that although biases may be found in the intuitions of non-philosophers, persons with expertise in philosophy will be resistant to these biases. Much debate over the expertise defense has centered over the question of the burden of (...) proof; must defenders of expertise provide empirical evidence of its existence, or should we grant the existence of philosophical expertise as a ‘default’ assumption? Defenders have frequently appealed to analogy with other fields; since expertise clearly exists in, e.g., the sciences, we are entitled to assume its existence in philosophy. Recently, however, experimentalists have begun to provide empirical evidence that biases in intuition extend even to philosophers. Though these findings don't yet suffice to defeat the default assumption of expertise the analogy argument motivates, they do force any proponent of the analogy argument to provide more specific and empirically informed proposals for the possible nature of philosophical expertise. (shrink)

The “expertise defense” is the claim that philosophers have special expertise that allows them to resist the biases suggested by the findings of experimental philosophers. Typically, this defense is backed up by an analogy with expertise in science or other academic fields. Recently, however, studies have begun to suggest that philosophers' intuitions may be just as subject to inappropriate variation as those of the folk. Should we conclude that the expertise defense has been debunked? I'll argue that the analogy with (...) science still motivates a default assumption of philosophical expertise; however, the expertise so motivated is not expertise in intuition, and its existence would not suffice to answer the experimentalist challenge. I'll also suggest that there are deep parallels between the current methodological crisis in philosophy and the decline of introspection-based methods in psychology in the early twentieth century. The comparison can give us insight into the possible future evolution of philosoph.. (shrink)

The “expertise defense” is the claim that philosophers have special expertise that allows them to resist the biases suggested by the findings of experimental philosophers. Typically, this defense is backed up by an analogy with expertise in science or other academic fields. Recently, however, studies have begun to suggest that philosophers' intuitions may be just as subject to inappropriate variation as those of the folk. Should we conclude that the expertise defense has been debunked? I'll argue that the analogy with (...) science still motivates a default assumption of philosophical expertise; however, the expertise so motivated is not expertise in intuition, and its existence would not suffice to answer the experimentalist challenge. I'll also suggest that there are deep parallels between the current methodological crisis in philosophy and the decline of introspection-based methods in psychology in the early twentieth century. The comparison can give us insight into the possible future evolution of philosophical methodology. (shrink)

Experimental philosophers have challenged friends of the expertise defense to show that the intuitive judgments of professional philosophers are different from the intuitive judgments of nonphilosophers, and the intuitive judgments of professional philosophers are better than the intuitive judgments of nonphilosophers, in ways that are relevant to the truth or falsity of such judgments. Friends of the expertise defense have responded by arguing that the burden of proof lies with experimental philosophers. This article sketches three arguments which show that both (...) and are probably false. If its arguments are cogent, then shifting the burden of proof is a futile move, since philosophical training makes no difference so far as making intuitive judgments in response to hypothetical cases is concerned. (shrink)

This article examines whether people share the Gettier intuition (viz. that someone who has a true justified belief that p may nonetheless fail to know that p) in 24 sites, located in 23 countries (counting Hong Kong as a distinct country) and across 17 languages. We also consider the possible influence of gender and personality on this intuition with a very large sample size. Finally, we examine whether the Gettier intuition varies across people as a function of their disposition to (...) engage in “reflective” thinking. (shrink)

: While thought experiments play an important role in contemporary analytic philosophy, much remains unclear about thought experiments. In particular, it is still unclear whether the judgments elicited by thought experiments can provide evidence for the premises of philosophical arguments. This article argues that, if an influential and promising view about the nature of the judgments elicited by thought experiments is correct, then many thought experiments in philosophy fail to provide any evidence for the premises of philosophical arguments.

We have recently presented evidence for cross-cultural variation in semantic intuitions and explored the implications of such variation for philosophical arguments that appeal to some theory of reference as a premise. Devitt (2011) and Ichikawa and colleagues (forthcoming) offer critical discussions of the experiment and the conclusions that can be drawn from it. In this response, we reiterate and clarify what we are really arguing for, and we show that most of Devitt’s and Ichikawa and colleagues’ criticisms fail to address (...) our concerns. (shrink)

I address a criticism of the use of thought experiments in conceptual analysis advanced on the basis of the survey method of so-called experimental philosophy. The criticism holds that surveys show that intuitions are relative to cultures in a way that undermines the claim that intuition-based investigation yields any objective answer to philosophical questions. The crucial question is what intuitions are as philosophers have been interested in them. To answer this question we look at the role of intuitions in philosophical (...) inquiry. When we have done this, we can see that it is impossible for intuitions properly understood to be relative in the way that has been suggested as they are conceived of as expressions of competence in the concepts deployed in their contents. The remaining methodological issues, though not to be dismissed, present no in principle objection to the method of thought experiments. (shrink)

In disputes about conceptual analysis, each side typically appeals to pre-theoretical 'intuitions' about particular cases. Recently, many naturalistically oriented philosophers have suggested that these appeals should be understood as empirical hypotheses about what people would say when presented with descriptions of situations, and have consequently conducted surveys on non-specialists. I argue that this philosophical research programme, a key branch of what is known as 'experimental philosophy', rests on mistaken assumptions about the relation between people's concepts and their linguistic behaviour. The (...) conceptual claims that philosophers make imply predictions about the folk's responses only under certain demanding, counterfactual conditions. Because of the nature of these conditions, the claims cannot be tested with methods of positivist social science. We are, however, entitled to appeal to intuitions about folk concepts in virtue of possessing implicit normative knowledge acquired through reflective participation in everyday linguistic practices. (shrink)

Considers that intuitive predictions follow a judgmental heuristic-representativeness. By this heuristic, people predict the outcome that appears most representative of the evidence. Consequently, intuitive predictions are insensitive to the reliability of the evidence or to the prior probability of the outcome, in violation of the logic of statistical prediction. The hypothesis that people predict by representativeness was supported in a series of studies with both naive and sophisticated university students. The ranking of outcomes by likelihood coincided with the ranking by (...) representativeness, and Ss erroneously predicted rare events and extreme values if these happened to be representative. The experience of unjustified confidence in predictions and the prevalence of fallacious intuitions concerning statistical regression are traced to the representativeness heuristic. (shrink)

Champions of the methodological movement of experimental philosophy have challenged the long-standing practice of relying on intuitive verdicts on cases in philosophical inquiry. They argue that th...

Experimental restrictionists have challenged philosophers’ reliance on intuitions about thought experiment cases based on experimental findings. According to the expertise defense, only the intuitions of philosophical experts count—yet the bulk of experimental philosophy consists in studies with lay people. In this paper, we argue that direct strategies for assessing the expertise defense are preferable to indirect strategies. A direct argument in support of the expertise defense would have to show: first, that there is a significant difference between expert and lay (...) intuitions; second, that expert intuitions are superior to lay intuitions; and third, that expert intuitions accord with the relevant philosophical consensus. At present, there is only little experimental evidence that bears on these issues. To advance the debate, we conducted two new experiments on intuitions about knowledge with experts and lay people. Our results suggest that the intuitions of epistemological experts are superior in some respects, but they also pose an unexpected challenge to the expertise defense. Most strikingly, we found that even epistemological experts tend to ascribe knowledge in fake-barn-style cases. This suggests that philosophy, as a discipline, might fail to adequately map the intuitions of its expert practitioners onto a disciplinary consensus. (shrink)

In this paper, I am going to offer a reconstruction of a challenge to intuition-based armchair philosophy that has been put forward by experimental philosophers of a restrictionist stripe, which I will call the 'master argument'. I will then discuss a number of popular objections to this argument and explain why they either fail to cast doubt on its first, empirical premise or do not go deep enough to make for a lasting rebuttal. Next, I will consider two more promising (...) objections, the grounding objection and the expertise objection, which aim at the second, epistemic premise of the argument. Against this background, I will then suggest what I call 'conservative restrictionism' as the most reasonable default reaction to the experimentalist challenge, which is a combination of the two views of local restrictionism and methodological conservativism. (shrink)

Recently, a new movement of philosophers, called 'experimental philosophy', has suggested that the philosophers' favored armchair is in flames. In order to assess some of their claims, it is helpful to provide a theoretical background against which we can discuss whether certain facts are, or could be, evidence for or against a certain view about how philosophical intuitions work and how good they are. In this paper, I will be mostly concerned with providing such a theoretical background, and I will (...) start discussing in which way experimental philosophy challenges the reliability of philosophical intuitions and how its challenge fits into some more theoretical considerations that also point towards a reliability problem for intuitions. The paper attempts to argue that a certain account of intuitions—the imaginationist account—is available which is well-suited for explicating the expertise reply to the challenge of experimental philosophy. (shrink)

It is a commonplace that in philosophy, intuitions supply evidence for and against philosophical theories. Recent work in experimental philosophy has brought to bear the intuitions of philosophically naïve subjects in a number of different ways. One line of response to this work has been to claim that philosophers have expertise that privileges their intuitive judgments, and allows them to disregard the judgments of non-experts. This expertise is supposed to be analogous to the expertise of the mathematician or the physicist. (...) This paper critically evaluates this appeal to philosophical expertise. (shrink)

This target article is concerned with the implications of the surprisingly different experimental practices in economics and in areas of psychology relevant to both economists and psychologists, such as behavioral decision making. We consider four features of experimentation in economics, namely, script enactment, repeated trials, performance-based monetary payments, and the proscription against deception, and compare them to experimental practices in psychology, primarily in the area of behavioral decision making. Whereas economists bring a precisely defined “script” to experiments for participants to (...) enact, psychologists often do not provide such a script, leaving participants to infer what choices the situation affords. By often using repeated experimental trials, economists allow participants to learn about the task and the environment; psychologists typically do not. Economists generally pay participants on the basis of clearly defined performance criteria; psychologists usually pay a flat fee or grant a fixed amount of course credit. Economists virtually never deceive participants; psychologists, especially in some areas of inquiry, often do. We argue that experimental standards in economics are regulatory in that they allow for little variation between the experimental practices of individual researchers. The experimental standards in psychology, by contrast, are comparatively laissez-faire. We believe that the wider range of experimental practices in psychology reflects a lack of procedural regularity that may contribute to the variability of empirical findings in the research fields under consideration. We conclude with a call for more research on the consequences of methodological preferences, such as the use on monetary payments, and propose a “do-it-both-ways” rule regarding the enactment of scripts, repetition of trials, and performance-based monetary payments. We also argue, on pragmatic grounds, that the default practice should be not to deceive participants. Key Words: behavioral decision making; cognitive illusions; deception; experimental design; experimental economics; experimental practices; financial incentives; learning; role playing. (shrink)

Most students are trained in using but not in actively choosing a research methodology. I support Hertwig and Ortmann's call for more rationality in the use of methodology. I comment on additional practices that sacrifice experimental control to the experimenter's convenience, and on the strange fact that such laissez-faire attitudes and rigid intolerance actually co-exist in psychological research programs.

We examined the effects of order of presentation on the moral judgments of professional philosophers and two comparison groups. All groups showed similar-sized order effects on their judgments about hypothetical moral scenarios targeting the doctrine of the double effect, the action-omission distinction, and the principle of moral luck. Philosophers' endorsements of related general moral principles were also substantially influenced by the order in which the hypothetical scenarios had previously been presented. Thus, philosophical expertise does not appear to enhance the stability (...) of moral judgments against this presumably unwanted source of bias, even given familiar types of cases and principles. (shrink)

Recent experimental studies indicate that epistemically irrelevant factors can skew our intuitions, and that some degree of scepticism about appealing to intuition in philosophy is warranted. In response, some have claimed that philosophers are experts in such a way as to vindicate their reliance on intuitions—this has become known as the ‘expertise defence’. This paper explores the viability of the expertise defence, and suggests that it can be partially vindicated. Arguing that extant discussion is problematically imprecise, we will finesse the (...) notion of ‘philosophical expertise’ in order to better reflect the complex reality of the different practices involved in philosophical inquiry. On this basis, we offer a new version of the expertise defence that allows for distinct types of philosophical expertise. The upshot of our approach is that wholesale vindications or rejections of the expertise defence are shown to be unwarranted; we must instead turn to local, piecemeal investigations of philosophical expertise. Lastly, in the spirit of taking our own advice, we exemplify how recent developments from experimental philosophy lend themselves to this approach, and can empirically support one instance of a successful expertise defence. (shrink)