When experimental participants are given the chance to reflect and revise their initial judgments in a dynamic conversational context, do their responses to philosophical scenarios differ from responses to those same scenarios presented in a traditional static survey? In three experiments comparing responses given in conversational contexts with responses to traditional static surveys, we find no consistent evidence that responses differ in these different formats. This aligns with recent findings that various manipulations of reflectiveness have no effect on participants’ judgments (...) about philosophical scenarios. Although we did not find a consistent quantitative effect of format (conversation vs. static survey), conversational experiments still provide qualitative insights into debates about how participants are understanding (or misunderstanding) the scenarios they read in experimental studies, whether they are replacing difficult questions with questions that are more easily answered, and how participants are imagining the scenarios they read in ways that differ from what is explicitly stated by experimenters. We argue that conversational experiments—"Socratic questionnaires"—help show what is going on “under the hood” of traditional survey designs in the experimental investigation of philosophical questions. (shrink)

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

Philosophy is a reflective activity. So perhaps it is unsurprising that many philosophers have claimed that reflection plays an important role in shaping and even improving our philosophical thinking. This hypothesis seems plausible given that training in philosophy has correlated with better performance on tests of reflection and reflective reasoning has correlated with demonstrably better judgments in a variety of domains. This article reviews the hypothesized roles of reflection in philosophical thinking as well as the empirical evidence for these roles. (...) This reveals that although there are fairly reliable links between reflection and philosophical judgment among both laypeople and philosophers, the role of reflection in philosophical thinking may nonetheless depend in part on other factors, some of which have yet to be determined. So progress in research on reflection in philosophy may require further innovation in experimental methods and psychometric validation of philosophical measures. (shrink)

This paper presents new evidence on the impact of socioeconomic status and education on knowledge attribution. I examine a variety of cases, including vignettes where agents have been Gettiered, have false beliefs, and possess knowledge. Early work investigated whether SES might be associated with knowledge attribution :429–460, 2001; Seyedsayamdost in Episteme 12:95–116, 2014). But these studies used college education as a dummy variable for SES. I use the recently developed Great British Class Survey :219–250, 2013) to measure SES. The paper (...) reports evidence against an association between SES and patterns of knowledge ascription, and reports mixed evidence about education effects. (shrink)