Experimental Philosophy: Corpus Analysis

Nietzsche promises to “translate man back into nature,” but it remains unclear what he meant by this and to what extent he succeeded at it. To help come to grips with Nietzsche’s conceptions of drive (Trieb), instinct (Instinkt) and virtue (Tugend and/or Keuschheit), I develop novel digital humanities methods to systematically track his use of these terms, constructing a near-comprehensive catalogue of what he takes these dispositions to be and how he thinks they are related. Nietzsche individuate drives and instincts (...) by the type of actions they motivate. One way in which the “translation” of man back into nature might succeed is through naturalistic explanation and reduction of moral notions such as virtue in terms of amoral, naturalistic notions, such as drives and instincts. I go on to show that this is indeed Nietzsche’s project: for him, a virtue is a well-calibrated drive. Such calibration relates both to the rest of the agent’s psychic economy (her other drives) and to her social context (what’s considered praiseworthy and blameworthy in her community). (shrink)

Obituaries are an especially rich resource for identifying people’s values. Because obituaries are succinct and explicitly intended to summarize their subjects’ lives, they may be expected to include only the features that the author(s) find most salient, not only for themselves as relatives or friends of the deceased, but also to signal to others in the community the socially-recognized aspects of the deceased’s character. We report three approaches to the scientific study of virtue and value through obituaries. We begin by (...) reviewing studies 1 and 2, in which obituaries were carefully read and labeled. We then report study 3, which further develops these results with a semi-automated, large-scale semantic analysis of several thousand obituaries. Finally, we present the results of study 4 in which individuals were asked to write prospective obituaries. Geography, gender, and elite status all turn out to influence the virtues and values associated with the deceased. (shrink)

Critics across the political spectrum have worried that ordinary uses of words like 'racist', 'sexist', and 'homophobic' are becoming conceptually inflated, meaning that these expressions are getting used so widely that they lose their nuance and, thereby, their moral force. However, the charge of conceptual inflation, as well as responses to it, are standardly made without any systematic investigation of how 'racist' and other expressions condemning oppression are actually used in ordinary language. Once we examine large linguistic corpora to see (...) how these expressions are actually used, we find that English speakers have a rich linguistic repertoire for qualifying the degree to which and dimensions along which something is racist, sexist, homophobic, and so on. These facts about ordinary usage undermine the charge of conceptual inflation. Without awareness of facts about ordinary usage, theorists risk making linguistic prescriptions that are unnecessary or counterproductive. (shrink)

It is a common view among philosophers of science that theoretical virtues (also known as epistemic or cognitive values), such as simplicity and consistency, play an important role in scientific practice. In this paper, I set out to study the role that theoretical virtues play in scientific practice empirically. I apply the methods of data science, such as text mining and corpus analysis, to study large corpora of scientific texts in order to uncover patterns of usage. These patterns of usage, (...) in turn, might shed some light on the role that theoretical virtues play in scientific practice. Overall, the results of this empirical study suggest that scientists invoke theoretical virtues explicitly, albeit rather infrequently, when they talk about models (less than 30%), theories (less than 20%), and hypotheses (less than 15%) in their published works. To the extent that they are mentioned in scientific publications, the results of this study suggest that accuracy, consistency, and simplicity are the theoretical virtues that scientists invoke more frequently than the other theoretical virtues tested in this study. Interestingly, however, depending on whether they talk about hypotheses, theories, or models, scientists may invoke one of those theoretical virtues more than the others. (shrink)

Drawing on the epistemology of logic literature on anti-exceptionalism about logic, we set out to investigate the following metaphilosophical questions empirically: Is philosophy special? Are its methods (dis)continuous with science? More specifically, we test the following metaphilosophical hypotheses empirically: philosophical deductivism, philosophical inductivism, and philosophical abductivism. Using indicator words to classify arguments by type (namely, deductive, inductive, and abductive arguments), we searched through a large corpus of philosophical texts mined from the JSTOR database (n = 435,703) to find patterns of (...) argumentation. The results of our quantitative, corpus-based study suggest that deductive arguments are significantly more common than abductive arguments and inductive arguments in philosophical texts overall, but they are gradually and steadily giving way to non-deductive (i.e., inductive and abductive) arguments in academic philosophy. (shrink)

Research in experimental philosophy has increasingly been turning to corpus methods to produce evidence for empirical claims, as they open up new possibilities for testing linguistic claims or studying concepts across time and cultures. The present article reviews the quasi-experimental studies that have been done using textual data from corpora in philosophy, with an eye for the modeling and experimental design that enable statistical inference. I find that most studies forego comparisons that could control for confounds, and that only a (...) little less than half employ statistical testing methods to control for chance results. Furthermore, at least some researchers make modeling decisions that either do not take into account the nature of corpora and of the word-concept relationship, or undermine the experiment's capacity to answer research questions. I suggest that corpus methods could both provide more powerful evidence and gain more mainstream acceptance by improving their modeling practices. (shrink)

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

We investigate claims about the frequency of "know" made by philosophers. Our investigation has several overlapping aims. First, we aim to show what is required to confirm or disconfirm philosophers’ claims about the comparative frequency of different uses of philosophically interesting expressions. Second, we aim to show how using linguistic corpora as tools for investigating meaning is a productive methodology, in the sense that it yields discoveries about the use of language that philosophers would have overlooked if they remained in (...) their "armchairs of an afternoon", to use J.L. Austin’s phrase. Third, we discuss facts about the meaning of "know" that so far have been ignored in philosophy, with the aim of reorienting discussions of the relevance of ordinary language for philosophical theorizing. (shrink)

Empirical philosophers of science aim to base their philosophical theories on observations of scientific practice. But since there is far too much science to observe it all, how can we form and test hypotheses about science that are sufficiently rigorous and broad in scope, while avoiding the pitfalls of bias and subjectivity in our methods? Part of the answer, we claim, lies in the computational tools of the digital humanities, which allow us to analyze large volumes of scientific literature. Here (...) we advocate for the use of these methods by addressing a number of large-scale, justificatory concerns—specifically, about the epistemic value of journal articles as evidence for what happens elsewhere in science, and about the ability of DH tools to extract this evidence. Far from ignoring the gap between scientific literature and the rest of scientific practice, effective use of DH tools requires critical reflection about these relationships. (shrink)

The aim of this paper is to contribute to the debate over the nature of scientific progress in philosophy of science by taking a quantitative, corpus-based approach. By employing the methods of data science and corpus linguistics, the following philosophical accounts of scientific progress are tested empirically: the semantic account of scientific progress, the epistemic account of scientific progress, and the noetic account of scientific progress. Overall, the results of this quantitative, corpus-based study lend some empirical support to the epistemic (...) and the noetic accounts over the semantic account of scientific progress, for they suggest that practicing scientists use the terms ‘knowledge’ and ‘understanding’ significantly more often than the term ‘truth’ when they talk about the aims or goals of scientific research in their published works. But the results do not favor the epistemic account over the noetic account, or vice versa, for they reveal no significant differences between the frequency with which practicing scientists use the terms ‘knowledge’ and ‘understanding’ when they talk about the aims or goals of scientific research in their published works. (shrink)

Philosophy is often divided into two traditions: analytic and continental philosophy. Characterizing the analytic-continental divide, however, is no easy task. Some philosophers explain the divide in terms of the place of argument in these traditions. This raises the following questions: Is analytic philosophy rife with arguments while continental philosophy is devoid of arguments? Or can different types of arguments be found in analytic and continental philosophy? This paper presents the results of an empirical study of a large corpus of philosophical (...) texts mined from the JSTOR database (n = 53,260) designed to find patterns of argumentation by type. Overall, the results suggest that there are no significant differences between the types of arguments advanced in analytic and continental philosophy journal articles. The findings, therefore, provide no empirical support to the hypothesis that the divide between analytic and continental philosophy has to do with the place of argument in these traditions. (shrink)

The paper critically discusses an empirical study by Mizrahi & Dickinson 2020, which analyzes in a huge data base (JSTORE) the incidence of three types of philosophical arguments. Their results are: 1. Deductive arguments were the most commeon type of argument in philosophy until the end of the 20th century. 2. Around 2008 a shift in methodology occurred, such that the indcutive arguments outweigh other types of argument. The paper, first, criticizes the empirical study as grossly false and considers the (...) - very limited - possibilities of recognition of argument types by present computer programs. (shrink)

It is generally accepted among philosophers of science that hypothesis testing is a key methodological feature of science. As far as philosophical theories of confirmation are con...

In this paper, I propose that applying the methods of data science to “the problem of whether mathematical explanations occur within mathematics itself” (Mancosu 2018) might be a fruitful way to shed new light on the problem. By carefully selecting indicator words for explanation and justification, and then systematically searching for these indicators in databases of scholarly works in mathematics, we can get an idea of how mathematicians use these terms in mathematical practice and with what frequency. The results of (...) this empirical study suggest that mathematical explanations do occur in research articles published in mathematics journals, as indicated by the occurrence of explanation indicators. When compared with the use of justification indicators, however, the data suggest that justifications occur much more frequently than explanations in scholarly mathematical practice. The results also suggest that justificatory proofs occur much more frequently than explanatory proofs, thus suggesting that proof may be playing a larger justificatory role than an explanatory role in scholarly mathematical practice. (shrink)

There is an ongoing methodological debate in philosophy of science concerning the use of case studies as evidence for and/or against theories about science. In this paper, I aim to make a contribution to this debate by taking an empirical approach. I present the results of a systematic survey of the PhilSci-Archive, which suggest that a sizeable proportion of papers in philosophy of science contain appeals to case studies, as indicated by the occurrence of the indicator words “case study” and/or (...) “case studies.” These results are confirmed by data mined from the JSTOR database on research articles published in leading journals in the field: Philosophy of Science, the British Journal for the Philosophy of Science (BJPS), and the Journal for General Philosophy of Science (JGPS), as well as the Proceedings of the Biennial Meeting of the Philosophy of Science Association (PSA). The data also show upward trends in appeals to case studies in articles published in Philosophy of Science, the BJPS, and the JGPS. The empirical work I have done for this paper provides philosophers of science who are wary of the use of case studies as evidence for and/or against theories about science with a way to do philosophy of science that is informed by data rather than case studies. (shrink)

Until recently, experimental philosophy has been associated with the questionnaire-based study of intuitions; however, experimental philosophers now adapt a wide range of empirical methods for new philosophical purposes. New methods include paradigms for behavioural experiments from across the social sciences as well as computational methods from the digital humanities that can process large bodies of text and evidence. This book offers an accessible overview of these exciting innovations. The volume brings together established and emerging research leaders from several areas of (...) experimental philosophy to explore how new empirical methods can contribute to philosophical debates. Each chapter presents one or several methods new to experimental philosophy, demonstrating their application in a key area of philosophy and discussing their strengths and limitations. Methods covered include eye tracking, virtual reality technology, neuroimaging, statistical learning, and experimental economics as well as corpus linguistics, visualisation techniques and data and text mining. The volume explores their use in moral philosophy and moral psychology, epistemology, philosophy of science, metaphysics, philosophy of language, philosophy of mind and the history of ideas. Methodological Advances in Experimental Philosophy is essential reading for undergraduates, graduate students and researchers working in experimental philosophy. (shrink)

The concept of “life” certainly is of some use to distinguish birds and beavers from water and stones. This pragmatic usefulness has led to its construal as a categorical predicate that can sift out living entities from non-living ones depending on their possessing specific properties—reproduction, metabolism, evolvability etc. In this paper, we argue against this binary construal of life. Using text-mining methods across over 30,000 scientific articles, we defend instead a degrees-of-life view and show how these methods can contribute to (...) experimental philosophy of science and concept explication. We apply topic-modeling algorithms to identify which specific properties are attributed to a target set of entities (bacteria, archaea, viruses, prions, plasmids, phages and the molecule of adenine). Eight major clusters of properties were identified together with their relative relevance for each target entity (two that relate to metabolism and catalysis, one to genetics, one to evolvability, one to structure, and—rather unexpectedly—three that concern interactions with the environment broadly construed). While aligning with intuitions—for instance about viruses being less alive than bacteria—these quantitative results also reveal differential degrees of performance that have so far remained elusive or overlooked. Taken together, these analyses provide a conceptual “lifeness space” that makes it possible to move away from a categorical construal of life by empirically assessing the relative lifeness of more-or-less alive entities. (shrink)

What is philosophy of science? Numerous manuals, anthologies or essays provide carefully reconstructed vantage points on the discipline that have been gained through expert and piecemeal historical analyses. In this paper, we address the question from a complementary perspective: we target the content of one major journal of the field—Philosophy of Science—and apply unsupervised text-mining methods to its complete corpus, from its start in 1934 until 2015. By running topic-modeling algorithms over the full-text corpus, we identified 126 key research topics (...) that span across 82 years. We also tracked their evolution and fluctuating significance over time in the journal articles. Our results concur with and document known and lesser-known episodes of the philosophy of science, including the rise and fall of logic and language-related topics, the relative stability of a metaphysical and ontological questioning (space and time, causation, natural kinds, realism), the significance of epistemological issues about the nature of scientific knowledge as well as the rise of a recent philosophy of biology and other trends. These analyses exemplify how computational text-mining methods can be used to provide an empirical large-scale and data-driven perspective on the history of philosophy of science that is complementary to other current historical approaches. (shrink)

In this chapter we use methods of corpus linguistics to investigate the ways in which mathematicians describe their work as explanatory in their research papers. We analyse use of the words explain/explanation (and various related words and expressions) in a large corpus of texts containing research papers in mathematics and in physical sciences, comparing this with their use in corpora of general, day-to-day English. We find that although mathematicians do use this family of words, such use is considerably less prevalent (...) in mathematics papers than in physics papers or in general English. Furthermore, we find that the proportion with which mathematicians use expressions related to ‘explaining why’ and ‘explaining how’ is significantly different to the equivalent proportion in physics and in general English. We discuss possible accounts for these differences. (shrink)

The “received wisdom” in contemporary analytic philosophy is that intuition talk is a fairly recent phenomenon, dating back to the 1960s. In this paper, we set out to test two interpretations of this “received wisdom.” The first is that intuition talk is just talk, without any methodological significance. The second is that intuition talk is methodologically significant; it shows that analytic philosophers appeal to intuition. We present empirical and contextual evidence, systematically mined from the JSTOR corpus and HathiTrust’s Digital Library, (...) which provide some empirical support for the second rather than the first hypothesis. Our data also suggest that appealing to intuition is a much older philosophical methodology than the “received wisdom” alleges. We then discuss the implications of our findings for the contemporary debate over philosophical methodology. (shrink)

Philosophy of science is expanding via the introduction of new digital data and tools for their analysis. The data comprise digitized published books and journal articles, as well as heretofore unpublished material such as images, archival text, notebooks, meeting notes, and programs. The growth in available data is matched by the extensive development of automated analysis tools. The variety of data sources and tools can be overwhelming. In this article, we survey the state of digital work in the philosophy of (...) science, showing what kinds of questions can be answered and how one can go about answering them. (shrink)

The following method is popular in some areas of philosophy and linguistics when trying to describe the semantics of a given sentence Φ. Present ordinary speakers with scenarios that involve an utterance of Φ, ask them whether these utterances are felicitous or infelicitous and then construct a semantics that assigns the truth-value True to felicitous utterances of Φ and the truth-value False to infelicitous utterances of Φ. The author makes five observations about this intuition-based approach to semantics; their upshot is (...) that it should be revised in favour of a more nuanced method. The author suggests that this method should be based on corpus linguistics and makes some tentative remarks about what it might look like and which questions we need to address in order to develop it. (shrink)

In this chapter, we outline the range of argument forms involving causation that can be found in everyday discourse. We also survey empirical work concerned with the generation and evaluation of such arguments. This survey makes clear that there is presently no unified body of research concerned with causal argument. We highlight the benefits of a unified treatment both for those interested in causal cognition and those interested in argumentation, and identify the key challenges that must be met for a (...) full understanding of causal argumentation. (shrink)

Search in an environment with an uncertain distribution of resources involves a trade-off between exploitation of past discoveries and further exploration. This extends to information foraging, where a knowledge-seeker shifts between reading in depth and studying new domains. To study this decision-making process, we examine the reading choices made by one of the most celebrated scientists of the modern era: Charles Darwin. From the full-text of books listed in his chronologically-organized reading journals, we generate topic models to quantify his local (...) (text-to-text) and global (text-to-past) reading decisions using Kullback-Liebler Divergence, a cognitively-validated, information-theoretic measure of relative surprise. Rather than a pattern of surprise-minimization, corresponding to a pure exploitation strategy, Darwin’s behavior shifts from early exploitation to later exploration, seeking unusually high levels of cognitive surprise relative to previous eras. These shifts, detected by an unsupervised Bayesian model, correlate with major intellectual epochs of his career as identified both by qualitative scholarship and Darwin’s own self-commentary. Our methods allow us to compare his consumption of texts with their publication order. We find Darwin’s consumption more exploratory than the culture’s production, suggesting that underneath gradual societal changes are the explorations of individual synthesis and discovery. Our quantitative methods advance the study of cognitive search through a framework for testing interactions between individual and collective behavior and between short- and long-term consumption choices. This novel application of topic modeling to characterize individual reading complements widespread studies of collective scientific behavior. (shrink)

The experimental philosophy movement advocates the use of empirical methods in philosophy. The methods most often discussed and in fact employed in experimental philosophy are appropriated from the experimental paradigm in psychology. But there is a variety of other (at least partly) empirical methods from various disciplines that are and others that could be used in philosophy. The paper explores the application of corpus analysis to philosophical issues. Although the method is well established in linguistics, there are only a few (...) tentative attempts of philosophers to utilise it. Examples are introduced and the merit of corpus analysis is compared to that of using general internet search engines and questionnaires for similar purposes. (shrink)

The goal of this short paper is to show that esthetic adjectives—exemplified by “beautiful” and “elegant”—do not pattern stably on a range of linguistic diagnostics that have been used to taxonomize the gradability properties of adjectives. We argue that a plausible explanation for this puzzling data involves distinguishing two properties of gradable adjectives that have been frequently conflated: whether an adjective’s applicability is sensitive to a comparison class, and whether an adjective’s applicability is context-dependent.

According to the antirealist argument known as the pessimistic induction, the history of science is a graveyard of dead scientific theories and abandoned theoretical posits. Support for this pessimistic picture of the history of science usually comes from a few case histories, such as the demise of the phlogiston theory and the abandonment of caloric as the substance of heat. In this article, I wish to take a new approach to examining the ‘history of science as a graveyard of theories’ (...) picture. Using JSTOR Data for Research and Springer Exemplar, I present new lines of evidence that are at odds with this pessimistic picture of the history of science. When rigorously tested against the historical record of science, I submit, the pessimistic picture of the history of science as a graveyard of dead theories and abandoned posits may turn out to be no more than a philosophers’ myth. (shrink)

We introduce here evoText, a new tool for automated analysis of the literature in the biological sciences. evoText contains a database of hundreds of thousands of journal articles and an array of analysis tools for generating quantitative data on the nature and history of life science, especially ecology and evolutionary biology. This article describes the features of evoText, presents a variety of examples of the kinds of analyses that evoText can run, and offers a brief tutorial describing how to use (...) it. (shrink)

Recent decades have seen a surge in interest in metaphilosophy. In particular there has been an interest in philosophical methodology. Various questions have been asked about philosophical methods. Are our methods any good? Can we improve upon them? Prior to such evaluative and ameliorative concerns, however, is the matter of what methods philosophers actually use. Worryingly, our understanding of philosophical methodology is impoverished in various respects. This article considers one particular respect in which we seem to be missing an important (...) part of the picture. While it is a received wisdom that the word “ intuition ” has exploded across analytic philosophy in recent decades, the article presents evidence that the explosion is apparent across a broad swathe of academia. It notes various implications for current methodological debates about the role of intuitions in philosophy. (shrink)

Dispositions are modal properties. The standard conception of dispositions holds that each disposition is individuated by its stimulus condition(s) and its manifestation(s), and that their modality is best captured by some conditional construction that relates stimulus to manifestation as antecedent to consequent. I propose an alternative conception of dispositions: each disposition is individuated by its manifestation alone, and its modality is closest to that of possibility — a fragile vase, for instance, is one that can break easily. The view is (...) expounded in some detail and defended against the major objections. (shrink)

In the philosophical literature on mental states, the paradigmatic examples of mental states are beliefs, desires, intentions, and phenomenal states such as being in pain. The corresponding list in the psychological literature on mental state attribution includes one further member: the state of knowledge. This article examines the reasons why developmental, comparative and social psychologists have classified knowledge as a mental state, while most recent philosophers--with the notable exception of Timothy Williamson-- have not. The disagreement is traced back to a (...) difference in how each side understands the relationship between the concepts of knowledge and belief, concepts which are understood in both disciplines to be closely linked. Psychologists and philosophers other than Williamson have generally have disagreed about which of the pair is prior and which is derivative. The rival claims of priority are examined both in the light of philosophical arguments by Williamson and others, and in the light of empirical work on mental state attribution. (shrink)