-/- For all that digital methods—including network visualization, text analysis, and others—have begun to show extensive promise in philosophical contexts, a tension remains between two uses of those tools that have often been taken to be incompatible, or at least to engage in a kind of trade-off: the discovery of new hypotheses and the testing of already-formulated positions. This paper presents this basic distinction, then explores ways to resolve this tension with the help of two interdisciplinary case studies, taken from (...) preregistration in contemporary science and the debate over whig history in the history of science. These case studies, the paper argues, refocus our attention from a mutually exclusive testing/discovery binary to the relationship between our background data or philosophical views and the empirical generalizations that we might draw from the data. Finally, it develops a set of three challenges for philosophers and corresponding avenues for future work that will, it is hoped, allow us to better justify our use of these methods. (shrink)

(Editorial introduction to a special issue of Synthese.).

One of the critical issues in the philosophy of science is to understand scientific knowledge. This paper proposes a novel approach to the study of reflection on science, called “cognitive metascience”. In particular, it offers a new understanding of scientific knowledge as constituted by various kinds of scientific representations, framed as cognitive artifacts. It introduces a novel functional taxonomy of cognitive artifacts prevalent in scientific practice, covering a huge diversity of their formats, vehicles, and functions. As a consequence, toolboxes, conceptual (...) frameworks, theories, models, and individual hypotheses can be understood as artifacts supporting our cognitive performance. It is also shown that by empirically studying how artifacts function, we may discover hitherto undiscussed virtues and vices of these scientific representations. This paper relies on the use of language technology to analyze scientific discourse empirically, which allows us to uncover the metascientific views of researchers. This, in turn, can become part of normative considerations concerning virtues and vices of cognitive artifacts. (shrink)

In light of the recent credibility crisis in psychology, this paper argues for a greater emphasis on theorizing in scientific research. Although reliable experimental evidence, preregistration, methodological rigor, and new computational frameworks for modeling are important, scientific progress also relies on properly functioning theories. However, the current understanding of the role of theorizing in psychology is lacking, which may lead to future crises. Theories should not be viewed as mere speculations or simple inductive generalizations. To address this issue, the author (...) introduces a framework called “cognitive metascience,” which studies the processes and results of evaluating scientific practice. This study should proceed both qualitatively, as in traditional science and technology studies and cognitive science, and quantitatively, by analyzing scientific discourse using language technology. By analyzing theories as cognitive artifacts that support cognitive tasks, this paper aims to shed more light on their nature. This perspective reveals that multiple distinct theories serve entirely different roles, and studying these roles, along with their epistemic vices and virtues, can provide insight into how theorizing should proceed. The author urges a change in research culture to appreciate the variety of distinct theories and to systematically advance scientific progress. . (shrink)