Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, (...) and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, what (...) level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

While the term “reactivity” has come to be associated with specific phenomena in the social sciences, having to do with subjects’ awareness of being studied, this paper takes a broader stance on this concept. I argue that reactivity is a ubiquitous feature of the psychological subject matter and that this fact is a precondition of experimental research, while also posing potential problems for the experimenter. The latter are connected to the worry about distorted data and experimental artifacts. But what are (...) experimental artifacts and what is the most productive way of dealing with them? In this paper, I approach these questions by exploring the ways in which experimenters in psychology simultaneously exploit and suppress the reactivity of their subject matter in order to produce experimental data that speak to the question or subject matter at hand. Highlighting the artificiality of experimental data, I raise the question of what distinguishes a genuine experimental result from an experimental artifact. My analysis construes experimental results as the outcomes of inferences from the data that take material background assumptions as auxiliary premises. Artifacts occur when one or more of these background assumptions are false, such that the data do not reliably serve the purposes they were generated for. I conclude by laying out the ways in which my analysis of data quality is relevant to, and informed by, recent debates about the replicability of experimental results. (shrink)

It is commonly held that research efforts in the cognitive and behavioral sciences are mainly directed toward providing explanations and that phenomena figure into scientific practice qua explananda. I contend that these assumptions convey a skewed picture of the research practices in question and of the role played by phenomena. I argue that experimental research often aims at exploring and describing “objects of research” and that phenomena can figure as components of, and as evidence for, such objects. I situate my (...) analysis within the existing literature and illustrate it with examples from memory research. (shrink)

The last two decades have seen a rising interest in (a) the notion of a scientific phenomenon as distinct from theories and data, and (b) the intricacies of experimentally producing and stabilizing phenomena. This paper develops an analysis of the stabilization of phenomena that integrates two aspects that have largely been treated separately in the literature: one concerns the skills required for empirical work; the other concerns the strategies by which claims about phenomena are validated. I argue that in order (...) to make sense of the process of stabilization, we need to distinguish between two types of phenomena: phenomena as patterns in the data ( surface regularities ) and phenomena as underlying (or hidden ) regularities. I show that the epistemic relationships that data bear to each of these types of phenomena are different: Data patterns are instantiated by individual data, whereas underlying regularities are indicated by individual data, insofar as they instantiate a data pattern. Drawing on an example from memory research, I argue that neither of these two kinds of phenomenon can be stabilized in isolation. I conclude that what is stabilized when phenomena are stabilized is the fit between surface regularities and hidden regularities. (shrink)

In his 1935 book Principles of Gestalt Psychology, Kurt Koffka stated that empirical research in perceptual psychology should begin with “a phenomenological analysis,” which in turn would put constraints on the “true theory.” In this paper, I take this statement as a point of departure to investigate in what sense Gestalt psychologists practiced a phenomenological analysis and how they saw it related to theory construction. I will contextualize the perceptual research in Gestalt psychology vis-a-vis Husserlian phenomenology on the one hand (...) and mainstream psychophysics on the other, and I will argue that Gestalt psychologists practiced a form of “frontloading” phenomenology: Instead of requiring experimental subjects to engage in experiential reflections, such reflections were—in a sense—already engrained in the experimental designs used by researchers. This type of phenomenology was decidedly anti-“introspectionist” and as such was compatible with some of Husserl’s basic commitments, while at the same time bearing a surprising resemblance with the methods employed by psychophysicists like E. Boring and S.S. Stevens. This latter point will prompt me to explore what the difference between Gestalt-psychology and psychophysics amounted to. My analysis will reveal some disagreements and misunderstandings, especially with regard to the notions of isomorphism and introspection. (shrink)

This paper argues that whereas philosophical discussions of first-person methods often turn on the veridicality of first-person reports, more attention should be paid to the experimental circumstances under which the reports are generated, and to the purposes of designing such experiments. After pointing to the ‘constructedness’ of first-person reports in the science of perception, I raise questions about the criteria by which to judge whether the reports illuminate something about the nature of perception. I illustrate this point with a historical (...) debate between Gestalt psychologist and atomists, both of whom used first-person methods to investigate perception. (shrink)

This is a collection of original papers that look at the ways in which the dichotomy between explanation and understanding was conceptualized by various late 19th- and early 20th-century writers both in Germany and in other (mostly) European countries.

In recent debates about the replication crisis, two positions have been dominant: one that focuses on methodological reforms and one that focuses on theory building. This paper takes up the suggestion that there might be a deeper difference in play, concerning the ways the very subject matter of psychology is construed by opposing camps, i.e., in terms of stable effects versus in terms of complexity. I argue that each gets something right, but neither is sufficient. My analysis suggests that the (...) context sensitivity of the psychological subject matter needs to be front and center of methodological and theoretical efforts. (shrink)

This paper provides an analysis of Franz Brentano’s thesis that psychology employs a distinctive method, which sets it apart from physiology. The aim of the paper is two-fold: First, I situate Brentano’s thesis (and the broader metaphysical system that underwrites it) within the context of specific debates about the nature and status of psychology, arguing that we regard him as engaging in a form of boundary work. Second, I explore the relevance of Brentano’s considerations to more recent debates about autonomy (...) on the one hand and theoretical and/or methodological integration on the other. I argue that Brentano puts his finger on the idea that an integrated research process presupposes the existence of distinct methods and approaches, and that he highlights the philosophical challenge of accounting for such distinct methods. I suggest that Brentano’s ideas offer unconventional perspectives on current debates, in particular regarding first-person methods and the investigative process in cognitive science. (shrink)

Carnaps Werk zwischen den späten 1920er- und frühen 1930er-Jahren nimmt verschiedentlich auf Begrifflichkeiten und Debatten der philosophischen und experimentellen Psychologie seiner Zeit Bezug. Diese Bezugnahmen sind jedoch nicht immer konsistent oder explizit. Beispielsweise bedient Carnap sich sowohl im Aufbau als auch in seinen Ausführungen zur Psychologie in einer physikalischen Sprache einiger Grundannahmen der experimentellen Psychologie, führt dies jedoch nicht konsequent zu Ende. Umgekehrt sieht er seine Auffassungen zur Physikalisierung der psychologischen Sprache nicht zuletzt auch als potenzielles Korrektiv für die existierende (...) Psychologie seiner Zeit, was bei dem Gestaltpsychologen Carl Duncker auf Unverständnis stößt. In dem vorliegenden Aufsatz belege ich meine These von Carnaps spannungsvolle Verhältnis zur Psychologie und versuche, dieses Verhältnis historisch und systematisch einzuordnen. (shrink)