This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, what (...) level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, (...) and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

To explain their role in discovery and contrast them with theory-driven research, philosophers of science have characterized exploratory experiments in terms of what they lack: namely, that they lack direction from what have been called “local theories” of the target system or object under investigation. I argue that this is incorrect: it’s not whether or not there is direction from a local theory that matters, but instead how such a theory is used to direct an experiment that matters. Appealing to (...) contemporary exploratory experiments that involve the use of experimental techniques—specifically, examples where scientists explore the interaction of neural activity and human behavior by magnetically stimulating brains—I argue that local theories of a target system can inform auxiliary hypotheses in exploratory experiments, which direct these experiments. These examples illustrate how local theories can direct the exploration of target systems where researchers do not aim to evaluate these theories. (shrink)

Experimental design is one aspect of a scientific method. A well-designed, properly conducted experiment aims to control variables in order to isolate and manipulate causal effects and thereby maximize internal validity, support causal inferences, and guarantee reliable results. Traditionally employed in the natural sciences, experimental design has become an important part of research in the social and behavioral sciences. Experimental methods are also endorsed as the most reliable guides to policy effectiveness. Through a discussion of some of the central concepts (...) associated with experimental design, including controlled variation and randomization, this chapter will provide a summary of key ethical issues that tend to arise in experimental contexts. In addition, by exploring assumptions about the nature of causation and by analyzing features of causal relationships, systems, and inferences in social contexts, this chapter will summarize the ways in which experimental design can undermine the integrity of not only social and behavioral research but policies implemented on the basis of such research. (shrink)

The use of neuroscientific evidence in criminal trials has been steadily increasing. Despite progress made in recent decades in understanding the mechanisms of psychological and behavioral functioning, neuroscience is still in an early stage of development and its potential for influencing legal decision-making is highly contentious. Scholars disagree about whether or how neuroscientific evidence might impact prescriptions of criminal culpability, particularly in instances in which evidence of an accused’s history of mental illness or brain abnormality is offered to support a (...) plea of not criminally responsible. In the context of these debates, philosophers and legal scholars have identified numerous problems with admitting neuroscientific evidence in legal contexts. To date, however, less has been said about the challenges of evaluating the evidence upon which integrative mechanistic explanations that bring together evidence from different areas of neuroscience are based. As we explain, current criteria for evaluating such evidence to determine its admissibility in legal contexts are inadequate. Appealing to literature in the philosophy of scientific experimentation and theoretical work in the social, cognitive and behavioral sciences, we lay the groundwork for reforming these criteria and identify some of the implications of modifying them. (shrink)

Data production in experimental sciences depends on localised experimental systems, but the epistemic properties of data transcend the contingencies of the processes that produce them. Philosophers often believe that experimental systems instantiate but do not produce the epistemic properties of data. In this paper, we argue that experimental systems' local functioning entails intrinsic capacities to produce the epistemic properties of data. We develop this idea by applying Derrida's model of arche-writing to study a case of theory-oriented experimental practice. Derrida's model (...) relativises or dissolves the conceptual distinction between the moment of data production and a subsequent moment of data dissemination. It thus has consequences for understanding both data production (despite being intrinsically local, data production a priori generates transferrable and modellable information) and data dissemination (when modelling information, researchers needs to refer this information to the context of its production). We study a case of data production in a non-exploratory experimental system designed to test a pre-existing hypothesis in visual neuroscience. A case of theory-oriented experimental practice should allow us to identify the autonomous functioning of experimental systems in data production more clearly, insofar as it allows us to study the limits of pre-existing theory in the activities of these systems. We suggest that pre-existing concepts, hypotheses and theories condition the relevance but not the production of experimental data. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.