This paper examines the role existence plays in measurement validity. I argue that existing popular theories of measurement and of validity follow a correspondence framework, which starts by assuming that an entity exists in the real world with certain properties that allow it to be measurable. Drawing on literature from the sociology of measurement, I show that the correspondence framework faces several theoretical and practical challenges. I suggested the validity-first framework of measurement, which starts with a practice-based validation process as (...) the basis for a measurement theory, and only posits objective existence when it is scientifically useful to do so. (shrink)

Microaggressions are, roughly, acts or states of affairs that express prejudice or neglect toward members of oppressed groups in relatively subtle ways. There is an apparent consensus among both proponents and critics of the microaggression concept that microaggressions are “subjective.” We examine what subjectivity amounts to in this context and argue against this consensus. We distinguish between microaggressions as an explanatory posit and microaggressions as a hermeneutical tool, arguing that in either case there is no reason at present to regard (...) microaggressions as subjective and that microaggressions in the hermeneutical sense should be regarded as objective. (shrink)

When it originated in the late 19th century, psychometrics was a field with both a scientific and a social mission: psychometrics provided new methods for research into individual differences, and at the same time, these psychometric instruments were considered a means to create a new social order. In contrast, contemporary psychometrics - due to its highly technical nature and its limited involvement in substantive psychological research - has created the impression of being a value-free discipline. In this article, we develop (...) a contrasting characterization of contemporary psychometrics as a value-laden discipline. We expose four such values: that individual differences are quantitative (rather than qualitative), that measurement should be objective in a specific sense, that test items should be fair, and that utility of a model is more important than its truth. Our goal is not to criticize psychometrics for employing these values, but rather to bring them into the open and to show that these values are not inevitable and are in need of systematic evaluation. (shrink)

What is a valid measuring instrument? Recent philosophy has attended to logic of justification of measures, such as construct validation, but not to the question of what it means for an instrument to be a valid measure of a construct. A prominent approach grounds validity in the existence of a causal link between the attribute and its detectable manifestations. Some of its proponents claim that, therefore, validity does not depend on pragmatics and research context. In this paper, I cast doubt (...) on the possibility of a context-independent causal account of validity (what I call unconditional validity). I assess several versions, arguing that all of them fail to judge the validity of measuring instruments correctly. Because different research purposes require different properties from measuring instruments, no account of validity succeeds without referring to the specific research purpose that creates the need for measurement in the first place. (shrink)

This paper provides a philosophical assessment of leading theory-based, evidence-based and coherentist approaches to the definition and the measurement of well-being. It then builds on this assessment to articulate a reformed division of labor for the science of well-being and argues that this reformed division of labor can improve on the proffered approaches by combining the most plausible tenets of theory-based approaches with the most plausible tenets of coherentist approaches. This result does not per se exclude the possibility that theory-based (...) and coherentist approaches may be independently improved or amended in the years to come. Still, together with the challenges that affect these approaches, it strengthens the case for combining the most plausible tenets of those approaches. (shrink)

Milgram’s experiments have had a considerable influence on the historical study of genocidal behavior, which originated with Christopher Browning’s groundbreaking book Ordinary Men. The purpose of my article is to examine and critically assess the following theory which is often taken somewhat for granted: “Relevance thesis: findings in social psychology, most notably Milgram’s findings about obedience behavior, are causally relevant to explaining perpetrators’ behaviors.” The relevance theory presupposes that certain paradigmatic studies in social psychology have both internal and external validity. (...) In the context of the replication crisis which has affected many recent findings in social psychology, it seems crucial to discuss this presupposition. I shall argue that the evidence is mixed. (shrink)

In experimental cognitive psychology, objects of inquiry are typically operationalized with psychological tasks. When interpreting results from such tasks, we focus primarily on behavioral measures such as reaction times and accuracy rather than experiences – i.e., phenomenology – associated with the task, and posit that the tasks elicit the desired cognitive phenomenon. Evaluating whether the tasks indeed elicit the desired phenomenon can be facilitated by understanding the experience during task performance. In this paper we explore the breadth of experiences that (...) are elicited by and accompany task performance using in-depth phenomenological and qualitative methodology to gather subjective reports during the performance of a visuo-spatial change detection task. Thirty-one participants (18 females) were asked to remember either colors, orientations or positions of the presented stimuli and recall them after a short delay. Qualitative reports revealed rich experiential landscapes associated with the task-performance, suggesting a distinction between two broad classes of experience: phenomena at the front of consciousness and background feelings. The former includes cognitive strategies and aspects of metacognition, whereas the latter include more difficult-to-detect aspects of experience that comprise the overall sense of experience (e.g., bodily feelings, emotional atmosphere, mood). We focus primarily on the background feelings, since strategies of task-performance to a large extent map onto previously identified cognitive processes and discuss the methodological implications of our findings. (shrink)

Although researchers agree on the importance of validity, they have not yet reached a consensus on what validity consists of. This article traces the historic trajectories of validity theory development in three research traditions: psychometrics, experiment in social settings, and animal models of psychiatric disorders, showing that the multiplicity in the concept of validity is shaped by its multiple historic trajectories and reflects the diversity of practices and concerns in different research traditions. I argue that specifying validity of what target (...) practice and for what purpose in discussions helps to connect validity to its rich context that gives rise to its specific meaning and relevance. (shrink)