This paper examines the role existence plays in measurement validity. I argue that existing popular theories of measurement and of validity follow a correspondence framework, which starts by assuming that an entity exists in the real world with certain properties that allow it to be measurable. Drawing on literature from the sociology of measurement, I show that the correspondence framework faces several theoretical and practical challenges. I suggested the validity-first framework of measurement, which starts with a practice-based validation process as (...) the basis for a measurement theory, and only posits objective existence when it is scientifically useful to do so. (shrink)

Suppose you want to do as much good as possible. What should you do? According to members of the effective altruism movement—which has produced much of the thinking on this issue and counts several moral philosophers as its key protagonists—we should prioritise among the world’s problems by assessing their scale, solvability, and neglectedness. Once we’ve done this, the three top priorities, not necessarily in this order, are (1) aiding the world’s poorest people by providing life-saving medical treatments or alleviating poverty (...) itself, (2) preventing global catastrophic risks, such as those posed by nuclear war or rogue artificial intelligence, and (3) ending factory farming. These claims are both plausible and striking. If correct, they should prompt a stark revision of how we approach our altruistic activities. However, the project of determining how to do the most good—as opposed to say, whether we should do the most good—has only recently, within the last ten years, become the subject of serious academic attention. Many key claims have not yet been carefully scrutinised. This is a cause for concern: are effective altruists doing good badly? In this thesis, I critique and develop some of the latest claims about how individuals can do the most good. I do this in three areas: the value of saving lives (preventing premature deaths), how best to improve lives (making people happier during their lives), and cause prioritisation methodology (frameworks for determining which problems are the highest priorities). In each case, I raise novel theoretical considerations that, when incorporated, change the analysis. Roughly speaking, my main conclusions are (1) saving lives is not as straightforwardly good we tend to suppose, may not be good at all, and is not clearly a priority; (2) happiness can be measured through self-reports and, based on the self-reported evidence, treating mental health stands out as an overlooked problem that may be an even more cost-effective way to improve lives than alleviating poverty; (3) the cause prioritisation methodology proposed by effective altruists needs to be moderately reconceptualised and, when it is, it turns out it is not as illuminating a tool as we might have thought and hoped. (shrink)

This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, what (...) level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

Psychometrics and the representational theory of measurement are widely used in social scientific measurement. They are currently pursued largely in isolation from one another. I argue that despite their separation in practice, RTM and psychometrics are complementary approaches, because they can contribute in complementary ways to the establishment of what I argue is a crucial measurement property, namely, representational interpretability. Because RTM and psychometrics are complementary in the establishment of representational interpretability, the current separation of measurement approaches is unfounded. 1Introduction2Two (...) Approaches to Measurement 2.1Representational theory of measurement2.2Psychometrics2.3Representational interpretability3Complementarity, Conceptually 3.1Representational theory of measurement: Conditions of representational interpretability3.2Psychometrics: Evidence of representational interpretability4Complementarity in Action 4.1What is the Rasch model?4.2Rasch and conjoint measurement5Conclusion: Critics and Fruits of Complementarity. (shrink)

One widespread argument against the efficacy of subjective well-being as a measure of well-being is the adaptation problem as formulated by Sen and Nussbaum: the phenomenon that people may adapt to deprivation and find satisfaction or happiness in objectively bad circumstances. It is not generally noticed that there are two distinct arguments for why the phenomenon of adaptation is a problem for subjective well-being as a measure of well-being. The Axiological Adaptation Argument is a counter-example to theories of well-being that (...) rely on mental states. The Epistemic Adaptation Argument illustrates that levels of happiness or satisfaction cannot be measured well when people have adapted. I argue that the most serious threat to subjective well-being measures is not the Axiological Argument, but the Epistemic Argument. I reflect on the implications the epistemic problem has for the empirical literature in general, and for research on the phenomenon of adaptation in particular. (shrink)

Typically, philosophers analysing well-being’s nature maintain three claims. First, that well-being has essential properties. Second, that the concept of well-being circumscribes those properties. Third, that well-being theories should capture them exhaustively and exclusively. This predominant position is called well-being monism. In opposition, contextualists argue that no overarching concept of well-being referring to a universally applicable well-being standard exists. Such a standard would describe what is good, bad, and neutral, for us without qualification. Instead, well-being research is putatively about several central (...) phenomena. If several phenomena are central, a proliferation of concurrently acceptable well-being theories and operationalisations is expected. However, contextualists are challenged to explain how those analysing well-being are not systematically talking past each other. In this paper, I address that challenge. The upshot is that contextualist well-being theories can be justifiably context-sensitive and applied to tailor-made policy-making efforts. I illustrate the benefits by connecting contextualism to the capability approach. (shrink)

When it originated in the late 19th century, psychometrics was a field with both a scientific and a social mission: psychometrics provided new methods for research into individual differences, and at the same time, these psychometric instruments were considered a means to create a new social order. In contrast, contemporary psychometrics - due to its highly technical nature and its limited involvement in substantive psychological research - has created the impression of being a value-free discipline. In this article, we develop (...) a contrasting characterization of contemporary psychometrics as a value-laden discipline. We expose four such values: that individual differences are quantitative (rather than qualitative), that measurement should be objective in a specific sense, that test items should be fair, and that utility of a model is more important than its truth. Our goal is not to criticize psychometrics for employing these values, but rather to bring them into the open and to show that these values are not inevitable and are in need of systematic evaluation. (shrink)

We explore the question of whether machines can infer information about our psychological traits or mental states by observing samples of our behaviour gathered from our online activities. Ongoing technical advances across a range of research communities indicate that machines are now able to access this information, but the extent to which this is possible and the consequent implications have not been well explored. We begin by highlighting the urgency of asking this question, and then explore its conceptual underpinnings, in (...) order to help emphasise the relevant issues. To answer the question, we review a large number of empirical studies, in which samples of behaviour are used to automatically infer a range of psychological constructs, including affect and emotions, aptitudes and skills, attitudes and orientations (e.g. values and sexual orientation), personality, and disorders and conditions (e.g. depression and addiction). We also present a general perspective that can bring these disparate studies together and allow us to think clearly about their philosophical and ethical implications, such as issues related to consent, privacy, and the use of persuasive technologies for controlling human behaviour. (shrink)

There are roughly two philosophical literatures on “happiness,” each corresponding to a different sense of the term. One uses ‘happiness’ as a value term, roughly synonymous with well-being or flourishing. The other body of work uses the word as a purely descriptive psychological term, akin to ‘depression’ or ‘tranquility’. An important project in the philosophy of happiness is simply getting clear on what various writers are talking about: what are the important meanings of the term and how do they connect? (...) While the “well-being” sense of happiness receives significant attention in the contemporary literature on well-being, the psychological notion is undergoing a revival as a major focus of philosophical inquiry, following on recent developments in the science of happiness. This entry focuses on the psychological sense of happiness (for the well-being notion, see the entry on well-being). The main accounts of happiness in this sense are hedonism, the life satisfaction theory, and the emotional state theory. Leaving verbal questions behind, we find that happiness in the psychological sense has always been an important concern of philosophers. Yet the significance of happiness for a good life has been hotly disputed in recent decades. Further questions of contemporary interest concern the relation between the philosophy and science of happiness, as well as the role of happiness in social and political decision-making. (shrink)

Precise measurements of well-being would be of profound societal importance. Yet, the sceptical worry that we cannot use social science instruments and tests to measure well-being is widely discussed by philosophers and scientists. A recent and interesting philosophical argument has pointed to the psychometric procedures of construct validation to address this sceptical worry. The argument has proposed that these procedures could warrant confidence in our ability to measure well-being. The present paper evaluates whether this type of argument succeeds. The answer (...) is that it depends on which methodological background assumptions are motivating the sceptical worry to begin with. We show this by doing two things. First, we clarify (a) the different types of well-being theories involved in the science of well-being, and (b) the general methodological dimensions of well-being theorising. Second, we apply these distinctions and argue that construct validation is an unsuccessful response to measurement scepticism if this scepticism is motivated by a form of methodological non-naturalism. In the light of this, the overall point of the paper is that philosophers and scientists, when discussing measurement of well-being, should explicate their deeper methodological commitments. We further suggest that making such explicit commitments might present philosophers with a dilemma. (shrink)

While aging research and policy aim to promote ‘health’ at all ages, there remains no convincing explanation of what this ‘health’ is. In this paper, I investigate whether we can find, implicit within the sciences of aging, a way to know what health is and how to measure it, i.e. a theory of health. To answer this, I start from scientific descriptions of aging and its modulators and then try to develop some generalizations about ‘health’ implicit within this research. After (...) discussing some of the core aspects of aging and the ways in which certain models describe spatial and temporal features specific to both aging and healthy phenotypes, I then extract, explicate, and evaluate one potential construct of health in these models. This suggests a theory of health based on the landscape of optimized phenotypic trajectories. I conclude by considering why it matters for more candidate theories to be proposed and evaluated by philosophers and scientists alike. (shrink)

What is a valid measuring instrument? Recent philosophy has attended to logic of justification of measures, such as construct validation, but not to the question of what it means for an instrument to be a valid measure of a construct. A prominent approach grounds validity in the existence of a causal link between the attribute and its detectable manifestations. Some of its proponents claim that, therefore, validity does not depend on pragmatics and research context. In this paper, I cast doubt (...) on the possibility of a context-independent causal account of validity (what I call unconditional validity). I assess several versions, arguing that all of them fail to judge the validity of measuring instruments correctly. Because different research purposes require different properties from measuring instruments, no account of validity succeeds without referring to the specific research purpose that creates the need for measurement in the first place. (shrink)

In recent years, several authors have called to ground descriptive and normative decision theory on neuro-psychological measures of utility. In this paper, I combine insights from the best available neuro-psychological findings, leading philosophical conceptions of welfare and contemporary decision theory to rebut these prominent calls. I argue for two claims of general interest to philosophers, choice modellers and policy makers. First, severe conceptual, epistemic and evidential problems plague ongoing attempts to develop accurate and reliable neuro-psychological measures of utility. And second, (...) even if these problems are solved, neuro-psychological measures of utility lack the potential to inform welfare analyses and policy evaluations. (shrink)

Welfare in economics is generally conceived of in terms of the satisfaction of preferences, but a general, comparable index measure of welfare is generally not taken to be possible. In recent years, in response to the usage of measures of subjective well-being as indices of welfare in economics, a number of economists have started to develop measures of welfare based on preference-satisfaction. In order to evaluate the success of such measures, I formulate criteria of policy-relevance and theoretical success in the (...) context of preference-satisfaction measures of welfare. I present a detailed case study of the methodological choices put forward in a prominent generalized proposal for measuring welfare through preferences recently published in the American Economic Review. I contrast this with an alternative welfare measure which also uses preferences to weight aspects of welfare: the ICECAP-A measure. I assess the methodology of both approaches in detail and argue that the two goals of a preference... (shrink)

Supervised machine learning has found its way into ever more areas of scientific inquiry, where the outcomes of supervised machine learning applications are almost universally classified as predictions. I argue that what researchers often present as a mere terminological particularity of the field involves the consequential transformation of tasks as diverse as classification, measurement, or image segmentation into prediction problems. Focusing on the case of machine-learning enabled poverty prediction, I explore how reframing a measurement problem as a prediction task alters (...) the primary epistemic aim of the application. Instead of measuring a property, machine learning developers conceive of their models as predicting a given measurement of this property. I argue that this _predictive reframing_ common to supervised machine learning applications is epistemically and ethically problematic, as it allows developers to externalize concerns critical to the epistemic validity and ethical implications of their model’s inferences. I further hold that the predictive reframing is not a necessary feature of supervised machine learning by offering an alternative conception of machine learning models as measurement models. An interpretation of supervised machine learning applications to measurement tasks as _automatically-calibrated model-based measurements_ internalizes questions of construct validity and ethical desirability critical to the measurement problem these applications are intended to and presented as solving. Thereby, this paper introduces an initial framework for exploring technical, historical, and philosophical research at the intersection of measurement and machine learning. (shrink)

The practical goal of preventing premature death seems uncontroversial. But the term ‘premature death’ is vague with several, sometimes conflicting definitions. This ambiguity results in several conceptions with which not all will agree. Moreover, the normative rationale behind the goal of preventing premature deaths is masked by the operational definition of existing measures. In this article, we argue that ‘premature death’ should be recognized as a normative concept. We propose that normative theories should be used to justify measures of premature (...) death to provide them with normative validity and public legitimacy. (shrink)

This paper provides a philosophical assessment of leading theory-based, evidence-based and coherentist approaches to the definition and the measurement of well-being. It then builds on this assessment to articulate a reformed division of labor for the science of well-being and argues that this reformed division of labor can improve on the proffered approaches by combining the most plausible tenets of theory-based approaches with the most plausible tenets of coherentist approaches. This result does not per se exclude the possibility that theory-based (...) and coherentist approaches may be independently improved or amended in the years to come. Still, together with the challenges that affect these approaches, it strengthens the case for combining the most plausible tenets of those approaches. (shrink)

This paper applies conceptual engineering to deal with four objections that have been levelled against operationalism in psychology. These objections are: operationalism leads to harmful proliferation of concepts, operationalism goes hand-in-hand with untenable antirealism, operationalism leads to arbitrariness in scientific concept formation, and operationalism is incompatible with the usual conception of scientific measurement. Relying on a formulation of three principles of conceptual engineering, I will argue that there is a useful form of operationalism that does not fall prey to these (...) four objections. (shrink)

Measures of happiness are increasingly being used throughout the social sciences. While these measures have attracted numerous types of criticisms, a crucial aspect of these measures has been left largely unexplored—their calibration. Using Eran Tal’s recently developed notion of calibration we argue first that the prospect of continued calibration of happiness measures is crucial for the science of happiness, and second, that continued calibration of happiness measures faces a particular problem—The Two Unknowns Problem. The Two Unknowns Problem relies on the (...) claim that individuals are necessarily a part of the measurement apparatus in first person measures of happiness, and the claim that we have no reason to believe that the evaluation standards people employ are invariant across individuals and time. We argue that calibrating happiness measures therefore involves solving an equation with two unknowns—an individual’s degree of happiness, and their evaluation standards—which is, generally, not possible. Third, we consider two possible escape routes from this problem and we suggest that the most promising route requires yet unexplored empirical and theoretical work on linking happiness to behavioral or neural evidence. (shrink)

Social practices of quantification, or the production and communication of numbers, have been recognized as important foundations of organizational knowledge, as well as sources of power. With the advent of increasingly sophisticated digital tools to capture and extract numerical data from social life, however, there is a pressing need to understand the ethical stakes of quantification. The current study examines quantification from an ethical lens, to frame and promote a research agenda around the ethics of quantification. After a brief overview (...) of quantification research and its uses in state and market organization, I discuss quantification in terms of three core subprocesses—capture, specification, and appropriation, illustrating and identifying ethical concerns around each process. Linking these processes to the performative effects of measures, I present a working model of quantification from which the discussion builds ideas for developing a research agenda around quantification. (shrink)

Psychometrics is one of the main approaches to social scientific measurement. It is relied upon in drug testing, economic policymaking, recruitment, and other decision-making contexts. The first aim of this article is to introduce philosophers to key aspects of psychometrics, namely, classical test theory, item response theory, and construct validity. The second aim is to show how a debate on the nature of psychological attributes manifests in psychometrics. In this debate, realists claim that psychometric measures are indicators of independently existing (...) qualities, while operationalists argue that a measure defines its target attribute. The third and final aim is to argue that despite its poor reputation among philosophers, operationalism is a viable approach to psychometrics. (shrink)

ABSTRACTQuestions about how empathy should be conceptualized have long been a preoccupation of the field of empathy research. There are numerous definitions of empathy that have been proposed and that often overlap with other concepts such as sympathy and compassion. This makes communication between research groups or across disciplines difficult. Many researchers seem to see the diversity of definitions as a problem rather than a form of benign pluralism. Within this debate about conceptualization, researchers sometimes suggest that more neuroscientific evidence (...) will make the problem go away – that uncovering the processes underlying empathy will thereby also sort out conceptual difficulties. In this paper, I challenge this assumption by examining how neuroscientists studying empathy use concepts in practice – both in the development of their measures and in the interpretation of their data. I argue that this neuroscientific literature demonstrates that continuity and stability comes from the use of cert... (shrink)

Erik Angner has argued that simultaneous endorsement of the representational theory of measurement and psychometrics leads to inconsistency. His claim rests on an implicit assumption: RTM and psychometrics are full-fledged approaches to measurement. I argue that RTM and psychometrics are only partial approaches that deal with different aspects of measurement, and that therefore simultaneous endorsement of the two is not inconsistent. The argument has implications for the improvement of measurement practices.

It is commonplace that care should be patient-centered. Nevertheless, no universally agreed-upon definition of patient-centered care exists. By consequence, the relation between patient-centered care as such and ethical principles cannot be investigated. However, some research has been performed on the relation between specific models of patient-centered care and ethical principles such as respect for autonomy and beneficence. In this article, I offer a detailed case study on the relationship between specific measures of patient-centered care and the ethical principle of respect (...) for autonomy. Decision Quality Instruments (DQIs) are patient-centered care measures that were developed by Karen Sepucha and colleagues. The model of patient-centered care that guided the development of these DQIs pays special attention to the ethical principle of respect for autonomy. Using Jonathan Pugh’s theory of rational autonomy, I will investigate how the DQIs relate to patient autonomy. After outlining Pugh’s theory of rational autonomy and framing the DQIs accordingly (Part I), I will investigate whether the methodological choices made while developing these DQIs align with respect for autonomy (Part II). My analysis will indicate several tensions between DQIs and patient autonomy that could result in what I call “structural paternalism.” These tensions offer us sufficient reasons, especially given the importance of the ethical principle of respect for autonomy, to initiate a more encompassing debate on the normative validity of Decision Quality Instruments. The aim of the present paper is to highlight the need for, and to offer a roadmap to, this debate. (shrink)

After decades of debates about species concepts, there is broad agreement that species are evolving lineages. However, species classification is still in a state of disorder: different methods of delimitation lead to competing outcomes for the same organisms, and the groups recognised as species are of widely different kinds. This paper considers whether this problem can be resolved by developing a unitary scale for evolutionary independence. Such a scale would show clearly when groups are comparable and allow taxonomists to choose (...) a conventional threshold of independence for species status. Existing measurement approaches to species delimitation are typically shot down by what I call the heterogeneity objection, according to which independently evolving groups are too heterogeneous to be captured by a single scale. I draw a parallel with the measurement of temperature to argue that this objection does not provide sufficient reasons to abandon the measurement approach, and that such an approach may even help to make the vague notion of evolutionary independence more precise. (shrink)

Many people think of empathy as a powerful force for good within society and as a crucial component of moral cognition. Recently, prominent theorists in psychology and philosophy have challenged this viewpoint and mounted a case against empathy. The most compelling versions of this case rely heavily on empirical evidence from psychology and neuroscience. They contend that the inherent partiality and parochialism of empathy undermines its potential to serve moral ends. This paper argues that the argument against empathy overreaches; it (...) makes an unwarranted inference from descriptive evidence about our empathic capacities to normative claims about the proper role of empathy in culture, society, and ethics. The paper concludes with suggestions about how to use insights from the empirical literature to build a more nuanced and contextually sensitive account of the role of empathy in our ethical lives. (shrink)

Although researchers agree on the importance of validity, they have not yet reached a consensus on what validity consists of. This article traces the historic trajectories of validity theory development in three research traditions: psychometrics, experiment in social settings, and animal models of psychiatric disorders, showing that the multiplicity in the concept of validity is shaped by its multiple historic trajectories and reflects the diversity of practices and concerns in different research traditions. I argue that specifying validity of what target (...) practice and for what purpose in discussions helps to connect validity to its rich context that gives rise to its specific meaning and relevance. (shrink)