If a human subject knows they are being measured, this knowledge may affect their attitudes and behaviour to such an extent that it affects the measurement results as well. This broad range of effects is shared under the term ‘reactivity’. Although reactivity is often seen by methodologists as a problem to overcome, in this paper I argue that some quite extreme reactive changes may be legitimate, as long as we are measuring phenomena that are not simple biological regularities. Legitimate reactivity (...) is reactivity which does not undermine the accuracy of a measure; I show that if such reactivity were corrected for, this would unjustifiably ignore the authority of the research subject. Applying this argument to the measurement of depression, I show that under the most commonly accepted models of depression there is room for legitimate reactivity. In the first part of the paper, I provide an inventory of the different types of reactivity that exist in the literature, as well as the different types of phenomena that one could measure. In the second part, I apply my argument to the measurement of depression with the PHQ-9 survey. I argue that depending on what kind of phenomenon we consider depression to be, we will accept different kinds of reactivity. I show that both under the harmful dysfunction model and the practical kinds model, certain reactive changes in measuring depression are best seen as legitimate recharacterizations of the underlying phenomenon, and define what legitimate means in this context. I conclude that in both models, biological aspects constrain characterization, but the models are not so strict that only one concept is acceptable, leaving room for reactivity. (shrink)

The reactions that science triggers on the people it studies, describes, or theorises about, can affect the science itself and its claims to knowledge. This phenomenon, which we call reactivity, has been discussed in many different areas of the social sciences and the philosophy of science, falling under different rubrics such as the Hawthorne effect, self-fulfilling prophecies, the looping effects of human kinds, the performativity of models, observer effects, experimenter effects and experimenter demand effects. In this paper we review state-of-the-art (...) research that falls under the remit of the philosophy of reactivity by considering ontological, epistemic and moral issues that reactivity raises. Along the way, we devote special attention to articles belonging to this journal's Topical Collection entitled “Reactivity in the Human Sciences”. (shrink)

Scientific models can be performative: they can causally affect the phenomena they are intended to represent. The existing literature offers two responses. The appraisal view emphasizes that performativity can sometimes be a good-making model attribute, e.g., when predictions steer the public’s behavior in desirable ways. The mitigation view seeks to endogenize agents’ behavioral response to model-issued forecasts to get rid of performativity instead. This paper argues that neither approach is fully compelling: the appraisal view encounters severe concerns about moral values (...) illegitimately encroaching on how modelers construct and use models, while the mitigation view fails to acknowledge that endogenization is itself a choice that involves substantive value-judgments relating to the desirability of certain social outcomes. (shrink)

Reactivity in qualitative data collection occurs when a researcher generates data about a situation with reactivity, that is, a situation in which the ongoing research affects the research participants such that they, say, diverge from their routines when the researcher is present, or tell the researcher what they think she wants to hear. In qualitative research, there are two basic approaches to reactivity. The traditional position maintains that data should ideally be collected in situations without any reactivity. In other words, (...) good data are reactivity free. By contrast, the more recent view holds that data from situations with reactivity are fine as long as the researcher is aware of the occurring reactivity so that she can take it into account when interpreting her data. In this fashion, good data are reactivity transparent. In this paper, I first spell out and defend the more recent approach to reactivity. I argue that qualitative data are reactivity transparent when conjoined with true reactivity assumptions and that, thus supplemented, data are informative about social life independently of its being studied. Next, I examine various issues raised by the requirement to put forth true reactivity assumptions. Lastly, I use my discussion of reactivity transparency as a basis for providing a framework for thinking about good qualitative data. (shrink)

Philosophers of science typically focus on the epistemic performance of scientific models when evaluating them. Analysing the effects that models may have on the world has typically been the purview of sociologists of science. We argue that the reactive (or “performative”) effects of models should also figure in model evaluations by philosophers of science. We provide a detailed analysis of how models in financial economics created the impetus for the growing importance of the phenomenon of “passive investing” in financial markets. (...) Considering this case motivates the position that we call contextualism about model evaluation, or _model contextualism_ for short. Model contextualism encompasses standard analyses of the epistemic performance of the model, but also includes their reactive aspects. It entails identifying the _epistemic and contextual import of the model_, the ways in which a model can engender change in the world (which we call the _channels of transmission_), and the _interactions between the epistemic and reactive import of a model_. (shrink)

As a result of being measured, individuals sometimes alter their behavior and attitudes to such extent that subsequent measurement results are affected. This ‘reactivity’ to measurement problematizes prediction and explanation, but some reactivity is nevertheless legitimate. Using the example of the measurement of race in the US Census, this article demonstrates that some forms of reactivity do not affect the accuracy of research. The article argues that legitimacy of reactivity depends on the metaphysical status of the phenomenon being measured. It (...) is argued that reactivity’s legitimacy is affected by the arbitrariness of a measure and the voluntariness of measurement results. (shrink)