To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

Derived measurements involve problems of coordination. Conducting them often requires detailed theoretical assumptions about their target, while such assumptions can lack sources of evidence that are independent from these very measurements. In this paper, I defend two claims about problems of coordination. I motivate both by a novel case study on a central measurement problem in the history of physical geodesy: the determination of the earth's ellipticity. First, I argue that the severity of problems of coordination varies according to scientists' (...) predictive and experimental control over perturbations of the measurement process. Second, I identify a methodology by which scientists can solve hard problems of coordination and gradually increase their predictive control over perturbations. I dub this methodology ‘operational pluralism’ since it is driven by the introduction of alternative measurement operations that involve different physical indicators. (shrink)

Psychometrics is one of the main approaches to social scientific measurement. It is relied upon in drug testing, economic policymaking, recruitment, and other decision-making contexts. The first aim of this article is to introduce philosophers to key aspects of psychometrics, namely, classical test theory, item response theory, and construct validity. The second aim is to show how a debate on the nature of psychological attributes manifests in psychometrics. In this debate, realists claim that psychometric measures are indicators of independently existing (...) qualities, while operationalists argue that a measure defines its target attribute. The third and final aim is to argue that despite its poor reputation among philosophers, operationalism is a viable approach to psychometrics. (shrink)

Multiple determination is the epistemic strategy of establishing the same result by means of multiple, independent procedures. It is an important strategy praised by both philosophers of science and practicing scientists. Despite the heavy appeal to multiple determination, little analysis has been provided regarding the specific grounds upon which its epistemic virtues rest. This article distinguishes between the various dimensions of multiple determination and shows how they can be used to evaluate the epistemic force of the strategy in particular cases. (...) Distinguishing between the various dimensions helps to resolve the disagreements regarding the relevance and epistemic import of multiple determination for scientific research. It also suggests a fruitful mode of interaction between the philosophy of science and (historical) accounts of scientific practice. (shrink)

There is growing agreement among taxonomists that species are independently evolving lineages. The central notion of this conception, evolutionary independence, is commonly operationalized by taxonomists in multiple, diverging ways. This leads to a problem of operationalization-dependency in species classification, as species delimitation is not only dependent on the properties of the investigated groups, but also on how taxonomists choose to operationalize evolutionary independence. The question then is how the operationalization-dependency of species delimitation is compatible with its objectivity and reliability. In (...) response to this problem, various taxonomists have proposed to integrate multiple operationalizations of evolutionary independence for delimiting species. This paper first distinguishes between a standard and a sophisticated integrative approach to taxonomy, and argues that it is unclear how either of these can support the reliability and objectivity of species delimitation. It then draws a parallel between the measurement of physical quantities and species delimitation to argue that species delimitation can be considered objective and reliable if we understand the sophisticated integrative approach as assessing the coherence between the idealized models of multiple operationalizations of evolutionary independence. (shrink)

The article advances a new way of thinking about classifications in general and the classification of mental disorders in particular. By applying insights from measurement practice to the context of classification, I defend a notion of epistemic accuracy that allows one to evaluate and improve classifications by comparing different classifying methods to each other. Progress in classification arises from the mutual development of classification systems and classifying methods. Based on this notion of accuracy, the article illustrates with an example how (...) psychiatric classifications can be improved via circumscribed comparisons of different perspectives on mental disorders, without relying on complete models of their complex aetiology. When applying this strategy, the traditional opposition between symptom-based and causal approaches is of little consequence for making progress in the epistemic accuracy of psychiatric classification. (shrink)

Craniology – the practice of inferring intelligence differences from the measurement of human skulls – survived the dismissal of phrenology and remained a widely popular research program until the end of the nineteenth century. From the 1970s, historians and sociologists of science extensively focused on the explicit and implicit socio-cultural biases invalidating the evidence and claims that craniology produced. Building on this literature, I reassess the history of craniological practice from a different but complementary perspective that relies on recent developments (...) in the epistemology of measurement. More precisely, I identify two aspects of the measurement culture of nineteenth-century craniologists that are crucial to understand the lack of validity of craniological inference: their neglect of the problem of coordination for their presupposed quantification of intelligence and their narrow view of calibration. Based on my analysis, I claim that these methodological shortcomings amplified the impact of the socio-cultural biases of craniologists, which had a pervasive role in their evidential use of measurement. Finally, my argument shows how the epistemology of measurement perspective can offer useful tools in debates concerning the use of biological evidence to foster social discourse and for analyzing the relationship between theory, evidence, and measurement. (shrink)

In this essay, I argue that at least in two phases of pharmaceutical research, especially while assessing the adequacy of the accumulated data and its interpretation, the influence of non-epistemic values is necessary. I examine a specific case from the domain of pharmaceutical research and demonstrate that there are multiple competing sets of values which may legitimately or illegitimately influence different phases of the inquiry. In such cases, the choice of the appropriate set of values—epistemic as well as non-epistemic—should be (...) made on the basis of the set’s viability to promote specific epistemic and social aims of the research, in the case at hand, rather than other competing aims. I put forth an account which addresses two philosophically significant and interrelated questions in the context of values in science debates: which aim should be prioritized when there are different stakeholders who try to achieve competing but, sometimes, conflicting goals; and what should be the criteria according to which the prioritization of a particular goal over other competing goals can be determined? I argue that both these questions can be addressed by invoking the principle of non-arbitrariness and the mere means principle and self-determination right. The philosophical import of raising and addressing these questions from an ethical perspective is that this approach leads to a better understanding of problems in today’s pharmaceutical research and guides us in efforts to alleviate these problems. (shrink)

To study consciousness, scientists need to determine when participants are conscious and when they are not. They do so with consciousness detection procedures. A recurring skeptical argument against those procedures is that they cannot be calibrated: there is no way to make sure that detection outcomes are accurate. In this article, I address two main skeptical arguments purporting to show that consciousness scientists cannot calibrate detection procedures. I conclude that there is nothing wrong with calibration in consciousness science.

One important strategy for dealing with error in our methods is triangulation, or the use multiple methods to investigate the same object. Current accounts of triangulation assume that its primary function is to provide a confirmatory boost to hypotheses beyond what confirmation of each method alone could produce. Yet, researchers often use multiple methods to examine new constructs about which they are uncertain. For example, social psychologists use multiple indirect measures to provide convergent evidence about implicit attitudes, but how to (...) characterize implicit attitudes is an open question. To make sense of triangulation under uncertainty about constructs, I suggest two changes: first, triangulation can serve multiple epistemic functions, including some that are non-confirmatory, and second, researchers should assess the epistemic risk in claims about evidence and the acceptance/rejection of hypotheses. (shrink)

The 2011 Nobel Prize in Physics was awarded to researchers from the Supernova Cosmology Project and the High-z Supernova Search Team for the discovery of the accelerating expansion of the universe. In this paper, I provide a historical analysis of the supernova cosmology evidence put forward by these teams for the accelerating universe, in terms of an iterative model of scientific progress developed by Hasok Chang in the context of his study of the development of measurement standards. I argue, using (...) the key concept of epistemic iteration, that the iterative model adequately accounts for evidence production in experimental science as well. In order to apply Chang’s model to the experimental evidence for the accelerating universe, I introduce the concept of endorsement as a particular mode of progress, and argue that supernova scientists produced an endorsed measurement system to claim evidence for their discovery. Furthermore, I show that the credibility of the evidence was not based on a particular measurement, rather, what proved to be decisive was the “robust consistency” of many individual results. (shrink)