Innovative modes of collaboration between archaeologists and Indigenous communities are taking shape in a great many contexts, in the process transforming conventional research practice. While critics object that these partnerships cannot but compromise the objectivity of archaeological science, many of the archaeologists involved argue that their research is substantially enriched by them. I counter objections raised by internal critics and crystalized in philosophical terms by Boghossian, disentangling several different kinds of pluralism evident in these projects and offering an analysis of (...) why they are epistemically productive when they succeed. My central thesis is that they illustrate the virtues of epistemic inclusion central to proceduralist accounts of objectivity, but I draw on the resources of feminist standpoint theory to motivate the extension of these social -cognitive norms beyond the confines of the scientific community. (shrink)

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications (...) of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)

In this paper, I explore the relationship of virtue, argumentation, and philosophical conduct by considering the role of the specific virtue of intellectual humility in the practice of philosophical argumentation. I have three aims: first, to sketch an account of this virtue; second, to argue that it can be cultivated by engaging in argumentation with others; and third, to problematize this claim by drawing upon recent data from social psychology. My claim is that philosophical argumentation can be conducive to the (...) cultivation of virtues, including humility, but only if it is conceived and practiced in appropriately ‘edifying’ ways. (shrink)

Recently, mainstream philosophy journals have tended to implement more and more stringent forms of peer review, probably in an attempt to prevent editorial decisions that are based on factors other than quality. Against this trend, we propose that journals should relax their standards of acceptance, as well as be less restrictive about whom is to decide what is admitted into the debate. We start by arguing, partly on the basis of the history of peer review in the journal Mind, that (...) past and current peer review practices attest to partisanship with respect to philosophical approach. Then, we explain that such partisanship conflicts with the standard aims of peer review, and that it is both epistemically and morally problematic. This assessment suggests that, if feasible, journals should treat all available and proposed standards of acceptance in philosophy as epistemically equal, and that philosophical work should be evaluated in terms of the novelty and significance of its contribution to developing thought in ways that are of value. Finally, we show, in a programmatic way, that improving the current situation is feasible, and can be done fairly easily. (shrink)

This highly multidisciplinary collection discusses an increasingly important topic among scholars in science and technology studies: objectivity in science. It features eleven essays on scientific objectivity from a variety of perspectives, including philosophy of science, history of science, and feminist philosophy. Topics addressed in the book include the nature and value of scientific objectivity, the history of objectivity, and objectivity in scientific journals and communities. Taken individually, the essays supply new methodological tools for theorizing what is valuable in the pursuit (...) of objective knowledge and for investigating its history. The essays offer many starting points, while suggesting new avenues of research. Taken collectively, the essays exemplify the very virtues of objectivity that they theorize—in reading them together, the reader can sense various anxieties about the dangerously subjective in our age and locate commonalities of concern as well as differences of approach. As a result, the volume offers an expansive vision of a research community seeking a communal understanding of its own methods and its own epistemic anxieties, struggling to enunciate the key problems of knowledge of our time and offer insight into how to overcome them. -/- (Contributors: Alex Csiszar, Scott Edgar, Peter Galison, Ian Hacking, Sandra Harding, Moira Howes, Paolo Savoia, Judy Segal, Joan Steigerwald, and Alison Wylie). (shrink)

To arrive at their final evaluation of a manuscript or grant proposal, reviewers must convert a submission’s strengths and weaknesses for heterogeneous peer review criteria into a single metric of quality or merit. I identify this process of commensuration as the locus for a new kind of peer review bias. Commensuration bias illuminates how the systematic prioritization of some peer review criteria over others permits and facilitates problematic patterns of publication and funding in science. Commensuration bias also foregrounds a range (...) of structural strategies for realigning peer review practices and institutions with the aims of science. (shrink)

Based on an empirical study of a research team in natural science, the author argues that collaborating scientists do not trust each other completely. Due to the inherent incompleteness of trust, epistemic trust among scientists is not sufficient to manage epistemic dependency in research teams. To mitigate the limitations of epistemic trust, scientists resort to specific strategies of indirect assessment such as dialoguing practices and the probing of explanatory responsiveness. Furthermore, they rely upon impersonal trust and deploy practices of hierarchical (...) authorship. (shrink)

Gender bias is a recalcitrant problem in academia and society. However, dissent has been created on this issue. We focus on dissenting studies by Stephen J. Ceci and Wendy M. Williams, arguing that they reach conclusions that are unwarranted on the basis of the available evidence and that they ignore fundamental objections to their methodological decisions. Drawing on discussions from other contexts, particularly on manufactured dissent concerning anthropogenic climate change, we conclude that dissent on gender bias substantially contributes to the (...) exacerbation of biases in society and an increasing number of attacks on researchers, making it both epistemically and socially problematic. (shrink)

Empirical evidence indicates that women philosophers tend to submit their work to journals substantially less often than their male colleagues. This paper points out that this difference in submission behavior comes with other specific aspects of women philosophers’ behavior, such as a tendency to be reluctant to participate in discussions, to be willing to do work low in prestige, and to specialize in certain research topics, and it argues that these differences can be understood as indirect effects of social biases: (...) namely, effects on the working behavior of members of targeted social groups. Recent findings from philosophy journals’ book review sections and from other academic disciplines known to suffer from gender problems, especially from STEM disciplines, lend additional weight to this hypothesis. (shrink)

Psychometrically oriented researchers construe low inter-rater reliability measures for expert peer reviewers as damning for the practice of peer review. I argue that this perspective overlooks different forms of normatively appropriate disagreement among reviewers. Of special interest are Kuhnian questions about the extent to which variance in reviewer ratings can be accounted for by normatively appropriate disagreements about how to interpret and apply evaluative criteria within disciplines during times of normal science. Until these empirical-cum-philosophical analyses are done, it will remain (...) unclear the extent to which low inter-rater reliability measures represent reasonable disagreement rather than arbitrary differences between reviewers. (shrink)

In this paper, I argue for a new way to understand the integration of facts and values in the concept of mental disorder that has the potential to avoid the flaws of previous hybrid approaches. I import conceptual tools from the account of procedural objectivity defended by Helen Longino to resolve the controversy over the definition of mental disorder. My argument is threefold: I first sketch the history of the debate opposing objectivists and constructivists and focus on the criticisms that (...) led to the emergence of the debate. Second, I offer a reconstruction of the “Natural Function Approach” argument to make explicit an unsound assumption underlying this approach. The reconstruction will allow me to show that the NFO’s argument depends on the ideal of value-free science that I will criticize. Then I propose an alternative ideal for psychiatry: social objectivity. I argue that the concept of mental health should be seen as “socially objective” rather than value-free, moving the debate towards the social procedures by which the definition is produced rather than the normative and factual content of its definition. (shrink)

Under the traditional system of peer-reviewed publication, the degree of prestige conferred to authors by successful publication is tied to the degree of the intellectual rigor of its peer review process: ambitious scientists do well professionally by doing well epistemically. As a result, we should expect journal editors, in their dual role as epistemic evaluators and prestige-allocators, to have the power to motivate improved author behavior through the tightening of publication requirements. Contrary to this expectation, I will argue that the (...) publication bias literature in academic medicine demonstrates that editor interventions have had limited effectiveness in improving the health of the publication and trial registration record, suggesting that much stronger interventions are needed. (shrink)

The underrepresentation of women, people of color, and especially women of color—and the corresponding overrepresentation of white men—is more pronounced in philosophy than in many of the sciences. I suggest that part of the explanation for this lies in the role played by the idealized rational self, a concept that is relatively influential in philosophy but rarely employed in the sciences. The idealized rational self models the mind as consistent, unified, rationally transcendent, and introspectively transparent. I hypothesize that acceptance of (...) the idealized rational self leads philosophers to underestimate the influence of implicit bias on their own judgments and prevents them from enacting the reforms necessary to minimize the effects of implicit bias on institutional decision-making procedures. I consider recent experiments in social psychology that suggest that an increased sense of one’s own objectivity leads to greater reliance on bias in hiring scenarios, and I hypothesize how these results might be applied to philosophers’ evaluative judgments. I discuss ways that the idealized rational self is susceptible to broader critiques of ideal theory, and I consider some of the ways that the picture functions as a tool of active ignorance and color-evasive racism. (shrink)

On the surface, developing a social psychology of science seems compelling as a way to understand how individual social cognition – in aggregate – contributes towards individual and group behavior within scientific communities (Kitcher, 2002). However, in cases where the functional input-output profile of psychological processes cannot be mapped directly onto the observed behavior of working scientists, it becomes clear that the relationship between psychological claims and normative philosophy of science should be refined. For example, a robust body of social (...) psychological research demonstrates implicit gender bias in the evaluation of others (e.g., Steinpreis, Anders, & Ritzke, 1999). Many expected implicit bias to be a major cause of women’s underrepresentation in math intensive fields of science; however, quantitative sociological research of hiring and manuscript and grant evaluation has discovered no gender disparity in outcomes (Ceci & Williams, 2011). Why might this be so? This paper will discuss methodological challenges that go beyond classic problems of external validity in extrapolating psychological effects and explanations to scientific communities. These problems include more complex external validity issues raised by the introduction of multi-process models of cognition (e.g., implicit versus explicit social cognition) as well as the reflexive role that folk and experimental theories of social psychology play in guiding the behavior of scientists at the individual and community level. (shrink)

There is an increasing push by journals to ensure that data and products related to published papers are shared as part of a cultural move to promote transparency, reproducibility, and trust in the scientific literature. Yet few journals commit to evaluating their effectiveness in implementing reporting standards aimed at meeting those goals (1, 2). Similarly, though the vast majority of journals endorse peer review as an approach to ensure trust in the literature, few make their peer review data available to (...) evaluate effectiveness toward achieving concrete measures of quality, including consistency and completeness in meeting reporting standards. Remedying these apparent disconnects is critical for closing the gap between guidance recommendations and actual reporting behavior. We see this as a collective action problem requiring leadership and investment by publishers, who can be incentivized through mechanisms that allow them to manage reputational risk and through continued innovation in journal assessment. (shrink)

Journal peer review is an essential part of academic practices.1 But how well does it serve its purpose and which factors have an influence on how close it comes to achieving its aims? Peer review has been widely discussed in empirical literature: it has been studied both qualitatively and quantitatively (e.g., by Cole, who in his 1992 book uses data on how grant applications submitted to National Science Foundation were...

In the debate about values in science, it is a time-honored tradition to distinguish between the normative question of whether non-cognitive values should play a role in science and the descriptive question of whether they in fact do so or not.1 Among philosophers of science, it is now an accepted view that the descriptive question has been settled. That is, it is no longer disputed that non-cognitive values play a role in science. Hence, all that is left to do on (...) the descriptive front is to describe these values and their roles in more detail. In the words of Longino: “We should stop asking whether social values play a role in science and ask which values and whose values play a role and how” (2004, p. .. (shrink)

This paper summarizes recent and ongoing experimental work regarding the reality, nature, effects, and causes of the underrepresentation of women in academic philosophy. We first present empirical data on several aspects of underrepresentation, and then consider various reasons why this gender imbalance is problematic. We then turn to the published and preliminary results of empirical work aimed at identifying factors that might explain it.

What is the current status of Asian Americans in philosophy? How do Asian Americans fare in comparison to other minority groups? And, what professional strategies might they use (more or less successfully) in response to their counterstereotypical status in philosophy? In this piece, I will address these questions empirically by extrapolating from available demographic, survey, and experimental studies. This analysis will be too fast and loose, but I offer it in the spirit of constructing a broad-brushed sketch— painted from a (...) pallet of variegated data—for others to critique, improve, and displace. (shrink)

Recent work on women’s underrepresentation in philosophy has focused on a distinction between “in class” and “pre-university” effects as the primary cause of women’s underrepresentation in philosophy. This paper reports from a large dataset (n > 2,000,000) from the Cooperative Institutional Research Program that shows that, of the American students that intended to major in philosophy before they started college, about two-thirds are men. This lends credence to the pre-university effects explanation for women’s underrepresentation in philosophy. This paper will discuss (...) this finding in light of Louise Antony’s “perfect storm” theory of women’s underrepresentation in philosophy. I will argue that a major part of the perfect storm for women in philosophy is a masculine philosopher schema that discourages women from continuing in philosophy even before they enter a college philosophy class. I will also consider two objections to this argument, what I call the “problem of ignorance” and the “transmission problem.”. (shrink)