This article examines whether and how a particular research practice is overseen and supervised, and by whom. This investigation fills notable gaps in the literature on science, including a lack of emphasis on larger sociopolitical structures, a neglect of regulation, and indifference toward ethics. The author focuses on the oversight of a particular research practice; data editing; which embodies qualities that are intriguing to sociologists of science: invisibility, uncertainty, heterogeneity, and reliance on tacit knowledge. These characteristics pose unique challenges to (...) oversight efforts. An analysis of in-depth interviews with gatekeepers reveals that although the methodological and ethical implications of data editing strategies can be substantial, oversight of such practices falls outside the stages and domains of current gatekeeping activity. These findings serve as the basis for recommendations to ensure data integrity while maintaining the professional autonomy of researchers. (shrink)

Published research findings are sometimes refuted by subsequent evidence, says Ioannidis, with ensuing confusion and disappointment.

This fascinating study in the sociology of science explores the way scientists conduct, and draw conclusions from, their experiments. The book is organized around three case studies: replication of the TEA-laser, detecting gravitational rotation, and some experiments in the paranormal. "In his superb book, Collins shows why the quest for certainty is disappointed. He shows that standards of replication are, of course, social, and that there is consequently no outside standard, no Archimedean point beyond society from which we can lever (...) the intellects of our fellows. "- -Donald M. McCloskey, Journal of Economic Psychology "Collins is one of the genuine innovators of the sociology of scientific knowledge.... Changing Order is a rich and entertaining book. "- - Isis "The book gives a vivid sense of the contingent nature of research and is generally a good read. "- -Augustine Brannigan, Nature "This provocative book is a review of [Collins's] work, and an attempt to explain how scientists fit experimental results into pictures of the world.... A promising start for new explorations of our image of science, too often presented as infallibly authoritative. "- -Jon Turney, New Scientist. (shrink)

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications (...) of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)