Prepublication peer review should be abolished. We consider the effects that such a change will have on the social structure of science, paying particular attention to the changed incentive structure and the likely effects on the behaviour of individual scientists. We evaluate these changes from the perspective of epistemic consequentialism. We find that where the effects of abolishing prepublication peer review can be evaluated with a reasonable level of confidence based on presently available evidence, they are either positive or neutral. (...) We conclude that on present evidence abolishing peer review weakly dominates the status quo. (shrink)

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications (...) of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)

Recent work has demonstrated that academic research faces serious challenges. Incentives to defend publishable ideas often lead researchers astray. Despite their tendency to produce error, efforts to publish erroneous results typically help a researcher's career. In addition, errors often arise from seemingly innocent methodological assumptions that allow researchers to believe their research is sound. This article discusses this research, as well as research into difficulties facing epistemic rationality caused by nonepistemic incentives. It then applies the lessons of this research to (...) philosophical practice. It explains why philosophy likely suffers from these problems. It then provides an example of a widely shared methodological assumption that allows such research to be pursued and regularly published. It claims that the significance philosophers place on arguments is inappropriate, and that typical evaluations of philosophical arguments involve an instance of the base-rate fallacy. It concludes by discussing whether or not this article is self-defeating. (shrink)

With the ever expanding array of professional journals, pressures on the peer review process have increased considerably. Unless editors and publishers recognize the need for improving the efficiency of the process, the future of traditional peer review may be at risk. This is a review of the studies that have followed up the suggestions made by Ingelfinger in 1974 for improvement of manuscript peer review. Implementation of changes has been slow, despite the abundance of literature that suggests the necessary improvements. (...) Conscientious self-regulation is expected of editors who, in the current publication scenario, possess enormous power without liability. Suitability of peer review to outsourcing should be assessed and if it is absolutely essential to outsource peer review, care should be taken to ensure that it is implemented systematically and monitored regularly for quality. Finally, it is time for high earning publishers to consider compensation for the efforts of the reviewers. (shrink)