A growing interest in and concern about the adequacy and fairness of modern peer-review practices in publication and funding are apparent across a wide range of scientific disciplines. Although questions about reliability, accountability, reviewer bias, and competence have been raised, there has been very little direct research on these variables.The present investigation was an attempt to study the peer-review process directly, in the natural setting of actual journal referee evaluations of submitted manuscripts. As test materials we selected 12 already published (...) research articles by investigators from prestigious and highly productive American psychology departments, one article from each of 12 highly regarded and widely read American psychology journals with high rejection rates (80%) and nonblind refereeing practices.With fictitious names and institutions substituted for the original ones (e.g., Tri-Valley Center for Human Potential), the altered manuscripts were formally resubmitted to the journals that had originally refereed and published them 18 to 32 months earlier. Of the sample of 38 editors and reviewers, only three (8%) detected the resubmissions. This result allowed nine of the 12 articles to continue through the review process to receive an actual evaluation: eight of the nine were rejected. Sixteen of the 18 referees (89%) recommended against publication and the editors concurred. The grounds for rejection were in many cases described as “serious methodological flaws.” A number of possible interpretations of these data are reviewed and evaluated. (shrink)

A scientific community cannot practice its trade without some set of received beliefs. These beliefs form the foundation of the "educational initiation that prepares and licenses the student for professional practice". The nature of the "rigorous and rigid" preparation helps ensure that the received beliefs are firmly fixed in the student's mind. Scientists take great pains to defend the assumption that scientists know what the world is like...To this end, "normal science" will often suppress novelties which undermine its foundations. Research (...) is therefore not about discovering the unknown, but rather "a strenuous and devoted attempt to force nature into the conceptual boxes supplied by professional education". (shrink)

In this 1976 volume, Professor Ziman paints a broad picture of science, and of its relations to the world in general. He sets the scene by the historical development of scientific research as a profession, the growth of scientific technologies out of the useful arts, the sources of invention and technical innovation, and the advent of Big Science. He then discusses the economics of research and development, the connections between science and war, the nature of science policy and the moral (...) dilemmas of social responsibility in science. Each topic is introduced by reference to easily understandable particular examples, with a large number of illustrations chosen to bring out the concreteness and reality of science as a human activity. Professor Ziman gives a chapter-by-chapter list of suggested topics for oral and written discussion, intended to provoke critical, sceptical attitudes to simplified solutions to real issues, and comments briefly on relevant books and other sources. (shrink)

Researchers display confirmation bias when they persevere by revising procedures until obtaining a theory-predicted result. This strategy produces findings that are overgeneralized in avoidable ways, and this in turn binders successful applications. (The 40-year history of an attitude-change phenomenon.

A growing interest in and concern about the adequacy and fairness of modern peer-review practices in publication and funding are apparent across a wide range of scientific disciplines. Although questions about reliability, accountability, reviewer bias, and competence have been raised, there has been very little direct research on these variables.

Staged 2 different videotaped interviews with the same individual—a college instructor who spoke English with a European accent. In one of the interviews the instructor was warm and friendly, in the other, cold and distant. 118 undergraduates were asked to evaluate the instructor. Ss who saw the warm instructor rated his appearance, mannerisms, and accent as appealing, whereas those who saw the cold instructor rated these attributes as irritating. Results indicate that global evaluations of a person can induce altered evaluations (...) of the person's attributes, even when there is sufficient information to allow for independent assessments of them. Furthermore, Ss were unaware of this influence of global evaluations on ratings of attributes. In fact, Ss who saw the cold instructor actually believed that the direction of influence was opposite to the true direction. They reported that their dislike of the instructor had no effect on their rating of his attributes but that their dislike of his attributes had lowered their global evaluations of him. (shrink)

Laudan constructs a fresh approach to a longtime problem for the philosopher of science: how to explain the simultaneous and widespread presence of both agreement and disagreement in science. Laudan critiques the logical empiricists and the post-positivists as he stresses the need for centrality and values and the interdependence of values, methods, and facts as prerequisites to solving the problems of consensus and dissent in science.

Two books have been particularly influential in contemporary philosophy of science: Karl R. Popper's Logic of Scientific Discovery, and Thomas S. Kuhn's Structure of Scientific Revolutions. Both agree upon the importance of revolutions in science, but differ about the role of criticism in science's revolutionary growth. This volume arose out of a symposium on Kuhn's work, with Popper in the chair, at an international colloquium held in London in 1965. The book begins with Kuhn's statement of his position followed by (...) seven essays offering criticism and analysis, and finally by Kuhn's reply. The book will interest senior undergraduates and graduate students of the philosophy and history of science, as well as professional philosophers, philosophically inclined scientists, and some psychologists and sociologists. (shrink)

This article reports the results of a study of confirmational response bias among social work journals. A contrived research paper with positive findings and its negative mirror image were submitted to two different groups of social work journals and to two comparison groups of journals outside social work. The quantitative results, suggesting bias, are tentative; but the qualitative findings based upon an analysis of the referee comments are clear and consistent. Few referees from prestigious or nonprestcgrous social work journals prepared (...) reviews that were knowledgeable, scientifically astute, or objective. The best reviews came from journals outside of soccal work or from journals that are accepted as social work journals but originate with other disciplines. (shrink)

The thirty-five chapters in this book describe various judgmental heuristics and the biases they produce, not only in laboratory experiments but in important...