Although peer review provides the primary mechamism for allocating research funds, very few people have undertaken any serious study of the issue. Most of the literature surrounding peer review comes from individuals who have experienced specific problems with the system. The one detail that does stand out is that though policy makers and researchers seem to view peer review as a specific process, no single form exists. In fact, almost agency and foundation has its own unique process. This presentation will (...) explore the concept of peer review and highlight its strengths and weaknesses. (shrink)

Large differences in scientific productivity between male and female researchers have not yet been explained satisfactorily. This study finds that child care and lack of research collaboration are the two factors that cause significant gender differences in scientific publishing. Women with young children and women who do not collaborate in research with other scientists are clearly less productive than both their male and female colleagues.

We analyze the prestige of 1,500 scholars in economics, sociology, and management who have Spanish and French institutional affiliations operationalized by their h-index in Scopus and Google Scholar. We use a negative binomial count model to examine how some individual factors affect the h-index from both databases. The results show a non-monotonic relationship between the researchers’ career length and their h-index. There is a positive and statistically significant relationship between total research output and the h-index. The share of publications in (...) English over total publications has also a positive and statistically significant effect on the h-index, except in a single case, while the share of publications in other foreign languages does not have such effect. Finally, we found that the effects of the number of citations received by documents in English and by those in the vernacular language on the h-index vary according to the database, the country, and the discipline in question. (shrink)

I show that the social stratification of academic science can arise as a result of academics’ preference for reading work of high epistemic value. This is consistent with a view on which academic superstars are highly competent academics, but also with a view on which superstars arise primarily due to luck. I argue that stratification is beneficial if most superstars are competent, but not if most superstars are lucky. I also argue that it is impossible to tell whether most superstars (...) are in fact competent or lucky, or which group a given superstar belongs to, and hence whether stratification is overall beneficial. (shrink)

Preferably scientific investigations would promote true rather than false beliefs. The phenomenon of fraud represents a standing challenge to this veritistic ideal. When scientists publish fraudulent results they knowingly enter falsehoods into the information stream of science. Recognition of this challenge has prompted calls for scientists to more consciously adopt the veritistic ideal in their own work. In this paper I argue against such promotion of the veritistic ideal. It turns out that a sincere desire on the part of scientists (...) to see the truth propagated may well promote more fraud rather than less. (shrink)

The sociology of science seeks to theorize the social conditioning of science. This theorizing seems to undermine the validity of scientific knowledge and lead to relativism. Bourdieu and Latour both attempt to develop a sociology of science that overcomes relativism but stipulate opposite conditions for the production of scientific truths: while Bourdieu emphasizes autonomy, Latour emphasizes associations. This is because they work with oppositional epistemological and ontological assumptions. In both theories, the notion of truth lacks an independent definition; it is (...) derived from the theorist’s position on rationalism and defined with reference to how it is produced. This interdependence creates a different problem in each case. Bourdieu’s assertion that truths produced in relatively autonomous scientific fields are “trans-historical” remains an epistemological assertion. Latour’s argument that truths are produced through associations fails to capture the different resources, distinctions and boundarie.. (shrink)

ArgumentKuhnian phases of paradigmatic development correspond to characteristic variations of citation measures. These correlations can in turn be predicted from a simple model of human information processing when applied to the common environments of scientists. By combining a scientometric and a human information processing approach to the history of scientific thought, structures of disciplinary development, and in particular paradigmatic cycles, can be more reliably assessed than before. Consequently, the quantitative historian of science is liberated to some extent from the vagaries (...) of qualitative judgment, as exemplified by traditional narrative type approaches to the history of science. (shrink)

A growing interest in and concern about the adequacy and fairness of modern peer-review practices in publication and funding are apparent across a wide range of scientific disciplines. Although questions about reliability, accountability, reviewer bias, and competence have been raised, there has been very little direct research on these variables.The present investigation was an attempt to study the peer-review process directly, in the natural setting of actual journal referee evaluations of submitted manuscripts. As test materials we selected 12 already published (...) research articles by investigators from prestigious and highly productive American psychology departments, one article from each of 12 highly regarded and widely read American psychology journals with high rejection rates (80%) and nonblind refereeing practices.With fictitious names and institutions substituted for the original ones (e.g., Tri-Valley Center for Human Potential), the altered manuscripts were formally resubmitted to the journals that had originally refereed and published them 18 to 32 months earlier. Of the sample of 38 editors and reviewers, only three (8%) detected the resubmissions. This result allowed nine of the 12 articles to continue through the review process to receive an actual evaluation: eight of the nine were rejected. Sixteen of the 18 referees (89%) recommended against publication and the editors concurred. The grounds for rejection were in many cases described as “serious methodological flaws.” A number of possible interpretations of these data are reviewed and evaluated. (shrink)

Current sociology of knowledge tends to take for granted Robert K. Merton’s theory of cumulative advantage: successful ideas bring recognition to their authors, successful authors have their ideas recognized more easily than unknown ones. This article argues that this theory should be revised via the introduction of the differential between the status of an idea and that of its creator: when an idea is more important than its creator, the latter becomes identified with the former, and this will hinder recognition (...) of the intellectual’s new ideas as they differ from old ones in their content or style. Robert N. Bellah’s performance during the “civil religion debate” of the 1970s is reconstructed as an example of how this mechanism may work. Implications for further research are considered in the concluding section. (shrink)

Select groups and organizations embrace practices that perpetuate their inferiority. The result is the phenomenon we call “mediocrity.” This article examines the conditions under which mediocrity is selected and maintained by groups over time. Mediocrity is maintained by a key social process: the marginalization of the adept, which is a response to the group problem of what to do with the highly able. The problem arises when a majority of a group is comprised of average members who must decide what (...) to do with high performers in the group. To solve this problem, reward systems are subverted to benefit the less able and the adept are cast as deviant. Marginalization is a resolution of two tensions: marginalization of the adept for their behavior, and protection from the adept for the mediocre. The American research university is used as an example to describe the phenomenon and to formulate a theoretic argument. The forms and consequences of marginalization are discussed. Marginalizing the adept illustrates an anti-meritocratic behavioral pattern which serves to sustain social systems on which all people, however able, depend. (shrink)

This article asserts that graduate study should include preparation for participation in the process of self-regulation to assure the responsible conduct of research in the scientific community. This article outlines the various ways in which doctoral study can incorporate such preparation. These suggested ways include the inculcation of general attitudes and values about professional self-regulation, various ways doctoral study can be configured so that future scientists are prepared to participate in the deterrence, detection and sanctioning of scientific wrongdoing. The stages (...) of doctoral study in the United States and their relevance to preparation for self-regulations are also discussed. Recommendations regarding an extended role for faculty advisors, graduate assistantships, coursework and departmental policies and activities are also advanced. (shrink)

More than resource allocations, evaluations of funding applications have become central instances for status bestowal in academia. Much attention in past literature has been devoted to grasping the status consequences of prominent funding evaluations. But little attention has been paid to understanding how the status-bestowing momentum of such evaluations is constructed. Throughout this paper, our aim is to develop new knowledge on the role of applicants in constructing certain funding evaluations as events with crucial importance for status bestowal. Using empirical (...) material from retrospective interviews with Sweden-based early-career scientists who, successfully or unsuccessfully, applied for European Research Council (ERC) Starting Grants, our findings show how these scientists interlinked experiences from various practices to construct the ERC’s evaluations, in general, and the final-stage appointments at Brussels’ Madou Plaza Tower, in particular, as apex-esque, crescendo-like status-bestowing events. We discuss our findings as instructional, preparatory, and demarcative practices that, by extension, distribute responsibility for the construction and reinforcement of high-stakes, career-defining evaluations through which considerable stress and anxiety is generated in academia. (shrink)

Physicists were asked the question, “What do you think are the most important qualities needed to be successful at the type of work you do?” The results demonstrate which qualities physicists value and how values vary among the qualities they identified. The results also show how physicists’ beliefs about success vary by the rank of their department, age, productivity, and gender. More generally, the findings cast light on the moral order of physics by eliciting how members of an occupation construe (...) the structure of success in their line of work. (shrink)

Research on the public understanding of science has measured knowledge as acquaintance with scientific facts and methods and attitudes as evaluations of societal consequences of science and technology. The authors propose alternative concepts and measures: knowledge of the workings of scientific institutions and attitudes to the nature of science. The viability, reliability, and validity of the new measures are demonstrated on British and Bulgarian data. The instrument consists of twenty items and takes ten to fifteen minutes to apply. Differences in (...) the representation of science are reported between the British and Bulgarian young elite, between the elite and the public in Bulgaria, between natural and social science students, and between beginners and advanced students in Britain. The use of these measures will extend the scope of science indicator measures used by the European Commission and the National Science Foundation, help the assessment of the socialization in university training, and may even contribute to the peace process in the “science wars.”. (shrink)

This article compares the career trajectories and mobility patterns of Nobel Laureates in economics with those of highly cited sociologists to evaluate a theory advanced by Richard Whitley that postulates a nexus between the overall intellectual structure of a discipline and the composition of its elite. The theory predicts that the most eminent scholars in internally fragmented disciplines such as sociology will vary in their departmental affiliations and academic career paths, while disciplines such as economics with strong linkages between specialties (...) and shared standards of excellence will be dominated by a more homogeneous elite. The comparison provides strong empirical evidence in favor of Whitley’s theory. The careers of the most eminent economists are closely tied to the top five departments of the discipline, whereas the career pathways to eminence in sociology are largely unpredictable. (shrink)

There is a commonly made distinction between two types of scientists: risk-taking, trailblazing mavericks and detail-oriented followers. A number of recent papers have discussed the question what a desirable mixture of mavericks and followers looks like. Answering this question is most useful if a scientific community can be steered toward such a desirable mixture. One attractive route is through credit incentives: manipulating rewards so that reward-seeking scientists are likely to form the desired mixture of their own accord. Here I argue (...) that this idea is less straightforward than it may seem. Interpreting mavericks as scientists who prioritize rewards over speed and risk, I show in a deliberatively simple model that there is a fixed mixture which is not particularly likely to be desirable and which credit incentives cannot alter. I consider a way around this result, but this has some major drawbacks. I conclude that credit incentives are not as promising a way to create a desirable mixture of mavericks and followers as one might have thought. (shrink)

Using a decision theoretic model of scientists’ time allocation between potential research projects I explain the fact that on average women scientists publish less research papers than men scientists. If scientists are incentivised to publish as many papers as possible, then it is necessary and sufficient for a productivity gap to arise that women scientists anticipate harsher treatment of their manuscripts than men scientists anticipate for their manuscripts. I present evidence that women do expect harsher treatment and that scientists’ are (...) incentivised to publish as many papers as possible, and discuss some epistemological consequences of this conjecture. (shrink)

It is now recognized that relations of trust play an epistemic role in science. The contested issue is under what conditions trust in scientific testimony is warranted. I argue that John Hardwig's view of trustworthy scientific testimony is inadequate because it does not take into account the possibility that credibility does not reliably reflect trustworthiness, and because it does not appreciate the role communities have in guaranteeing the trustworthiness of scientific testimony.