While some form of evaluation has always been employed in science (e.g. peer review, hiring), formal systems of evaluation of research and researchers have recently come to play a more prominent role in many countries because of the adoption of new models of governance. According to such models, the quality of the output of both researchers and their institutions is measured, and issues such as eligibility for tenure or the allocation of public funding to research institutions crucially depends on the (...) outcomes of such measures. However, concerns have been raised over the risk that such evaluation may be threatening epistemic pluralism by penalizing the existent heterodox schools of thought and discouraging the pursuit of new ones. It has been proposed that this may happen because of epistemic bias favouring mainstream research programmes. In this paper, I claim that (1) epistemic pluralism is desirable and should be preserved; (2) formal evaluation exercises may threaten epistemic pluralism because they may be affected by some form of epistemic bias; therefore, (3) to preserve epistemic pluralism, we need some strategy to actively dampen epistemic bias. (shrink)

Prepublication peer review should be abolished. We consider the effects that such a change will have on the social structure of science, paying particular attention to the changed incentive structure and the likely effects on the behaviour of individual scientists. We evaluate these changes from the perspective of epistemic consequentialism. We find that where the effects of abolishing prepublication peer review can be evaluated with a reasonable level of confidence based on presently available evidence, they are either positive or neutral. (...) We conclude that on present evidence abolishing peer review weakly dominates the status quo. (shrink)

The question of the division of cognitive labor has given rise to various models characterizing the way scientists should distribute their efforts. These models often consider the scientific community as a self-governed sphere constituted by rational agents making choices on the basis of fixed rules. Such models have recently been criticized for not taking into account the real mechanisms of science funding. Hence, the question of the utility of the DCL models in guiding science policy remains an open one. In (...) this paper, we show that two unconsidered dimensions would have to be taken into account. First, DCL studies miss the existence of distinct levels of epistemic objectives organizing the research process. Indeed, the scientific field is structured as a system of hierarchical, interconnected practices which are defined both by their inherent purposes and by various superposed external functions. Second, I criticize the absence of ontological considerations, since the epistemological significance of pluralism is highly dependent on the nature of the object under study. Because of these missing dimensions, current DCL models might have a limited usefulness to identify good practices of research governance. (shrink)

The question of the division of cognitive labor has given rise to various models characterizing the way scientists should distribute their efforts. These models often consider the scientific community as a self-governed sphere constituted by rational agents making choices on the basis of fixed rules. Such models have recently been criticized for not taking into account the real mechanisms of science funding. Hence, the question of the utility of the DCL models in guiding science policy remains an open one. In (...) this paper, we show that two unconsidered dimensions would have to be taken into account. First, DCL studies miss the existence of distinct levels of epistemic objectives organizing the research process. Indeed, the scientific field is structured as a system of hierarchical, interconnected practices which are defined both by their inherent purposes and by various superposed external functions. Second, I criticize the absence of ontological considerations, since the epistemological significance of pluralism is highly dependent on the nature of the object under study. Because of these missing dimensions, current DCL models might have a limited usefulness to identify good practices of research governance. (shrink)

We consider how an epistemic network might self-assemble from the ritualization of the individual decisions of simple heterogeneous agents. In such evolved social networks, inquirers may be significantly more successful than they could be investigating nature on their own. The evolved network may also dramatically lower the epistemic risk faced by even the most talented inquirers. We consider networks that self-assemble in the context of both perfect and imperfect communication and compare the behaviour of inquirers in each. This provides a (...) step in bringing together two new and developing research programs, the theory of self-assembling games and the theory of network epistemology. (shrink)

Typically, public discussions of questions of social import exhibit two important properties: they are influenced by conformity bias, and the influence of conformity is expressed via social networks. We examine how social learning on networks proceeds under the influence of conformity bias. In our model, heterogeneous agents express public opinions where those expressions are driven by the competing priorities of accuracy and of conformity to one’s peers. Agents learn, by Bayesian conditionalization, from private evidence from nature, and from the public (...) declarations of other agents. Our key findings are that networks that produce configurations of social relationships that sustain a diversity of opinions empower honest communication and reliable acquisition of true beliefs, and that the networks that do this best turn out to be those which are both less centralized and less connected. (shrink)

There has been much discussion of the moral, legal and prudential implications of geoengineering, and of governance structures for both the research and deployment of such technologies. However, insufficient attention has been paid to how such measures might affect geoengineering in terms of the incentive structures which underwrite scientific progress. There is a tension between the features that make science productive, and the need to govern geoengineering research, which has thus far gone underappreciated. I emphasize how geoengineering research requires governance (...) which reaches beyond science’s traditional boundaries, and moreover requires knowledge which itself reaches beyond what we traditionally expect scientists to know about. How we govern emerging technologies should be sensitive to the incentive structures which drive science. (shrink)

Recent empirical work has shown that many scientific results may not be reproducible. By itself, this does not entail that there is a problem. However, I argue that there is a problem: the reward structure of science incentivizes scientists to focus on speed and impact at the expense of the reproducibility of their work. I illustrate this using a well-known failure of reproducibility: Fleischmann and Pons' work on cold fusion. I then use a rational choice model to identify a set (...) of sufficient conditions for this problem to arise, and I argue that these conditions plausibly apply to a wide range of research situations. In the conclusion I consider possible solutions and implications for how Fleischmann and Pons' work should be evaluated. (shrink)