Computer simulation of an epistemic landscape model, modified to include explicit representation of a centralized funding body, show the method of funding allocation has significant effects on communal trade-off between exploration and exploitation, with consequences for the community’s ability to generate significant truths. The results show this effect is contextual, and depends on the size of the landscape being explored, with funding that includes explicit random allocation performing significantly better than peer review on large landscapes. The article proposes a way (...) of incorporating external institutional factors in formal social epistemology, and offers a way of bringing such investigations to bear on current research policy questions. 1Introduction2Theoretical Background3Model Description4Simulation Details 4.1Simulating the epistemic landscape4.2Simulating agents4.3Simulating communal knowledge4.4Simulating funding strategies4.5Simulating merit dynamics5Results and Discussion 5.1Experiment 1: The winner-takes-it-all mechanism only5.2Experiment 2: All dynamic mechanisms5.3Experiment 3: Adding a new funding mechanism 5.4Experiment 4: Varying the degree of myopia5.5Experiment 5: Variability of individual epistemic gain5.6Experiment 6: Likelihood of renewal6Discussion7Conclusion. (shrink)

BackgroundIt is commonly reported by editors that it has become harder to recruit reviewers for peer review and that this is because individuals are being asked to review too often and are experiencing reviewer fatigue. However, evidence supporting these arguments is largely anecdotal.Main bodyWe examine responses of individuals to review invitations for six journals in ecology and evolution. The proportion of invitations that lead to a submitted review has been decreasing steadily over 13 years (2003–2015) for four of the six (...) journals examined, with a cumulative effect that has been quite substantial (average decline from 56% of review invitations generating a review in 2003 to just 37% in 2015). The likelihood that an invitee agrees to review declines significantly with the number of invitations they receive in a year. However, the average number of invitations being sent to prospective reviewers and the proportion of individuals being invited more than once per year has not changed much over these 13 years, despite substantial increases in the total number of review invitations being sent by these journals—the reviewer base has expanded concomitant with this growth in review requests.ConclusionsThe proportion of review invitations that lead to a review being submitted has been declining steadily for four of the six journals examined here, but reviewer fatigue is not likely the primary explanation for this decline. (shrink)

BackgroundHealth research funding agencies are placing a growing focus on knowledge translation (KT) plans, also known as dissemination and implementation (D&I) plans, in grant applications to decrease the gap between what we know from research and what we do in practice, policy, and further research. Historically, review panels have focused on the scientific excellence of applications to determine which should be funded; however, relevance to societal health priorities, the facilitation of evidence-informed practice and policy, or realizing commercialization opportunities all require (...) a different lens.DiscussionWhile experts in their respective fields, grant reviewers may lack the competencies to rigorously assess the KT components of applications. Funders of health research—including health charities, non-profit agencies, governments, and foundations—have an obligation to ensure that these components of funding applications are as rigorously evaluated as the scientific components. In this paper, we discuss the need for a more rigorous evaluation of knowledge translation potential by review panels and propose how this may be addressed.ConclusionWe propose that reviewer training supported in various ways including guidelines and KT expertise on review panels and modalities such as online and face-to-face training will result in the rigorous assessment of all components of funding applications, thus increasing the relevance and use of funded research evidence. An unintended but highly welcome consequence of such training could be higher quality D&I or KT plans in subsequent funding applications from trained reviewers. (shrink)