A relatively high incidence of unsatisfactory review decisions is widely recognised and acknowledged as ‘the peer review problem’. Factors contributing to this problem are identified and examined. Specific examples of unreasonable rejection are considered. It is concluded that weaknesses of the ‘peer review’ system are significant and that they are well known or readily recognisable but that necessary counter-measures are not always enforced. Careful management is necessary to discount hollow opinion or error in review comment. Review and referee functions should (...) be quite separate. (shrink)

This paper reviews the published empirical evidence concerning journal peer review consisting of 68 papers, all but three published since 1975. Peer review improves quality, but its use to screen papers has met with limited success. Current procedures to assure quality and fairness seem to discourage scientific advancement, especially important innovations, because findings that conflict with current beliefs are often judged to have defects. Editors can use procedures to encourage the publication of papers with innovative findings such as invited papers, (...) early-acceptance procedures, author nominations of reviewers, structured rating sheets, open peer review, results-blind review, and, in particular, electronic publication. Some journals are currently using these procedures. The basic principle behind the proposals is to change the decision from whether to publish a paper to how to publish it. (shrink)

Implicit bias results from living in a society structured by race. Tamar Gendler has drawn attention to several epistemic costs of implicit bias and concludes that paying some costs is unavoidable. In this paper, we reconstruct Gendler’s argument and argue that the epistemic costs she highlights can be avoided. Though epistemic agents encode discriminatory information from the environment, not all encoded information is activated. Agents can construct local epistemic environments that do not activate biasing representations, effectively avoiding the consequences of (...) activation. We conclude that changing our local environments provides a way to avoid paying implicit bias’s epistemic costs. (shrink)

This paper summarizes recent and ongoing experimental work regarding the reality, nature, effects, and causes of the underrepresentation of women in academic philosophy. We first present empirical data on several aspects of underrepresentation, and then consider various reasons why this gender imbalance is problematic. We then turn to the published and preliminary results of empirical work aimed at identifying factors that might explain it.

Saul_Jennifer, Scepticism and Implicit Bias.

Policy disputes arise at all scales of governance: in clubs, non-profits, firms, nations, and alliances of nations. Both the means and ends of policy are disputed. While many, perhaps most, policy disputes arise from conflicting ends, important disputes also arise from differing beliefs on how to achieve shared ends. In fact, according to many experts in economics and development, governments often choose policies that are “inefficient” in the sense that most everyone could expect to gain from other feasible policies. Many (...) other kinds of experts also see existing policies as often clearly inferior to known alternatives. (shrink)

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications (...) of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)

In this essay we introduce the idea of an epistemic triangle, with factual, theoretical, and conceptual investigations at its vertices, and argue that whereas scientific progress requires a balance among the three types of investigations, psychology's epistemic triangle is stretched disproportionately in the direction of factual investigations. Expressed by a variety of different problems, this unbalance may be created by a main operative theme—the obsession of psychology with a narrow and mechanical view of the scientific method and a misguided aversion (...) to conceptual inquiries. Hence, to redress psychology's epistemic triangle, a broader and more realistic conception of method is needed and, in particular, conceptual investigations must be promoted. Using examples from different research domains, we describe the nature of conceptual investigations, relate them to theoretical investigations, and illustrate their purposes, forms, and limitations. (shrink)

Over the past hundred years, a number of scientific investigators claim to have adduced experimental evidence for phenomena information” seems to behave like a weak signal that has to compete for the information-processing resources of the organism, a reduction of ongoing sensorimotor activity may facilitate ESP detection. Such a meaningful convergence of results suggests that psi phenomena may represent a unitary, coherent process whose nature and compatibility with current physical theory have yet to be determined. The theoretical implications and potential (...) practical applications of psi could be significant, irrespective of the small magnitude of psi effects in laboratory settings. (shrink)

In a recent article in the British Journal for the Philosophy of Science, Heesen and Bright argue that prepublication peer review should be abolished and replaced with postpublication peer review (provided the matter is judged purely on epistemic grounds). In this article, I show that there are three problems with their argument. First, it fails to consider the epistemic cost of implementing the change to postpublication peer review. Second, it fails to consider some potential epistemic benefits of prepublication peer review, (...) which involve avoiding bias. Third, it fails to consider some potential epistemic disadvantages of postpublication peer review, which stem from the greater number of papers that would be published under that system. (shrink)

An empirically sensitive formulation of the norms of transformative criticism must recognize that even public and shared standards of evaluation can be implemented in ways that unintentionally perpetuate and reproduce forms of social bias that are epistemically detrimental. Helen Longino’s theory can explain and redress such social bias by treating peer evaluations as hypotheses based on data and by requiring a kind of perspectival diversity that bears, not on the content of the community’s knowledge claims, but on the beliefs and (...) norms of the culture of the knowledge community itself. To illustrate how socializing cognition can bias evaluations, we focus on peer-review practices, with some discussion of peer-review practices in philosophy. Data include responses to surveys by editors from general philosophy journals, as well as analyses of reviews and editorial decisions for the 2007 Cognitive Science Society Conference. (shrink)

ABSTRACT:This study examines whether the empirical evidence on the relationship between corporate social performance (CSP) and corporate financial performance (CFP) differs depending on the publication outlet in which that evidence appears. This moderator meta-analysis, based on a total sample size of 33,878 observations, suggests that published CSP-CFP findings have been shaped by differences in institutional logics in different subdisciplines of organization studies. In economics, finance, and accounting journals, the average correlations were only about half the magnitude of the findings published (...) in Social Issues in Management, Business Ethics, or Business and Society journals (mean corrected correlation coefficientof.22 vs..49, respectively). Specifically, economists did not find null or negative CSP-CFP correlations, and average findings published in general management outlets (=.41) were closer to Social Issues in Management, Business Ethics, and Business and Society results than to findings reported in economics, finance, and accounting journals. (shrink)

The authors review three theoretical approaches to strategic corporate social responsibility (CSR), which can be defined as voluntary CSR actions that enhance a firm’s competitiveness and reputation. The end result of such activities should be an improvement in financial and economic performance. Based on an overview of recent empirical evidence, the authors conclude that economic theories of strategic CSR have the greatest potential for advancing this field of inquiry, although theories of strategic leadership should also be incorporated into this perspective. (...) In the remainder of the article, they provide focused summaries of the articles presented in this special issue and outline an agenda for future research on strategic CSR and environmental sustainability. (shrink)

On the surface, developing a social psychology of science seems compelling as a way to understand how individual social cognition – in aggregate – contributes towards individual and group behavior within scientific communities (Kitcher, 2002). However, in cases where the functional input-output profile of psychological processes cannot be mapped directly onto the observed behavior of working scientists, it becomes clear that the relationship between psychological claims and normative philosophy of science should be refined. For example, a robust body of social (...) psychological research demonstrates implicit gender bias in the evaluation of others (e.g., Steinpreis, Anders, & Ritzke, 1999). Many expected implicit bias to be a major cause of women’s underrepresentation in math intensive fields of science; however, quantitative sociological research of hiring and manuscript and grant evaluation has discovered no gender disparity in outcomes (Ceci & Williams, 2011). Why might this be so? This paper will discuss methodological challenges that go beyond classic problems of external validity in extrapolating psychological effects and explanations to scientific communities. These problems include more complex external validity issues raised by the introduction of multi-process models of cognition (e.g., implicit versus explicit social cognition) as well as the reflexive role that folk and experimental theories of social psychology play in guiding the behavior of scientists at the individual and community level. (shrink)