The fallacies, as traditionally conceived, are wrong ways of reasoning that nevertheless appear attractive to us. Recently, however, Woods (2013) has argued that they don’t merit such a title, and that what we take to be fallacies are instead largely virtuous forms of reasoning. This reformation of the fallacies forms part of Woods’ larger project to naturalize logic. In this paper I will look to his analysis of the argumentum ad hominem as a case study for the prospects of this (...) project. I will argue that the empirical literature on implicit bias presents a difficulty for the reformation of the ad hominem as cognitively virtuous. Cases where implicit bias influences our assessment of the truth or claim or argument are instances of ad hominem reasoning, and these qualify as fallacious on Woods’ own definition. (shrink)

Peer review is often taken to be the main form of quality control on academic research. Usually journals carry this out. However, parts of maths and physics appear to have a parallel, crowd-sourced model of peer review, where papers are posted on the arXiv to be publicly discussed. In this paper we argue that crowd-sourced peer review is likely to do better than journal-solicited peer review at sorting papers by quality. Our argument rests on two key claims. First, crowd-sourced peer (...) review will lead on average to more reviewers per paper than journal-solicited peer review. Second, due to the wisdom of the crowds, more reviewers will tend to make better judgments than fewer. We make the second claim precise by looking at the Condorcet Jury Theorem as well as two related jury theorems developed specifically to apply to peer review. (shrink)

“Implicit bias” is a term of art referring to relatively unconscious and relatively automatic features of prejudiced judgment and social behavior. While psychologists in the field of “implicit social cognition” study “implicit attitudes” toward consumer products, self-esteem, food, alcohol, political values, and more, the most striking and well-known research has focused on implicit attitudes toward members of socially stigmatized groups, such as African-Americans, women, and the LGBTQ community.[1] For example, imagine Frank, who explicitly believes that women and men are equally (...) suited for careers outside the home. Despite his explicitly egalitarian belief, Frank might nevertheless implicitly associate women with the home, and this implicit association might lead him to behave in any number of biased ways, from trusting feedback from female co-workers less to hiring equally qualified men over women. Psychological research on implicit bias is relatively recent (§1), but a host of metaphysical (§2), epistemological (§3), and ethical questions (§4) about implicit bias are pressing.[2]. (shrink)

Prepublication peer review should be abolished. We consider the effects that such a change will have on the social structure of science, paying particular attention to the changed incentive structure and the likely effects on the behaviour of individual scientists. We evaluate these changes from the perspective of epistemic consequentialism. We find that where the effects of abolishing prepublication peer review can be evaluated with a reasonable level of confidence based on presently available evidence, they are either positive or neutral. (...) We conclude that on present evidence abolishing peer review weakly dominates the status quo. (shrink)

Business ethics journals have appeared on a few ranked lists that are specific to this niche discipline. As with more traditional academic disciplines, these rankings are used for academic rewards such as faculty tenure and promotion, along with department and school ratings. Journal ranking has been subject to considerable criticism even as its administrative use persists. Among the criticisms are that journal quality is a poor proxy for article quality, citation rate is an imperfect reflection of article influence, and bias (...) may be introduced into rankings by visibility characteristics such as journal age, size, circulation, and experience of the rater with a journal. This research note studies the effect of journal age and size on the rankings of business ethics journals compiled by Beets, Lewis, and Brower, by Albrecht, Thompson, Hoopes, and Rodrigo, and by Serenko and Bontis. Significant correlation was found for journal age with the administratively derived Beets et al. ranking. No significant correlation was found for size in any ranking study. Results were not significant for the Albrecht et al. and the Serenko and Bontis rankings representing the perspectives from surveys of active researchers or citation analysis. Perhaps sometimes a journal’s reputation precedes it, as perception of journal quality may be biased by journal visibility, either because it has been published and available for a number of years, or because it is well known and likely to be cited. (shrink)

It has been argued that implicit biases are operative in philosophy and lead to significant epistemic costs in the field. Philosophers working on this issue have focussed mainly on implicit gender and race biases. They have overlooked ideological bias, which targets political orientations. Psychologists have found ideological bias in their field and have argued that it has negative epistemic effects on scientific research. I relate this debate to the field of philosophy and argue that if, as some studies suggest, the (...) same bias also exists in philosophy then it will lead to hitherto unrecognised epistemic hazards in the field. Furthermore, the bias is epistemically different from the more familiar biases in respects that are important for epistemology, ethics, and metaphilosophy. (shrink)

In recent work, Mark Alfano and Jennifer Saul have put forward a similar kind of provocative sceptical challenge. Both appeal to recent literature in empirical psychology to show that our judgments across a wide range of cases are riddled with unreliable cognitive heuristics and biases. Likewise, they both conclude that we know a lot less than we have hitherto supposed, at least on standard conceptions of what knowledge involves. It is argued that even if one grants the empirical claims that (...) Saul and Alfano make, the sceptical conclusion that they canvass might not be as dramatic as it first appears. It is further argued, however, that one can reinstate a more dramatic sceptical conclusion by targeting their argument not at knowledge but rather at the distinct epistemic standing of understanding. (shrink)

This paper focuses on the distinction between methods which are mathematically "clever", and those which are simply crude, typically repetitive and computer intensive, approaches for "crunching" out answers to problems. Examples of the latter include simulated probability distributions and resampling methods in statistics, and iterative methods for solving equations or optimisation problems. Most of these methods require software support, but this is easily provided by a PC. The paper argues that the crunchier methods often have substantial advantages from the perspectives (...) of user-friendliness, reliability (in the sense that misuse is less likely), educational efficiency and realism. This means that they offer very considerable potential for simplifying the mathematical syllabus underlying many areas of applied mathematics such as management science and statistics: crunchier methods can provide the same, or greater, technical power, flexibility and insight, while requiring only a fraction of the mathematical conceptual background needed by their cleverer brethren. (shrink)

This paper summarizes recent and ongoing experimental work regarding the reality, nature, effects, and causes of the underrepresentation of women in academic philosophy. We first present empirical data on several aspects of underrepresentation, and then consider various reasons why this gender imbalance is problematic. We then turn to the published and preliminary results of empirical work aimed at identifying factors that might explain it.

Saul_Jennifer, Scepticism and Implicit Bias.

Policy disputes arise at all scales of governance: in clubs, non-profits, firms, nations, and alliances of nations. Both the means and ends of policy are disputed. While many, perhaps most, policy disputes arise from conflicting ends, important disputes also arise from differing beliefs on how to achieve shared ends. In fact, according to many experts in economics and development, governments often choose policies that are “inefficient” in the sense that most everyone could expect to gain from other feasible policies. Many (...) other kinds of experts also see existing policies as often clearly inferior to known alternatives. (shrink)

An empirically sensitive formulation of the norms of transformative criticism must recognize that even public and shared standards of evaluation can be implemented in ways that unintentionally perpetuate and reproduce forms of social bias that are epistemically detrimental. Helen Longino’s theory can explain and redress such social bias by treating peer evaluations as hypotheses based on data and by requiring a kind of perspectival diversity that bears, not on the content of the community’s knowledge claims, but on the beliefs and (...) norms of the culture of the knowledge community itself. To illustrate how socializing cognition can bias evaluations, we focus on peer-review practices, with some discussion of peer-review practices in philosophy. Data include responses to surveys by editors from general philosophy journals, as well as analyses of reviews and editorial decisions for the 2007 Cognitive Science Society Conference. (shrink)

In this essay we introduce the idea of an epistemic triangle, with factual, theoretical, and conceptual investigations at its vertices, and argue that whereas scientific progress requires a balance among the three types of investigations, psychology's epistemic triangle is stretched disproportionately in the direction of factual investigations. Expressed by a variety of different problems, this unbalance may be created by a main operative theme—the obsession of psychology with a narrow and mechanical view of the scientific method and a misguided aversion (...) to conceptual inquiries. Hence, to redress psychology's epistemic triangle, a broader and more realistic conception of method is needed and, in particular, conceptual investigations must be promoted. Using examples from different research domains, we describe the nature of conceptual investigations, relate them to theoretical investigations, and illustrate their purposes, forms, and limitations. (shrink)

This paper reviews the published empirical evidence concerning journal peer review consisting of 68 papers, all but three published since 1975. Peer review improves quality, but its use to screen papers has met with limited success. Current procedures to assure quality and fairness seem to discourage scientific advancement, especially important innovations, because findings that conflict with current beliefs are often judged to have defects. Editors can use procedures to encourage the publication of papers with innovative findings such as invited papers, (...) early-acceptance procedures, author nominations of reviewers, structured rating sheets, open peer review, results-blind review, and, in particular, electronic publication. Some journals are currently using these procedures. The basic principle behind the proposals is to change the decision from whether to publish a paper to how to publish it. (shrink)

Over the past hundred years, a number of scientific investigators claim to have adduced experimental evidence for phenomena information” seems to behave like a weak signal that has to compete for the information-processing resources of the organism, a reduction of ongoing sensorimotor activity may facilitate ESP detection. Such a meaningful convergence of results suggests that psi phenomena may represent a unitary, coherent process whose nature and compatibility with current physical theory have yet to be determined. The theoretical implications and potential (...) practical applications of psi could be significant, irrespective of the small magnitude of psi effects in laboratory settings. (shrink)

In a recent article in the British Journal for the Philosophy of Science, Heesen and Bright argue that prepublication peer review should be abolished and replaced with postpublication peer review (provided the matter is judged purely on epistemic grounds). In this article, I show that there are three problems with their argument. First, it fails to consider the epistemic cost of implementing the change to postpublication peer review. Second, it fails to consider some potential epistemic benefits of prepublication peer review, (...) which involve avoiding bias. Third, it fails to consider some potential epistemic disadvantages of postpublication peer review, which stem from the greater number of papers that would be published under that system. (shrink)

The Gendered Conference Campaign seeks to reduce the prevalence of conferences at which the keynote speakers are all male. Such conferences, according to proponents of the campaign, stereotype philosophy as male, contribute to implicit bias against women and perpetuate stereotype threat. I argue, first, that if a more diverse list of keynote speakers were the correct way to counter harms such as implicit bias and stereotype threat, then a Gendered Conference Campaign would not be the solution. The campaign would need (...) to include other groups that are the victims of implicit bias and stereotype within philosophy. Other challenges to proponents of the Gendered Conference Campaign are then presented. (shrink)

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications (...) of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to countenance the complexity of social interactions among actors involved directly and indirectly in peer review. (shrink)

A growing body of literature has identified potential problems that can compromise the quality, fairness, and integrity of journal peer review, including inadequate review, inconsistent reviewer reports, reviewer biases, and ethical transgressions by reviewers. We examine the evidence concerning these problems and discuss proposed reforms, including double-blind and open review. Regardless of the outcome of additional research or attempts at reforming the system, it is clear that editors are the linchpin of peer review, since they make decisions that have a (...) significant impact on the process and its outcome. We consider some of the steps editors should take to promote quality, fairness and integrity in different stages of the peer review process and make some recommendations for editorial conduct and decision-making. (shrink)

Peer review is a topic of considerable concern to many researchers, and there is a correspondingly large body of research on the topic. This issue of Science and Engineering Ethics presents recent work on peer review that is both grounded in empirical science and is applicable to policy decisions. This research raises two basic questions; (a) how does current peer review operate, and (b) how can it be improved? Topics addressed include descriptions of how peer review is used in Federal (...) agencies. whether peer review leads to better manuscripts, demographic characteristics of authors or reviewers (status or institutional affiliation), blinding of reviewers, authors, or results, reliability and consistency of reviews, accepting a paper before the study is done, simultaneous submission, and use of dispute resolution procedures such as scientific dialectical and pleading protocols. (shrink)