The replication crisis has prompted many to call for statistical reform within the psychological sciences. Here we examine issues within Frequentist statistics that may have led to the replication crisis, and we examine the alternative—Bayesian statistics—that many have suggested as a replacement. The Frequentist approach and the Bayesian approach offer radically different perspectives on evidence and inference with the Frequentist approach prioritising error control and the Bayesian approach offering a formal method for quantifying the relative strength of evidence for hypotheses. (...) We suggest that rather than mere statistical reform, what is needed is a better understanding of the different modes of statistical inference and a better understanding of how statistical inference relates to scientific inference. (shrink)

Based on an analysis of ten popular introductions to social psychology, we will show that Karl Popper's philosophy of ‘critical rationalism’ so far has had little to no traceable influence on the epistemology and practice of social psychology. If Popper is quoted or mentioned in the textbooks at all, the guiding principle of ‘falsificationism’ is reduced to a mere ‘falsifiability’ and some central elements of critical rationalism are left out – those that are incompatible with positivism and inductivism. Echoing earlier (...) attempts to introduce Popper to social psychology by Paul Meehl and Tom Pettigrew, we will argue that a discussing Popper's ideas in more depth could help social psychology to move forward in view of the ‘crisis of confidence’ that has emerged recently in view of the ‘Stapel affair’ and the reports of failures to replicate social psychological experiments in high-powered replication attempts. (shrink)

In this paper, I examine the challenges socially extended minds pose for mainstream, individualistic accounts of social cognition. I argue that individualistic accounts of social cognition neglect phenomena important to social cognition that are properly emphasized by socially extended mind accounts. Although I do not think the evidence or arguments warrant replacing individualistic explanations of social cognition with socially extended explanations, I argue that we have good reason to supplement our individualistic accounts so as to include the ways in which (...) situational context affects social interactions. The result, I hope, is a more sophisticated individualism that offers a more comprehensive account of how we think and act together. (shrink)

The neuroscientific investigation of sex differences has an unsavoury past, in which scientific claims reinforced and legitimated gender roles in ways that were not scientifically justified. Feminist critics have recently argued that the current use of functional neuroimaging technology in sex differences research largely follows that tradition. These charges of ‘neurosexism’ have been countered with arguments that the research being done is informative and valuable and that an over-emphasis on the perils, rather than the promise, of such research threatens to (...) hinder scientific progress. To investigate the validity of these contrasting concerns, recent functional magnetic resonance imaging (fMRI) investigations of sex differences and citation practices were systematically examined. In line with the notion of neurosexism, the research was found to support the influence of false-positive claims of sex differences in the brain, to enable the proliferation of untested, stereotype-consistent functional interpretations, and to pay insufficient attention to the potential plasticity of sex differences in both brain and mind. This, it is argued, creates a literature biased toward the presentation of sex differences in the brain as extensive, functionally significant, and fixed—and therefore implicitly supportive of a gender essentialist perspective. It is suggested that taking feminist criticisms into account would bring about substantial improvement in the quality of the science, as well as a reduction in socially harmful consequences. (shrink)

Concern about the integrity of empirical research has arisen in recent years in the light of studies showing the vast majority of publications in academic journals report positive results, many of these results are false and cannot be replicated, and many positive results are the product of data dredging and the application of flexible data analysis practices coupled with selective reporting. While a number of potential solutions have been proposed, the effects of these are poorly understood and empirical evaluation of (...) each would take many years. We propose that methods from the systems sciences be used to assess the effects, both positive and negative, of proposed solutions to the problem of declining research integrity such as study registration, Registered Reports, and open access to methods and data. In order to illustrate the potential application of systems science methods to the study of research integrity, we describe three broad types of models: one built on the characteristics of specific academic disciplines; one a diffusion of research norms model conceptualizing researchers as susceptible, “infected” and recovered; and one conceptualizing publications as a product produced by an industry comprised of academics who respond to incentives and disincentives. (shrink)

The field of psychology, including cognitive science, is vexed by a crisis of confidence. Although the causes and solutions are varied, we focus here on a common logical problem in inference. The default mode of inference is significance testing, which has a free lunch property where researchers need not make detailed assumptions about the alternative to test the null hypothesis. We present the argument that there is no free lunch; that is, valid testing requires that researchers test the null against (...) a well-specified alternative. We show how this requirement follows from the basic tenets of conventional and Bayesian probability. Moreover, we show in both the conventional and Bayesian framework that not specifying the alternative may lead to rejections of the null hypothesis with scant evidence. We review both frequentist and Bayesian approaches to specifying alternatives, and we show how such specifications improve inference. The field of cognitive science will benefit because consideration of reasonable alternatives will undoubtedly sharpen the intellectual underpinnings of research. (shrink)

In recent years, the publication of the studies on the transmissibility in mammals of the H5N1 influenza virus and synthetic genomes has triggered heated and concerned debate within the community of scientists on biological dual-use research; these papers have raised the awareness that, in some cases, fundamental research could be directed to harmful experiments, with the purpose of developing a weapon that could be used by a bioterrorist. Here is presented an overview regarding the dual-use concept and its related international (...) agreements which underlines the work of the Australia Group Export Control Regime. It is hoped that the principles and activities of the AG, that focuses on export control of chemical and biological dual-use materials, will spread and become well known to academic researchers in different countries, as they exchange biological materials and scientific papers. To this extent, and with the aim of drawing the attention of the scientific community that works with yeast to the so called Dual-Use Research of Concern, this article reports case studies on biological dual-use research and discusses a synthetic biology applied to the yeast Saccharomyces cerevisiae, namely the construction of the first eukaryotic synthetic chromosome of yeast and the use of yeast cells as a factory to produce opiates. Since this organism is considered harmless and is not included in any list of biological agents, yeast researchers should take simple actions in the future to avoid the sharing of strains and advanced technology with suspicious individuals. (shrink)