The origins of testing scientific models with statistical techniques go back to 18th century mathematics. However, the modern theory of statistical testing was primarily developed through the work of Sir R.A. Fisher, Jerzy Neyman, and Egon Pearson in the inter-war period. Some of Fisher's papers on testing were published in economics journals (Fisher, 1923, 1935) and exerted a notable influence on the discipline. The development of econometrics and the rise of quantitative economic models in the mid-20th century made statistical significance (...) testing a commonplace, albeit controversial tool within economics. -/- In the debate about significance testing, methodological controversies intertwine with epistemological issues and sociological developments. Our aim in this chapter is to expound these connections and to show how the use of, and the debate about, significance testing in economics differs from other social sciences, such as psychology. (shrink)

Our commentators explore the operation of grounded procedures across all levels of analysis in the behavioral sciences, from mental to social, developmental, and evolutionary/functional. Building on them, we offer two integrative principles for systematic effects of grounded procedures to occur. We discuss theoretical topics at each level of analysis, address methodological recommendations, and highlight further extensions of grounded procedures.

Experience-dependent neural plasticity is high in the developing brain, presenting a unique window of opportunity for training. To optimize existing training programs and develop new interventions, it is important to understand what processes take place in the developing brain during training. Here, we systematically review MRI-based evidence of training-induced neural plasticity in children and adolescents. A total of 71 articles were included in the review. Significant changes in brain activation, structure, microstructure, and structural and functional connectivity were reported with different (...) types of trainings in the majority of the studies. Significant correlation of performance improvement with neural changes was reported in 51% of the studies. Yet, only 48% of the studies had a control condition. Overall, the review supports the hypothesized neural changes with training while at the same time charting empirical and methodological desiderata for future research. (shrink)

The finding that intuitions about the reference of proper names vary cross-culturally was one of the early milestones in experimental philosophy. Many follow-up studies investigated the scope and magnitude of such cross-cultural effects, but our paper provides the first systematic meta-analysis of studies replicating. In the light of our results, we assess the existence and significance of cross-cultural effects for intuitions about the reference of proper names.

In this article, we analyse the evidential value of the corpus of experimental philosophy. While experimental philosophers claim that their studies provide insight into philosophical problems, some philosophers and psychologists have expressed concerns that the findings from these studies lack evidential value. Barriers to evidential value include selection bias and p-hacking. To find out whether the significant findings in x-phi papers result from selection bias or p-hacking, we applied a p-curve analysis to a corpus of 365 x-phi chapters and articles. (...) Our results suggest that this corpus has evidential value, although there are hints of p-hacking in a few parts of the x-phi corpus. (shrink)

Dual-process theories of higher order cognition (DPTs) have been enjoying much success, particularly since Kahneman’s 2002 Nobel prize address and recent book Thinking, Fast and Slow (2009). Historically, DPTs have attempted to provide a conceptual framework that helps classify and predict differences in patterns of behavior found under some circumstances and not others in a host of reasoning, judgment, and decision-making tasks. As evidence has changed and techniques for examining behavior have moved on, so too have DPTs. Killing two birds (...) with one stone, Evans and Stanovich (2013, this issue) respond to five main criticisms of DPTs. Along with addressing each criticism in turn, they set out to clarify the essential defining characteristics that distinguish one form of higher order cognition from the other. The aim of this commentary is to consider the defining characteristics of Type 1 and Type 2 processing that have been proposed and to suggest that the evidence can be taken to support quantitative differences rather than qualitatively distinct processes. (shrink)

Data which constitute satisfactory evidence in other contexts are sometimes not treated as valid evidence in the context of scientic conrmation. I give a justicatory explanation of this fact, appealing to the incentives, biases, and social situatedness of scientists.

Attachment theory ( Bowlby, 1969/1982 ) posits the existence of internal working models as a foundational feature of human bonds. Radical embodied approaches instead suggest that cognition requires no computation or representation, favoring a cognition situated in a body in an environmental context with affordances for action ( Chemero, 2009 ; Barrett, 2011 ; Wilson and Golonka, 2013 ; Casasanto and Lupyan, 2015 ). We explore whether embodied approaches to social soothing, interpersonal warmth, separation distress, and support seeking could replace (...) representational constructs such as internal working models with a view of relationship cognition anchored in the resources afforded to the individual by their brain, body, and environment in interaction. We review the neurobiological bases for social attachments and relationships and attempt to delineate how these systems overlap or don’t with more basic physiological systems in ways that support or contradict a radical embodied explanation. We suggest that many effects might be the result of the fact that relationship cognition depends on and emerges out of the action of neural systems that regulate several clearly physically grounded systems. For example, the neuropeptide oxytocin appears to be central to attachment and pair-bond behavior ( Carter and Keverne, 2002 ) and is implicated in social thermoregulation more broadly, being necessary for maintaining a warm body temperature (for a review, see IJzerman et al., 2015b ). Finally, we discuss the most challenging issues around taking a radically embodied perspective on social relationships. We find the most crucial challenge in individual differences in support seeking and responses to social contact, which have long been thought to be a function of representational structures in the mind (e.g., Baldwin, 1995 ). Together we entertain the thought to explain such individual differences without mediating representations or computations, but in the end propose a hybrid model of radical embodiment and internal representations. (shrink)

No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors (...) allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors. (shrink)

In recent years, several scientific disciplines have been undergoing replication crises, and in response, preregistration has been offered as a solution to replicability problems. In this paper, I will draw connections between this new focus on preregistration and an older debate in the philosophy of science, namely predictivism—the thesis that predictions are epistemically superior to accommodations. Specifically, I shall argue that predictivism justifies preregistration. As it turns out, predictivists of all stripes have subtly different reasons to support preregistration. This unity (...) is significant because firstly, preregistration proponents often seem to be implicitly committed to stronger versions of predictivism, but strong predictivism has long been deemed untenable by philosophers of science. Furthermore, the efficacy of preregistration in dealing with Questionable Research Practices (QRPs) like p-hacking and HARKing is at best contentious, which blocks a straightforward empirical justification of preregistration. Although empirical validation of preregistration—which need not be based on preventing QRPs—will eventually be required, it would be nice to have a principled justification for preregistration while we await the empirical evidence. I will also argue that preregistration offers something in return to predictivism: the former bolsters the latter by serving as a counterargument to accommodationism—the antithesis of predictivism. (shrink)

We argue that the trend toward providing users with feasible and actionable explanations of AI decisions—known as recourse explanations—comes with ethical downsides. Specifically, we argue that recourse explanations face several conceptual pitfalls and can lead to problematic explanation hacking, which undermines their ethical status. As an alternative, we advocate that explanations of AI decisions should aim at understanding.

Replicability is widely taken to ground the epistemic authority of science. However, in recent years, important published findings in the social, behavioral, and biomedical sciences have failed to replicate, suggesting that these fields are facing a “replicability crisis.” For philosophers, the crisis should not be taken as bad news but as an opportunity to do work on several fronts, including conceptual analysis, history and philosophy of science, research ethics, and social epistemology. This article introduces philosophers to these discussions. First, I (...) discuss precedents and evidence for the crisis. Second, I discuss methodological, statistical, and social-structural factors that have contributed to the crisis. Third, I focus on the philosophical issues raised by the crisis. Finally, I discuss proposed solutions and highlight the gaps that philosophers could focus on. (shrink)

This paper defends a desire-based understanding of pleasurable and unpleasant experiences. More specifically, the thesis is that what makes an experience pleasant/unpleasant is the subject having a certain kind of desire about that experience. I begin by introducing the ‘Desire Account’ in more detail, and then go on to explain and refute a prominent set of contemporary counter-examples, based on subjects who might have ‘Reflective Blindness’, looking particularly at the example of subjects with depression. I aim to make the Desire (...) Account more persuasive, but also to clear up more widespread misunderstandings about depression in metaethics. For example, mistakes that are made by conflating two of depression’s most prominent symptoms: depressed mood and anhedonia. (shrink)

. Scientists, for the most part, want to get it right. However, the social structures that govern their work undermine that aim, and this leads to nonreplicable findings in many fields. Because the social structure of science is a decentralized system, it is difficult to intervene. In this article, I discuss how we might do so, focusing on self-corrective-labor schemes. First, I argue that we need to implement a scheme that makes replication work outcome independent, systematic, and sustainable. Second, I (...) use these three criteria to evaluate extant proposals, which place the responsibility for replication on original researchers, consumers of their research, students, or many labs. Third, on the basis of a philosophical analysis of the reward system of science and the benefits of the division of cognitive labor, I propose a scheme that satisfies the criteria better: the professional scheme. This scheme has two main components. First, the scientific community is organized into two groups: discovery researchers, who produce new findings, and confirmation researchers, whose primary function is to do confirmation work. Second, a distinct reward system is established for confirmation researchers so that their career advancement is separated from whether they obtain positive experimental results. (shrink)

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Compared to human-operated vehicles, autonomous vehicles offer numerous potential benefits. However, public acceptance of AVs remains low. Using 4 studies, including 1 preregistered experiment, the present research examines the role of trust in AV adoption decisions. Using the Trust-Confidence-Cooperation model as a conceptual framework, we evaluate whether perceived integrity of technology—a previously underexplored dimension of trust that refers to perceptions of the moral agency of a given technology—influences AV policy support and adoption intent. We find that perceived technology integrity predicts (...) adoption intent for AVs and that messages that increase perceived integrity of AV technology result in greater AV adoption intent and policy support. This knowledge can be used to guide communication efforts aimed at increasing public trust in AVs, and ultimately enhance integration of AVs into transport systems. (shrink)

We conducted an integrative data analysis to examine the hedonic character of nostalgia. We combined positive and negative affect measures from 41 experiments manipulating nostalgia. Overall, nostalgia inductions increased positive and ambivalent affect, but did not significantly alter negative affect. The magnitude of nostalgia’s effects varied markedly across different experimental inductions of the emotion. The hedonic character of nostalgia, then, depends on how the emotion is elicited and the benchmark to which it is compared. We discuss implications for theory and (...) research on nostalgia and emotions in general. (shrink)

Appendix 1 was incomplete in the initial online publication. The original article has been corrected.

Support from grandparents plays a role in mothers’ perinatal mental health. However, previous research on maternal mental health has mainly focused on influences of partner support or general social support and neglected the roles of grandparents. In this narrative review and meta-analysis, the scientific evidence on the association between grandparental support and maternal perinatal mental health is reviewed. Searches in PubMed, EMBASE, MEDLINE, Scopus, and PsycINFO yielded 11 empirical studies on N = 3381 participants, reporting on 35 effect sizes. A (...) multilevel approach to meta-analysis was applied to test the association between grandparental support and maternal mental health. The results showed a small, statistically significant association (r =.16; 95% CI: 0.09–0.25). A moderator test indicated that the association was stronger for studies reporting on support from the maternal grandmother in particular (r =.23; 95% CI: 0.06–0.29). Our findings suggest that involved grandparents, in particular mother’s own mother, constitute a protective factor for the development of maternal postpartum mental health problems. These findings have clear implications for interventions. Future studies should examine whether stimulating high-quality support from grandparents is a fruitful avenue for enhancing maternal postpartum mental health. (shrink)

A common finding in the study of emotion and decision making is the tendency for fear and anxiety to decrease risk taking. The current meta-analysis summarises the strength and variability of this...

Research on social exclusion suggests an increased attention of excluded persons to subtle social cues. In one study (N= 32), published inPsychological Science,Bernstein et al. (2008)provided evidence for this idea by showing that participants in the social exclusion condition were better in correctly categorizing a target person’s smile as real or fake. Although highly cited, this finding has never been directly replicated. The present study aimed to fill that gap. 201 participants (79.1% female) were randomly assigned to a social exclusion, (...) social inclusion or control condition. Next, participants watched 20 videos of smiling persons and rated whether they show a real or a fake smile. In line with the original study, results showed that participants in the exclusion condition performed better than in the control condition. However, the performance did not differ between the exclusion and inclusion condition—although the pattern was in the predicted direction. In sum, the findings of our study increase rather than decrease confidence in the validity of the investigated idea, but results point to a substantially smaller effect. (shrink)

ABSTRACTDespite the extensive literature on what questionable research practices are and how to measure them, the normative underpinnings of such practices have remained less explored. QRPs often fall into a grey area of justifiable and unjustifiable practices. Where to precisely draw the line between such practices challenges individual scholars and this harms science. We investigate QRPs from a normative perspective using the theory of communicative action. We highlight the role of the collective in assessing individual behaviours. Our contribution is a (...) framework that allows identification of when particular actions cross over from acceptable to unacceptable practice. Thus, this article provides grounds for developing scientific standards to raise the quality of scientific research. (shrink)

Wood, Kressel, Joshi, and Louie (2014) meta-analyzed studies examining changes in women’s mate preferences as a function of cycle phase, and claimed to find little evidence for shifts, contrary to Gildersleeve, Haselton, and Fales’s (2014a) meta-analysis. This commentary concerns specific speculations Wood et al. made about particular researchers analyzing data multiple ways, capitalizing on chance and thereby inflating the Type I error rate. In so doing, Wood et al. misconstrued a key article explaining the high fertility period, misrepresented studies, and (...) presented no supportive evidence. The corrosive effects of inappropriate research practices on scientific literatures are concerning. So too are unsubstantiated speculations of them. (shrink)

The pattern of data underlying the successful replications of cleansing effects is improbable and most consistent with selective reporting. Moreover, the meta-analytic approach presented by Lee and Schwarz is likely to find an effect even if none existed. Absent more robust evidence, there is no need to develop a theoretical account of grounded procedures.