Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and (...) material questions in research, and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

Replicability and reproducibility of computational models has been somewhat understudied by “the replication movement.” In this paper, we draw on methodological studies into the replicability of psychological experiments and on the mechanistic account of explanation to analyze the functions of model replications and model reproductions in computational neuroscience. We contend that model replicability, or independent researchers' ability to obtain the same output using original code and data, and model reproducibility, or independent researchers' ability to recreate a model without original (...) code, serve different functions and fail for different reasons. This means that measures designed to improve model replicability may not enhance (and, in some cases, may actually damage) model reproducibility. We claim that although both are undesirable, low model reproducibility poses more of a threat to long-term scientific progress than low model replicability. In our opinion, low model reproducibility stems mostly from authors' omitting to provide crucial information in scientific papers and we stress that sharing all computer code and data is not a solution. Reports of computational studies should remain selective and include all and only relevant bits of code. (shrink)

According to a once influential view of selection, it consists of repeated cycles of replication and interaction. It has been argued that this view is wrong: replication is not necessary for evolution by natural selection. I analyze the nine most influential arguments for this claim and defend the replication–interaction conception of selection against these objections. In order to do so, however, the replication–interaction conception of selection needs to be modified significantly. My proposal is that replication (...) is not the copying of an entity, the replicator, but the copying of a property. Thus, we can have a replication process without there being a replicator that is being copied. (shrink)

Popper’s (1983, 2002) philosophy of science has enjoyed something of a renaissance in the wake of the replication crisis, offering a philosophical basis for the ensuing science reform movement. However, adherence to Popper’s approach may also be at least partly responsible for the sense of “crisis” that has developed following multiple unexpected replication failures. In this article, I contrast Popper’s approach with Lakatos’ (1978) approach and a related approach called naïve methodological falsificationism (NMF; Lakatos, 1978). The Popperian approach (...) is powerful because it is based on logical refutation, but its theories are noncausal and, therefore, lacking in scientific value. In contrast, the Lakatosian approach considers causal theories, but it concedes that these theories are not logically refutable. Finally, the NMF approach subjects Lakatosian causal theories to Popperian logical refutations. However, its approach of temporarily accepting a ceteris paribus clause during theory testing may be viewed as scientifically inappropriate, epistemically inconsistent, and “completely redundant” (Lakatos, 1978, p. 40). I conclude that the replication “crisis” makes the most sense in the context of the Popperian and NMF approaches because it is only in these two approaches that replication failures represent logical refutations of theories. In contrast, replication failures are less problematic in the Lakatosian approach because they do not logically refute theories. Indeed, in the Lakatosian approach, replication failures can be legitimately ignored or used to motivate theory development. (shrink)

This special issue on what some regard as a crisis of replicability in cognitive science (i.e. the observation that a worryingly large proportion of experimental results across a number of areas cannot be reliably replicated) is informed by three recent developments. -/- First, philosophers of mind and cognitive science rely increasingly on empirical research, mainly in the psychological sciences, to back up their claims. This trend has been noticeable since the 1960s (see Knobe, 2015). This development has allowed philosophers to (...) draw on a wider range of relevant resources, but it also makes them vulnerable to relying on claims that may not survive further scrutiny. If we have reasons to believe that a large proportion of findings in the psychological sciences cannot be reliably replicated, this would be a problem for philosophers who use such findings in their work. Second, philosophers are increasingly designing and carrying out their own experiments to back up claims, or to test claims earlier made from the armchair, for example, on the perceived permissibility of diverting trolleys or on the nature of free will. This growing field of experimental philosophy has diversified the intellectual field in philosophy, but may also be vulnerable to issues of replicability that philosophers did not face before. -/- Third, the recent evidence of apparently widespread non-replicability in the social sciences (and other fields) has forced philosophers of science to grapple with long standing questions from their field from a new perspective. To what extent does replicability matter for theory construction? How do the notions of replicability and scientific progress interact? How can normative insights from philosophy of science be used in order to improve scientific practice? -/- It is with these three developments in mind—the increasing importance of empirically-informed philosophy, of experimental philosophy, and of philosophy of science around replicability—that this special issue has been conceived. (shrink)

The reward system of science is the priority rule. The first scientist making a new discovery is rewarded with prestige, while second runners get little or nothing. Michael Strevens, following Philip Kitcher, defends this reward system, arguing that it incentivizes an efficient division of cognitive labor. I argue that this assessment depends on strong implicit assumptions about the replicability of findings. I question these assumptions on the basis of metascientific evidence and argue that the priority rule systematically discourages replication. (...) My analysis leads us to qualify Kitcher and Strevens’s contention that a priority-based reward system is normatively desirable for science. (shrink)

Philosophers of science and metascientists alike typically model scientists’ behavior as driven by credit maximization. In this article I argue that this modeling assumption cannot account for how scientists have a default level of trust in each other’s assertions. The normative implication of this is that science policy should not focus solely on incentive reform.

In this paper, I articulate an argument for incompatibilism about moral responsibility and determinism. My argument comes in the form of an extended story, modeled loosely on Peter van Inwagen’s “rollback argument” scenario. I thus call it “the replication argument.” As I aim to bring out, though the argument is inspired by so-called “manipulation” and “original design” arguments, the argument is not a version of either such argument—and plausibly has advantages over both. The result, I believe, is a more (...) convincing incompatibilist argument than those we have considered previously. (shrink)

The replication crisis (also called the replicability crisis and the reproducibility crisis) is an ongoing methodological crisis in which the results of many scientific studies are difficult or impossible to reproduce.

The Value-free ideal of science (VFI) is a view that claims that scientists should not use non-epistemic values when they are justifying their hypotheses, and is widely considered to be obsolete in the philosophy of science. I will defend the ideal by demonstrating that acceptance of non-epistemic values, prohibited by VFI, necessitates legitimizing certain problematic scientific practices. Such practices, including biased methodological decisions or Questionable Research Practices (QRP), significantly contribute to the Replication Crisis. I will argue that the realizability (...) of VFI is not a necessary condition for its validity. Then, I will show how some of the prominent proposals of value-laden science legitimize problematic scientific practices, provide real-world examples, and generalize the argument. Finally, I will show how value-laden methodological decisions contribute to the Replicability Crisis and discuss two strategies for realizing VFI. (shrink)

The aim of this paper is to argue that cultural evolution is in many ways much more similar to microbial than to macrobial biological evolution. As a result, we are better off using microbial evolution as the model of cultural evolution. And this shift from macrobial to microbial entails adjusting the theoretical models we can use for explaining cultural evolution.

Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we reassess the value of replicability from an epistemic perspective. We defend the orthodox view, according to which replications are always epistemically useful, against the more prudent view that claims that it (...) is useful in very limited circumstances. Additionally, we argue that we can learn more about the original experiment and the limits of the discovered effect from replications at different levels. We hold that replicability is a crucial feature of experimental results and scientists should continue to strive to secure it. (shrink)

I suggest that the recent, highly visible, and often heated debate over failures to replicate the results in the social sciences reveals more than the need for greater attention to the pragmatics and value of empirical falsification. It also is a symptom of a serious issue -- the underdeveloped state of theory in many areas of psychology. While I focus on the phenomenon of “social priming” -- since it figures centrally in current debate -- it is not the only area (...) of psychological inquiry to which my critique applies. I first discuss some of the key issues in the “social priming” debate and then attempt to show that many of the problems thus far identified are traceable to a lack of specificity of theory. Finally, I hint at the possibility that adherence to the materialist tenets of modern psychological theory may have a limiting effect on our full appreciation of the phenomena under scrutiny. (shrink)

In recent debates about the replication crisis, two positions have been dominant: one that focuses on methodological reforms and one that focuses on theory building. This paper takes up the suggestion that there might be a deeper difference in play, concerning the ways the very subject matter of psychology is construed by opposing camps, i.e., in terms of stable effects versus in terms of complexity. I argue that each gets something right, but neither is sufficient. My analysis suggests that (...) the context sensitivity of the psychological subject matter needs to be front and center of methodological and theoretical efforts. (shrink)

The replication crisis has caused researchers to distinguish between exact replications, which duplicate all aspects of a study that could potentially affect the results, and direct replications, which duplicate only those aspects of the study that are thought to be theoretically essential to reproduce the original effect. The replication crisis has also prompted researchers to think more carefully about the possibility of making Type I errors when rejecting null hypotheses. In this context, the present article considers the utility (...) of two types of Type I error probability: the Neyman–Pearson long run Type I error rate and the Fisherian sample-specific Type I error probability. It is argued that the Neyman–Pearson Type I error rate is inapplicable in social science because it refers to a long run of exact replications, and social science deals with irreversible units that make exact replications impossible. Instead, the Fisherian sample-specific Type I error probability is recommended as a more meaningful way to conceptualize false positive results in social science because it can be applied to each sample-specific decision about rejecting the same substantive null hypothesis in a series of direct replications. It is concluded that the replication crisis may be partly due to researchers’ unrealistic expectations about replicability based on their consideration of the Neyman–Pearson Type I error rate across a long run of exact replications. (shrink)

In evolutionary biology and ecology, ontological and epistemological perspectives based on the replicator and the interactor have become the background that makes it possible to transcend traditional biological levels of organization and to achieve a unified view of evolution in which replication and interaction are fundamental operating processes. Using the transactional perspective proposed originally by John Dewey and Arthur Fisher Bentley, a new ontological and methodological category is proposed here: the transactor. The transactional perspective, based on the concept of (...) the transactor, bridges the dichotomy between organisms and environment that characterizes the interactional perspective on evolution and provides epistemological support for the emergentist, systemic view of evolutionary and developmental processes. (shrink)

In “Normativity and Epistemic Intuitions”, Weinberg, Nichols and Stich famously argue from empirical data that East Asians and Westerners have different intuitions about Gettier -style cases. We attempted to replicate their study about the Car case, but failed to detect a cross - cultural difference. Our study used the same methods and case taken verbatim, but sampled an East Asian population 2.5 times greater than NEI’s 23 participants. We found no evidence supporting the existence of cross - cultural difference about (...) the intuition concerning the Gettier car case. Taken together with the failures of both of the existing replication studies, our results provide strong evidence that the purported cross - cultural difference in Gettier intuitions does not exist. (shrink)

The replication crisis has prompted many to call for statistical reform within the psychological sciences. Here we examine issues within Frequentist statistics that may have led to the replication crisis, and we examine the alternative—Bayesian statistics—that many have suggested as a replacement. The Frequentist approach and the Bayesian approach offer radically different perspectives on evidence and inference with the Frequentist approach prioritising error control and the Bayesian approach offering a formal method for quantifying the relative strength of evidence (...) for hypotheses. We suggest that rather than mere statistical reform, what is needed is a better understanding of the different modes of statistical inference and a better understanding of how statistical inference relates to scientific inference. (shrink)

Genes are thought to have evolved from long-lived and multiply-interactive molecules in the early stages of the origins of life. However, at that stage there were no replicators, and the distinction between interactors and replicators did not yet apply. Nevertheless, the process of evolution that proceeded from initial autocatalytic hypercycles to full organisms was a Darwinian process of selection of favourable variants. We distinguish therefore between Neo-Darwinian evolution and the related Weismannian and Central Dogma divisions, on the one hand, and (...) the more generic category of Darwinian evolution on the other. We argue that Hull’s and Dawkins’ replicator/interactor distinction of entities is a sufficient, but not necessary, condition for Darwinian evolution to take place. We conceive the origin of genes as a separation between different types of molecules in a thermodynamic state space, and employ a notion of reproducers. (shrink)

The commentaries provided by Haig; Derksen and Morawski; and Trafimow vary considerably in how they address critical realism and its implications for replication. Haig’s preference for Kaidesoja’s “naturalised” version of critical realism and Lipton’s inference to the best explanation is deeply problematic. While Derksen and Morawski concede that they deal only indirectly with critical realism, their endorsement of “performativity” negates it. In Trafimow’s case, ontology’s regulative role is untenably diminished and ultimately supplanted by classic methodologism. I conclude that (...) class='Hi'>replication should be replaced by exploratory stratified contextualism. (shrink)

The recent so-called crisis of replication continues to dominate psychology’s methodological landscape. It is argued here that the apparent renaissance of Popperian thinking that characterises some of the key responses to the crisis of replication is fundamentally flawed. In essence, there is a serious lack of any sustained and rigorous treatment of ontology that underpins much of the current debate about replication and Popper’s falsificationist approach. The overriding problem is that the replication debate reflects the methodologist (...) tendency for mainstream psychologists to avoid or gloss over crucial ontological questions. In contradistinction, this article (a) underscores the primacy of ontology; (b) delineates and applies a critical realist stratified ontology to psychology; (c) utilises the latter as a springboard from which to argue for Popper’s methodological “retirement”; and (d) revindicates the indispensability of context and the subtlety of psychological phenomena in arguing for the intrinsic limits of replication and experimentalism in general. (shrink)

Darwinian evolutionary theory has two key terms, variations and biological selection, which finally lead to survival of the fittest variant. With the rise of molecular genetics, variations were explained as results of error replications out of the genetic master templates. For more than half a century, it has been accepted that new genetic information is mostly derived from random error-based events. But the error replication narrative has problems explaining the sudden emergence of new species, new phenotypic traits, and genome (...) innovations as a sudden single event. Meanwhile, it is recognized that errors cannot explain the evolution of genetic information, genetic novelty, and complexity. Now, empirical evidence establishes the crucial role of non-random genetic content editors, such as viruses, diversity generating retroelements, and other RNA networks, to produce new genetic information, complex regulatory control, inheritance vectors, genetic identity, immunity, new sequence space, evolution of complex organisms, and evolutionary transitions. (shrink)

Absorb or replicate em terms of social relacions and even intercourse? Reflect, with reflection, it may be silly, but it works, on several levels of human experience.

The replicability of a research claim is often positioned as an important step in establishing the credibility of scientific research. This expectation persists despite ongoing disagreements over how to characterise replication practices in various contexts. Rather than attempt to explain or resolve these disagreements, we propose that there is value in exploring the variable uses of the replicability concept. To this end, we treat the replicability concept as a goal-directed tool for studying scientific practices. This approach extends scholarship on (...) the goal-directed uses of concepts within investigative practices to explore the value of reflexively interrogating those concepts used to study the sciences as practiced. In doing so, we highlight the importance of considering how and when a given concept is an appropriate tool for a given goal when studying scientific practices. For instance, in the case of the replicability concept, our examination suggests that there is value in clarifying how a given characterisation of replicability is appropriate to a given context-specific analytic and/or evaluative goal. In addition, we hope to draw attention to how Metaresearch and HPS contexts provide complementary insights for those seeking to understand when and how replication practices can help in assessing a given research claim. (shrink)

In one of the earlier influential papers in the field of experimental philosophy titled Normativity and Epistemic Intuitions published in 2001, Jonathan M. Weinberg, Shaun Nichols and Stephen Stich reported that respondents answered Gettier type questions differently depending on their ethnic background as well as socioeconomic status. There is currently a debate going on, on the significance of the results of Weinberg et al. (2001) and its implications for philosophical methodology in general and epistemology in specific. Despite the debates, however, (...) to our knowledge, there has not been a replication attempt of the experiments of the original paper. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes and hence greater power to detect differences, we failed to detect significant differences between the above-mentioned ethnic and socioeconomic groups. Our results suggest that epistemic intuitions are more robust across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups that follows from Weinberg et al. (2001) needs to be corrected. (shrink)

Grau and Pury (Review of Philosophy and Psychology, 5, 155–168, 2014) reported that people’s views about love are related to their views about reference. This surprising effect was however not replicated in Cova et al.’s (in press) replication study. In this article, we show that the replication failure is probably due to the replication’s low power and that a metaanalytic reanalysis of the result in Cova et al. suggests that the effect reported in Grau and Pury is (...) real. We then report a large, highly powered replication that successfully replicates Grau and Pury 2014. This successful replication is a case study in the challenges involved in replicating scientific work, and our article contributes to the discussion of these challenges. (shrink)

Two goals - improving replicability and accountability of Machine Learning research respectively, have accrued much attention from the AI ethics and the Machine Learning community. Despite sharing the measures of improving transparency, the two goals are discussed in different registers - replicability registers with scientific reasoning whereas accountability registers with ethical reasoning. Given the existing challenge of the Responsibility Gap - holding Machine Learning scientists accountable for Machine Learning harms due to them being far from sites of application, this paper (...) posits that reconceptualizing replicability can help bridge the gap. Through a shift from model performance replicability to claim replicability, Machine Learning scientists can be held accountable for producing non-replicable claims that are prone to eliciting harm due to misuse and misinterpretation. In this paper, I make the following contributions. First, I define and distinguish two forms of replicability for ML research that can aid constructive conversations around replicability. Second, I formulate an argument for claim-replicability's advantage over model performance replicability in justifying assigning accountability to Machine Learning scientists for producing non-replicable claims and show how it enacts a sense of responsibility that is actionable. In addition, I characterize the implementation of claim replicability as more of a social project than a technical one by discussing its competing epistemological principles, practical implications on Circulating Reference, Interpretative Labor, and research communication. (shrink)

In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors claim, are more in line with traditionally accepted solutions of classical problems. This inherent bias, so the argument goes, is one of the factors that leads more men than women to pursue degrees and careers in philosophy. These findings have received a considerable amount of attention and the (...) paper is to appear in the second edition of Experimental Philosophy edited by Knobe and Nichols , which itself is an influential outlet. Given the exposure of these results, we attempted to replicate three of the classes of questions that Buckwalter and Stich review in their paper and for which they report significant differences. We failed to replicate the results using several different sources for data collection (one being identical to the original procedures.. (shrink)

Understanding community-level selection using Lewontin’s criteria requires both community-level inheritance and community-level heritability, and in the discipline of community and ecosystem genetics, these are often conflated. While there are existing studies that show the possibility of both, these studies impose community-level inheritance as a product of the experimental design. For this reason, these experiments provide only weak support for the existence of community-level selection in nature. By contrast, treating communities as interactors (in line with Hull’s replicator-interactor framework or Dawkins’s idea (...) of the “extended phenotype”) provides a more plausible and empirically supportable model for the role of ecological communities in the evolutionary process. (shrink)

Norm theory (Kahneman & Miller, 1986) described a tendency for people to associate stronger regret with a negative outcome when it is a result of an exception (abnormal behavior) compared to when it is a result of routine (normal behavior). In two pre-registered studies, we conducted a replication and extension of three classic experiments on past behavior exception/routine contrasts (N = 684). We successfully replicated Kahneman and Miller’s (1986) experiments with the classic hitchhiker-scenario (Part 1) and car accident-scenario (Part (...) 2). In both cases, participants examined negative outcomes and tended to indicate a protagonist who deviated from own past behavior as more regretful than another who followed routine. Pre-registered extensions also showed effects for ratings of social norms, negative affect, and perceived luck. We did not find support for the Miller and McFarland (1986) experiment robbery scenario (Part 3) using a compensation measure, in that compensation to a victim of a robbery was not significantly different comparing exceptional and routine circumstances. However, a pre-registered extension showed that robbery under exceptional circumstances was regretted more than robbery under routine circumstances. We discuss implications for current and future research. (shrink)

Mindreading is the ability to attribute mental states to other individuals. According to the simulation theory (ST), mindreading is based on the ability the mind has of replicating others' mental states and processes. Mirror neurons (MNs) are a class of neurons that fire both when an agent performs a goal-directed action and when she observes the same type of action performed by another individual. Since MNs appear to form a replicative mechanism in which a portion of the observer's brain replicates (...) the agent's brain, MNs have been considered evidence in favor of ST. Jacob (2008), however, has maintained that the recent discovery of so-called logically related MNs refutes the hypothesis that MNs form a replicative mechanism. In this paper, I argue that, contrary to what is claimed by Jacob, one can accept the existence of logically related MNs and, at the same time, still maintain that the activity of MNs is replicative. It follows that MNs still support ST. (shrink)

While the term “reactivity” has come to be associated with specific phenomena in the social sciences, having to do with subjects’ awareness of being studied, this paper takes a broader stance on this concept. I argue that reactivity is a ubiquitous feature of the psychological subject matter and that this fact is a precondition of experimental research, while also posing potential problems for the experimenter. The latter are connected to the worry about distorted data and experimental artifacts. But what are (...) experimental artifacts and what is the most productive way of dealing with them? In this paper, I approach these questions by exploring the ways in which experimenters in psychology simultaneously exploit and suppress the reactivity of their subject matter in order to produce experimental data that speak to the question or subject matter at hand. Highlighting the artificiality of experimental data, I raise the question of what distinguishes a genuine experimental result from an experimental artifact. My analysis construes experimental results as the outcomes of inferences from the data that take material background assumptions as auxiliary premises. Artifacts occur when one or more of these background assumptions are false, such that the data do not reliably serve the purposes they were generated for. I conclude by laying out the ways in which my analysis of data quality is relevant to, and informed by, recent debates about the replicability of experimental results. (shrink)

A key source of support for the view that challenging people’s beliefs about free will may undermine moral behavior is two classic studies by Vohs and Schooler (2008). These authors reported that exposure to certain prompts suggesting that free will is an illusion increased cheating behavior. In the present paper, we report several attempts to replicate this influential and widely cited work. Over a series of five studies (sample sizes of N = 162, N = 283, N = 268, N (...) = 804, N = 982) (four preregistered) we tested the relationship between (1) anti-free-will prompts and free will beliefs and (2) free will beliefs and immoral behavior. Our primary task was to closely replicate the findings from Vohs and Schooler (2008) using the same or highly similar manipulations and measurements as the ones used in their original studies. Our efforts were largely unsuccessful. We suggest that manipulating free will beliefs in a robust way is more difficult than has been implied by prior work, and that the proposed link with immoral behavior may not be as consistent as previous work suggests. (shrink)

The inflation of Type I error rates is thought to be one of the causes of the replication crisis. Questionable research practices such as p-hacking are thought to inflate Type I error rates above their nominal level, leading to unexpectedly high levels of false positives in the literature and, consequently, unexpectedly low replication rates. In this article, I offer an alternative view. I argue that questionable and other research practices do not usually inflate relevant Type I error rates. (...) I begin by introducing the concept of Type I error rates and distinguishing between statistical errors and theoretical errors. I then illustrate my argument with respect to model misspecification, multiple testing, selective inference, forking paths, exploratory analyses, p-hacking, optional stopping, double dipping, and HARKing. In each case, I demonstrate that relevant Type I error rates are not usually inflated above their nominal level, and in the rare cases that they are, the inflation is easily identified and resolved. I conclude that the replication crisis may be explained, at least in part, by researchers’ misinterpretation of statistical errors and their underestimation of theoretical errors. (shrink)

Many scientists routinely generalize from study samples to larger populations. It is commonly assumed that this cognitive process of scientific induction is a voluntary inference in which researchers assess the generalizability of their data and then draw conclusions accordingly. We challenge this view and argue for a novel account. The account describes scientific induction as involving by default a generalization bias that operates automatically and frequently leads researchers to unintentionally generalize their findings without sufficient evidence. The result is unwarranted, overgeneralized (...) conclusions. We support this account of scientific induction by integrating a range of disparate findings from across the cognitive sciences that have until now not been connected to research on the nature of scientific induction. The view that scientific induction involves by default a generalization bias calls for a revision of the current thinking about scientific induction and highlights an overlooked cause of the replication crisis in the sciences. Commonly proposed interventions to tackle scientific overgeneralizations that may feed into this crisis need to be supplemented with cognitive debiasing strategies against generalization bias to most effectively improve science. (shrink)

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self-criticism; (2) a fast ‘n’ (...) bropen scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience. (shrink)

Memetics is a research approach which applies evolutionary ideas and terminology to cultural phenomena. The core idea of memetics is the existence of the units of cultural evolution which are attributed autonomous replicating goals. Of course, such a controversial concept has gained many devoted adherents as well as its determined opponents. The paper discusses the theoretical difficulties of memetics. The first part discusses the analogy of genes and memes. The theme of the second part is the ontology of a cultural (...) replicator. Finally, the third part presents the main issues related to manners of transmission and the adaptation of memes. In short, the aim of the paper is an evaluation of the explanatory potential of memetics. The explanatory potential of memetics will be evaluated in terms of its intrinsic consistency, the degree of its confirmation, the falsifiability of the theses which were elaborated on its basis and the heuristic value of this approach. (shrink)

Ken Wilber insists that valid knowledge must be derived from paradigms: sets of injunctions and social practices that lead to replicable experiences. In this article, I examine Wilber's claims that the theory still includes the essentials of premodern traditions, because the essentials of those traditions consist of a phenomenological core of practices leading to mystical experience. Drawing on the works of Robert Sharf and Wilhelm Halbfass and on close readings of primary texts, this article argues that mystical paradigms of replicable (...) experience are not in fact the essentials of these traditions--neither for the majority of practitioners nor even for their revered teachers or masters. The article concludes with a discussion of the implications of this point for constructive integral work. (shrink)

In their critique of Klein (2014a), Trafimow and Earp present two theses. First, they argue that, contra Klein, a well-specified theory is not a necessary condition for successful replication. Second, they contend that even when there is a well-specified theory, replication depends more on auxiliary assumptions than on theory proper. I take issue with both claims, arguing that (a) their first thesis confuses a material conditional (what I said) with a modal claim (T&E’s misreading of what I said), (...) and (b) their second thesis has the unfortunate consequence of refuting their first thesis. (shrink)

The results of forensic science are believed to be reliable, and are widely used in support of verdicts around the world. However, due to the lack of suitable empirical studies, we actually know very little about the reliability of such results. In this paper, I argue that phenomena analogous to the main culprits for the replication crisis in psychology are also present in forensic science. Therefore forensic results are significantly less reliable than is commonly believed. I conclude that in (...) order to obtain reliable estimates for the reliability of forensic results, we need to conduct studies analogous to the large-scale replication projects in psychology. Additionally, I point to some ways for improving the reliability of forensic science, inspired by the reforms proposed in response to the replicability crisis. (shrink)

This article is devoted to thirtieth anniversary of the first publication in 1982 Saul Kripke's book "Wittgenstein on rules and private language". Radical skeptical interpretation of the work 'late' Ludwig Wittgenstein proposed by Saul Kripke in this book is considered one of the most famous "puzzle" of modern philosophy of language, which has become a source of much debate and discussion on the nature of the linguistic sign and its meaning. This article examines some of the consequences of a radical (...) version of skeptical 'rule-following' paradox by Saul Kripke, which remain in force and effect for finite functions and limited linguistic registers 'Ad finitum'. Thereby questioned the widely held view among analytic philosophers that the skeptical core for Saul Kripke's 'rule-following' paradox is argument 'Ad infinitum' (an inherent source of skepticism for our intention to follow the rule is concluded in itself situation of mastering for us endless function on the limited set of examples), and thus any direct or even moderate solutions of this paradox would be focused to its elimination. Thus proved that including for the field of finite functions and languages described theirs the skeptical force of 'rule-following' paradox itself completely saves. Moreover, undertaken in this article analysis detects a very quaint phenomenon to the field of language registers 'Ad finitum' - the effect of 'replication' (in the using of a linguistic phrase is always a n-th set of empirically equivalent but logically incompatible and even non-identical languages which it belongs). Study of the phenomenon of replication leads to a number of important remarks on many critics of Saul Kripke's skeptical paradox, in particular the famous Oxford philosopher Gordon Baker and Peter Hacker. Thus the concept of 'community speakers' has been called by Saul Kripke for skeptical solution to paradox of him own cannot be eliminated by the concept of 'share' and 'shareable' languages proposed for this aim by Gordon Baker and Peter Hacker. Despite the criticism the skeptical paradox 'rule-following' by Saul Kripke is still the center of attention and remains influential in modern philosophy of language and the meaning theory. (shrink)

The replicability and importance of the correlation between cognitive style and religious belief have been debated. Moreover, the literature has not examined distinct psychological accounts of this relationship. We tested the replicability of the correlation (N = 5284; students and broader samples of Canadians, Americans, and Indians); while testing three accounts of how cognitive style comes to be related to belief in God, karma, witchcraft, and to the belief that religion is necessary for morality. The first, the dual process model, (...) posits that analytical thinking is recruited in overriding intuitions related to supernatural beliefs. The second, the expressive rationality model, posits that analytical thinking is recruited in supporting already-held beliefs in an identity-protective manner. And the third, the counter-normativity rationality model, posits that analytical thinking is recruited to question beliefs supported by prevailing cultural norms. In Study 2, we tested the replicability of our results in a re-analysis of published data. The association between analytic thinking style and beliefs was replicated. We conclude that whereas the counter-normativity rationality model was contradicted by the data, both the dual process and expressive rationality models received varying degrees of empirical support, but neither model fully accounted for all the patterns in the data. (shrink)

Replicating or exceeding human intelligence, not just in particular domains but in general, has always been a major goal of Artificial Intelligence (AI). We argue here that “human intelligence” is not only ill-defined, but often conflated with broader aspects of human psychology. Standard arguments for replicating it are morally unacceptable. We then suggest a reframing: that the proper goal of AI is not to replicate humans, but to complement them by creating diverse intelligences capable of collaborating with humans. This goal (...) renders issues of theory of mind, empathy, and caring, or community engagement, central to AI. It also challenges AI to better understand the circumstances in which human intelligence, including human moral intelligence, fails. (shrink)

Ever since the publication of Richard Dawkins' The Selfish Gene, a book for the lay reader that popularized the ideas of influential evolutionary biologists like William Hamilton and George Williams, there has been much discussion of so-called "universal Darwinism". Dawkins' dual aim was to reduce evolutionary phenomena to the level of the gene, while at the same time abstracting the Darwinian process of natural selection of "replicators" and making it into something that would apply beyond the domain of biology.

Replicated architecture is widely used in the field of real-time collaborative text editor. The idea of address space transformation provides a new way for concurrency control. During concurrent processing, it retraces the document status back to the state when the operations are generated to maintain consistency. However the previous concurrency processes strategy is based on single characters, the transmission cost during processing is too high since every character is packaged and broadcasted to remote sites after they are created by local (...) site. When the network load is high, especially when the network is unstable, this shortage will be even more obvious. Due to this problem, this paper presents a consistency maintenance strategy based on string editing operations, and proposes the string splitting mechanism combined with the idea of the address space transformation in order to maintain consistency. This strategy increases the transmission efficiency while guaranteeing the consistency of the shared document. (shrink)

The Greek gymnasium was replicated in the architecture, art, and activities of the Imperial Roman thermae. This mimēsis was rooted in sincere admiration of traditional Greek paideia – especially the glory of Athens’ Academy and Lyceum – but it did not manage to replicate the gymnasium’s educational impact. This article reconstructs the aesthetics of a visit to the Roman baths, explaining how they evoked a glorious Hellenic past, offering the opportunity to Romans to imagine being «Greek». But true Hellenic paideia (...) was always kept at arm’s length by an assumption of Roman cultural superiority. One may play at being a Greek athlete or philosopher, but one would never dedicate one’s life to it. The experience of the Imperial thermae celebrated Greek athletic culture, but it remained too superficial – too spectatorial – to effect the change of soul demanded by classical gymnastic education. (shrink)

Hypothesizing after the results are known, or HARKing, occurs when researchers check their research results and then add or remove hypotheses on the basis of those results without acknowledging this process in their research report (Kerr, 1998). In the present article, I discuss three forms of HARKing: (1) using current results to construct post hoc hypotheses that are then reported as if they were a priori hypotheses; (2) retrieving hypotheses from a post hoc literature search and reporting them as a (...) priori hypotheses; and (3) failing to report a priori hypotheses that are unsupported by the current results. These three types of HARKing are often characterized as being bad for science and a potential cause of the current replication crisis. In the present article, I use insights from the philosophy of science to present a more nuanced view. Specifically, I identify the conditions under which each of these three types of HARKing is most and least likely to be bad for science. I conclude with a brief discussion about the ethics of each type of HARKing. (shrink)

Scientists often adjust their significance threshold during null hypothesis significance testing in order to take into account multiple testing and multiple comparisons. This alpha adjustment has become particularly relevant in the context of the replication crisis in science. The present article considers the conditions in which this alpha adjustment is appropriate and the conditions in which it is inappropriate. A distinction is drawn between three types of multiple testing: disjunction testing, conjunction testing, and individual testing. It is argued that (...) alpha adjustment is only appropriate in the case of disjunction testing, in which at least one test result must be significant in order to reject the associated joint null hypothesis. Alpha adjustment is inappropriate in the case of conjunction testing, in which all relevant results must be significant in order to reject the joint null hypothesis. Alpha adjustment is also inappropriate in the case of individual testing, in which each individual result must be significant in order to reject each associated individual null hypothesis. The conditions under which each of these three types of multiple testing is warranted are examined. It is concluded that researchers should not automatically assume that alpha adjustment is necessary during multiple testing. Illustrations are provided in relation to joint studywise hypotheses and joint multiway ANOVAwise hypotheses. (shrink)

In a recent article in this journal, James Christensen, Tom Parr and David Axelsen argue that millionaire salaries are unjust and women have no grounds of fairness to unjust salaries in parity with men. They accept that disrespect is expressed toward women when they are paid less than men because of their gender. Their argument largely replicates a similar argument developed earlier by Anca Gheaus. By drawing on the distinction between ideal and nonideal theory, we argue that Christensen et al. (...) and Gheaus hold women to unacceptably high standards of justice and arguably higher standards than men are held to. (shrink)

This study sought to replicate and extend Hall and colleagues’ (2014) work on developing and validating scales from the Psychopathic Personality Inventory (PPI) to index the triarchic psychopathy constructs of boldness, meanness, and disinhibition. This study also extended Hall et al.’s initial findings by including the PPI Revised (PPI–R). A community sample (n D 240) weighted toward subclinical psychopathy traits and a male prison sample (n D 160) were used for this study. Results indicated that PPI–Boldness, PPI–Meanness, and PPI–Disinhibition converged (...) with other psychopathy, personality, and behavioral criteria in ways conceptually expected from the perspective of the triarchic psychopathy model, including showing very strong convergent and discriminant validity with their Triarchic Psychopathy Measure counterparts. These findings further enhance the utility of the PPI and PPI–R in measuring these constructs. (shrink)