In this paper, I distinguish three general approaches to public trust in science, which I call the individual approach, the semi-social approach, and the social approach, and critically examine their proposed solutions to what I call the problem of harmful distrust. I argue that, despite their differences, the individual and the semi-social approaches see the solution to the problem of harmful distrust as consisting primarily in trying to persuade individual citizens to trust science and that both approaches face two general (...) problems, which I call the problem of overidealizing science and the problem of overburdening citizens. I then argue that in order to avoid these problems we need to embrace a (thoroughly) social approach to public trust in science, which emphasizes the social dimensions of the reception, transmission, and uptake of scientific knowledge in society and the ways in which social forces influence both positively and negatively the trustworthiness of science. (shrink)

Sometimes inquirers may rationally pursue a theory even when the available evidence does not favor that theory over others. Features of a theory that favor pursuing it are known as considerations of promise or pursuitworthiness. Examples of such reasons include that a theory is testable, that it has a useful associated analogy, and that it suggests new research and experiments. These reasons need not be evidence in favor of the theory. This raises the question: what kinds of reasons are provided (...) by pursuitworthiness considerations? Are they epistemic reasons or practical reasons? I argue that pursuitworthiness considerations are a kind of non-evidential epistemic reason, which I call an inquisitive reason. In support of this, I first point out two important similarities between the traditional pursuitworthiness considerations discussed in philosophy of science, which I call promise reasons, and certain social epistemic reasons that I call social inquisitive reasons. Specifically, both kinds of reason (1) favor pursuing a theory in a non-evidential way, and (2) concern promoting successful inquiry. I then propose recognition of a new category of normative reason: inquisitive reasons. This category contains both promise and social inquisitive reasons. Finally, I argue that inquisitive reasons share three essential features with previously recognized epistemic reasons: a connection to epistemic aims, explanatory independence, and the presence of a specific right-kind/wrong-kind reasons distinction. Each of these features have been used to argue that evidence should be treated as part of a distinct, independent domain of epistemic normativity. Since inquisitive reasons share these features, they too should be considered part of this independent epistemic domain. Thus, inquisitive reasons, including pursuitworthiness considerations, are epistemic reasons. (shrink)

Current debates about the replication crisis in psychology take it for granted that direct replication is valuable and focus their attention on questionable research practices in regard to statistical analyses. This paper takes a broader look at the notion of replication as such. It is argued that all experimentation/replication involves individuation judgments and that research in experimental psychology frequently turns on probing the adequacy of such judgments. In this vein, I highlight the ubiquity of conceptual and material questions in research, (...) and I argue that replication is not as central to psychological research as it is sometimes taken to be. (shrink)

Replicability is widely taken to ground the epistemic authority of science. However, in recent years, important published findings in the social, behavioral, and biomedical sciences have failed to replicate, suggesting that these fields are facing a “replicability crisis.” For philosophers, the crisis should not be taken as bad news but as an opportunity to do work on several fronts, including conceptual analysis, history and philosophy of science, research ethics, and social epistemology. This article introduces philosophers to these discussions. First, I (...) discuss precedents and evidence for the crisis. Second, I discuss methodological, statistical, and social-structural factors that have contributed to the crisis. Third, I focus on the philosophical issues raised by the crisis. Finally, I discuss proposed solutions and highlight the gaps that philosophers could focus on. (shrink)

The replication (replicability, reproducibility) crisis in social psychology and clinical medicine arises from the fact that many apparently well-confirmed experimental results are subsequently overturned by studies that aim to replicate the original study. The culprit is widely held to be poor science: questionable research practices, failure to publish negative results, bad incentives, and even fraud. In this article I argue that the high rate of failed replications is consistent with high-quality science. We would expect this outcome if the field of (...) science in question produces a high proportion of false hypotheses prior to testing. If most of the hypotheses under test are false, then there will be many false hypotheses that are apparently supported by the outcomes of well conducted experiments and null hypothesis significance tests with a type-I error rate (α) of 5%. Failure to recognize this is to commit the fallacy of ignoring the base rate. I argue that this is a plausible diagnosis of the replication crisis and examine what lessons we thereby learn for the future conduct of science. (shrink)

A heated debate surrounds the significance of reproducibility as an indicator for research quality and reliability, with many commentators linking a "crisis of reproducibility" to the rise of fraudulent, careless and unreliable practices of knowledge production. Through the analysis of discourse and practices across research fields, I point out that reproducibility is not only interpreted in different ways, but also serves a variety of epistemic functions depending on the research at hand. Given such variation, I argue that the uncritical pursuit (...) of reproducibility as an overarching epistemic value is misleading and potentially damaging to scientific advancement. Requirements for reproducibility, however they are interpreted, are one of many available means to secure reliable research outcomes. Furthermore, there are cases where the focus on enhancing reproducibility turns out not to foster high-quality research. Scientific communities and Open Science advocates should learn from inferential reasoning from irreproducible data, and promote incentives for all researchers to explicitly and publicly discuss their methodological commitments, the ways in which they learn from mistakes and problems in everyday practice, and the strategies they use to choose which research component of any project needs to be preserved in the long term, and how. (shrink)

Social epistemology is the study of the social dimensions of knowledge or information. There is little consensus, however, on what the term "knowledge" comprehends, what is the scope of the "social", or what the style or purpose of the study should be. According to some writers, social epistemology should retain the same general mission as classical epistemology, revamped in the recognition that classical epistemology was too individualistic. According to other writers, social epistemology should be a more radical departure from classical (...) epistemology, a successor discipline that would replace epistemology as traditionally conceived. The classical approach could be realized in at least two forms. One would emphasize the traditional epistemic goal of acquiring true beliefs. It would study social practices in terms of their impact on the truth-values of agents’ beliefs. A second version of the classical approach would focus on the epistemic goal of having justified or rational beliefs. Applied to the social realm, it might concentrate, for example, on when a cognitive agent is justified or warranted in accepting the statements and opinions of others. Proponents of the anti-classical approach have little or no use for concepts like truth and justification. In addressing the social dimensions of knowledge, they understand "knowledge" as simply what is believed, or what beliefs are "institutionalized" in this or that community, culture, or context. They seek to identify the social forces and influences responsible for knowledge production so conceived. Social epistemology is theoretically significant because of the central role of society in the knowledge-forming process. It also has practical importance because of its possible role in the redesign of information-related social institutions. (shrink)

Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we reassess the value of replicability from an epistemic perspective. We defend the orthodox view, according to which replications are always epistemically useful, against the more prudent view that claims that it (...) is useful in very limited circumstances. Additionally, we argue that we can learn more about the original experiment and the limits of the discovered effect from replications at different levels. We hold that replicability is a crucial feature of experimental results and scientists should continue to strive to secure it. (shrink)

The Value-free ideal of science (VFI) is a view that claims that scientists should not use non-epistemic values when they are justifying their hypotheses, and is widely considered to be obsolete in the philosophy of science. I will defend the ideal by demonstrating that acceptance of non-epistemic values, prohibited by VFI, necessitates legitimizing certain problematic scientific practices. Such practices, including biased methodological decisions or Questionable Research Practices (QRP), significantly contribute to the Replication Crisis. I will argue that the realizability of (...) VFI is not a necessary condition for its validity. Then, I will show how some of the prominent proposals of value-laden science legitimize problematic scientific practices, provide real-world examples, and generalize the argument. Finally, I will show how value-laden methodological decisions contribute to the Replicability Crisis and discuss two strategies for realizing VFI. (shrink)

In this commentary, I propose a framework for thinking about data quality in the context of scientific research. I start by analyzing conceptualizations of quality as a property of information, evidence and data and reviewing research in the philosophy of information, the philosophy of science and the philosophy of biomedicine. I identify a push for purpose dependency as one of the main results of this review. On this basis, I present a contextual approach to data quality in scientific research, whereby (...) the quality of a dataset is dependent on the context of use of the dataset as much as the dataset itself. I exemplify the approach by discussing current critiques and debates of scientific quality, thus showcasing how data quality can be approached contextually. (shrink)

The life sciences are said to be in the midst of a replication crisis because a majority of published results are irreproducible, and scientists rarely replicate existing data. Here I argue that point 2 of this assessment is flawed because there is a hitherto unidentified form of replication in the experimental life sciences, which I call ‘microreplications’. Using a case study from biochemistry, I illustrate how MRs depend on a key element of experimentation, namely, experimental controls. I end by reflecting (...) on what MRs mean for the broader debate about the replication crisis. (shrink)

The enduring replication crisis in many scientific disciplines casts doubt on the ability of science to estimate effect sizes accurately, and in a wider sense, to self-correct its findings and to produce reliable knowledge. We investigate the merits of a particular countermeasure—replacing null hypothesis significance testing with Bayesian inference—in the context of the meta-analytic aggregation of effect sizes. In particular, we elaborate on the advantages of this Bayesian reform proposal under conditions of publication bias and other methodological imperfections that are (...) typical of experimental research in the behavioral sciences. Moving to Bayesian statistics would not solve the replication crisis single-handedly. However, the move would eliminate important sources of effect size overestimation for the conditions we study. (shrink)

The replicability crisis refers to the apparent failures to replicate both important and typical positive experimental claims in psychological science and biomedicine, failures which have gained increasing attention in the past decade. In order to provide evidence that there is a replicability crisis in the first place, scientists have developed various measures of replication that help quantify or “count” whether one study replicates another. In this nontechnical essay, I critically examine five types of replication measures used in the landmark article (...) “Estimating the reproducibility of psychological science” (Open Science Collaboration, Science, 349, ac4716, 2015) based on the following techniques: subjective assessment, null hypothesis significance testing, comparing effect sizes, comparing the original effect size with the replication confidence interval, and meta-analysis. The first four, I argue, remain unsatisfactory for a variety of conceptual or formal reasons, even taking into account various improvements. By contrast, at least one version of the meta-analytic measure does not suffer from these problems. It differs from the others in rejecting dichotomous conclusions, the assumption that one study replicates another or not simpliciter. I defend it from other recent criticisms, concluding however that it is not a panacea for all the multifarious problems that the crisis has highlighted. (shrink)

The priority rule in science has been interpreted as a behavior regulator for the scientific community, which benefits society by adequately structuring the distribution of intellectual labor across pre-existing research programs. Further, it has been lauded as part of society's "grand reward scheme" because it fairly rewards people for the benefits they produce. But considerations about how news of scientific developments spreads throughout a scientific community at large suggest that the priority rule is something else entirely, which can disadvantage historically (...) underrepresented or otherwise marginalized social groups. (shrink)

Scientists are becoming increasingly aware of a “replicability crisis” in the behavioral, social, and biomedical sciences. Researchers have made progress identifying statistical and methodological...

Fraud and misleading research represent serious impediments to scientific progress. We must uncover the causes of fraud in order to understand how science functions and in order to develop strategies for combating epistemically detrimental behavior. This paper investigates how the incentive to commit fraud is enhanced by the structure of the scientific reward system. Science is an "accumulation process:" success begets resources which begets more success. Through a simplified mathematical model, I argue that this cyclic relationship enhances the appeal of (...) fraud and makes combating it extremely difficult. (shrink)

This study investigated the relationship between publication pressure and questionable research practices (QRPs), focusing on moral disengagement (MD) and lab research ethics climate. A survey of 269 Chinese PhD students revealed that (1) publication pressure is significantly positively correlated with QRPs and MD; (2) MD mediates the relationship between publication pressure and QRPs; lab research ethics climate moderates both (3) the relationship between publication pressure and MD, and (4) the mediating role of MD between publication pressure and QRPs. Responsible conduct (...) of research education should emphasize potential ethical conflicts in publication, the impact of cognitive patterns of MD, and lab-based interventions for QRPs. (shrink)

In his text ‘Wissenschaft als Beruf’, Max Weber associates the understanding of science as a vocation with the scientist’s ability to present the audience with ‘inconvenient facts’. He argues that this presentation provides a ‘full understanding of the facts’ and overcomes any personal value judgment. This overcoming refers to Weber’s understanding of scientific objectivity. I propose to interpret this understanding in the context of contemporary studies of public science communication. I pose the question, ‘Should scientists objectively present inconvenient facts to (...) the public or should they neglect objectivity in science-society communication?’ I will start by legitimizing this question in the context of contemporary discussions on public science communication. To answer this question I will then use Heather Douglas’s observations addressing irreducible complexity of objectivity as a conceptual framework. I will briefly describe, with some modifications, this idea in relation to Weber’s representation of ‘inconvenient facts’. I then will continue by referencing discussions concerning scientist’s norms in public science communication and relate them to the formulations of objectivity above. In conclusion, I will offer an explanation of why the objectivity in Weber’s interpretation remains relevant to regulate contemporary public science communication. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.