The research is devoted to the problem of philosophically justifying rationality, which inevitably takes the form of a circular argument: to define what rationality is, we must refrain from referring to its criteria, which must be rationally defined beforehand. This epistemic circle is compared to the so-called “experimenter’s regress”. The experimenter’s regress involves reasoning in which judging the correctness of obtained scientific results can only be based on the correctness of the procedure of obtaining them and judging the correctness of (...) the procedure of obtaining them can only be done by relying on the obtained results. From the perspective of social researchers of science, the experimenter’s (and the theoretician’s) regress casts a shadow on traditional theories of rationality that take science as a model of rational knowledge. The research analyzes the experimenter’s regress in the context of virtuous and vicious circles. It is shown that the experimenter’s regress is overcome by turning to external factors. These factors are proposed to be interpreted in terms of extended rationality. By analyzing the experimenter’s regress, social epistemologists consciously or unconsciously rationalize these “external” factors and enrich the concept of rationality. This allows qualifying the circle described by rationality in defining itself as virtuous and the work of the epistemologist as a progressive activity, during which both epistemology and its subject undergo qualitative changes. (shrink)

The replication crisis has spawned discussions on the meaning of replication. In fact, in order to determine whether an experiment fails to replicate, it is necessary to establish what replication is. This is, however, a difficult task, as it is possible to attribute different meanings to it. This paper offers a solution to this problem of ambiguity by engineering a concept of replication that, if compared to other proposals, stands out for being not only broadly applicable but also sufficiently specific. (...) It features a minimal level of operationalism, which would otherwise limit its applicability, while it heavily relies on replication’s specific epistemic functions, which are inter-disciplinary. Another merit is its context sensitivity, which enables it to differentiate instances of replication from non-instances of replication in every scientific discipline according to the discipline’s own standards. (shrink)

Depression is a widespread and debilitating disorder, but developing effective treatments has proven challenging. Despite success in animal models, many treatments fail in human trials. While various factors contribute to this translational failure, standardization practices in animal research are often overlooked. This paper argues that certain standardization choices in behavioral neuroscience research on depression can limit the generalizability of results from rodents to humans. This raises ethical and scientific concerns, including animal waste and a lack of progress in treating human (...) patients. To address these issues, animal ethics committees can establish reasonable expectations for preclinical research and highlight the impact of standardization on generalizability. Such efforts can help improve translation from animal models to human patients and ultimately benefit those suffering from depression. (shrink)

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self-criticism; (2) a fast ‘n’ bropen (...) scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience. (shrink)

Replicability is widely regarded as one of the defining features of science and its pursuit is one of the main postulates of meta-research, a discipline emerging in response to the replicability crisis. At the same time, replicability is typically treated with caution by philosophers of science. In this paper, we reassess the value of replicability from an epistemic perspective. We defend the orthodox view, according to which replications are always epistemically useful, against the more prudent view that claims that it (...) is useful in very limited circumstances. Additionally, we argue that we can learn more about the original experiment and the limits of the discovered effect from replications at different levels. We hold that replicability is a crucial feature of experimental results and scientists should continue to strive to secure it. (shrink)

The philosophical interest in experimental practice in neuroscience has brought renewed attention to the study of the development and use of techniques and tools for data production. John Bickle has argued that the construction and progression of theories in neuroscience are entirely dependent on the development and ingenious use of research tools. In Bickle's account, theory plays a tertiary role, as it depends on what the tools allow researchers to manipulate, and the tools, in turn, are developed not in order (...) to test theories but as solutions to engineering problems. However, Bickle's account is not entirely precise in explaining what informs researchers' decision-making in their atheoretical laboratory tinkering. Identifying the sources that guide researchers in tool development and use is crucial if one wishes to contribute to the philosophical or meta-scientific understanding of experimental practice in neuroscience. In the following paper, I claim that decision-making in tools' development and use in neuroscience is doubly guided. Pre-existing theory and concepts determine information's relevance, whereas tools' functioning in controlled situations determines information's reliability. Accordingly, experimenters' decision-making is situated both in the context of analysing, modelling or interpreting information and in the context of producing information. I study the case of the tungsten microelectrode developed by David Hubel during the 1950s. First, I show that pre-existing theory and concepts determine in advance what information would be relevant to obtain from the microelectrode. Second, I show that Hubel's tinkering follows the guidelines derived from the very structure of what we recognise as reliable experimentally produced information. Finally, I suggest that data-production processes allow experimenters to assess what to expect from an experimental system in terms of concept- and theory-generation and confirmation, thereby endorsing Bickle's tenet on the tertiary role of theory in neuroscience. (shrink)

We argue that the epistemic functions of replication in science are best understood by their role in assessing kinds of experimental error. Direct replications serve to assess the reliability of an experiment through its precision: the presence and degree of random error. Conceptual replications serve to assess the validity of an experiment through its accuracy: the presence and degree of systematic errors. To illustrate the aptness of this view, we examine the Hubble constant controversy in astronomy, showing how astronomers have (...) responded to the concordances and discordances in their results by carrying out the different kinds of replication that we identify, with the aim of establishing a precise, accurate value for the Hubble constant. We contrast our view with Machery’s “re-sampling” account of replicability, which maintains that replications only assess reliability. (shrink)

The replicability of a research claim is often positioned as an important step in establishing the credibility of scientific research. This expectation persists despite ongoing disagreements over how to characterise replication practices in various contexts. Rather than attempt to explain or resolve these disagreements, we propose that there is value in exploring the variable uses of the replicability concept. To this end, we treat the replicability concept as a goal-directed tool for studying scientific practices. This approach extends scholarship on the (...) goal-directed uses of concepts within investigative practices to explore the value of reflexively interrogating those concepts used to study the sciences as practiced. In doing so, we highlight the importance of considering how and when a given concept is an appropriate tool for a given goal when studying scientific practices. For instance, in the case of the replicability concept, our examination suggests that there is value in clarifying how a given characterisation of replicability is appropriate to a given context-specific analytic and/or evaluative goal. In addition, we hope to draw attention to how Metaresearch and HPS contexts provide complementary insights for those seeking to understand when and how replication practices can help in assessing a given research claim. (shrink)

In this commentary, I propose a framework for thinking about data quality in the context of scientific research. I start by analyzing conceptualizations of quality as a property of information, evidence and data and reviewing research in the philosophy of information, the philosophy of science and the philosophy of biomedicine. I identify a push for purpose dependency as one of the main results of this review. On this basis, I present a contextual approach to data quality in scientific research, whereby (...) the quality of a dataset is dependent on the context of use of the dataset as much as the dataset itself. I exemplify the approach by discussing current critiques and debates of scientific quality, thus showcasing how data quality can be approached contextually. (shrink)

The “practice turn” in philosophy of science has strengthened the connections between philosophy and scientific practice. Apart from reinvigorating philosophy of science, this also increases the relevance of philosophical research for science, society, and science education. In this paper, we reflect on our extensive experience with teaching mandatory philosophy of science courses to science students from a range of programs at University of Copenhagen. We highlight some of the lessons we have learned in making philosophy of science “fit for teaching” (...) outside of philosophy circles by taking selected cases from the students’ own field as the starting point. We argue for adapting philosophy of science teaching to particular audiences of science students, and discuss the benefits of drawing on research within science education to inform curriculum and course design. This involves reconsidering teaching resources, assumptions about students, intended learning outcomes, and teaching formats. We also argue that to make philosophy of science relevant and engaging to science students, it is important to consider their potential career trajectories. By anticipating future contexts and situations in which methodological, conceptual, and ethical questions could be relevant, philosophy of science can demonstrate its value in the education of science students. (shrink)

Data production in experimental sciences depends on localised experimental systems, but the epistemic properties of data transcend the contingencies of the processes that produce them. Philosophers often believe that experimental systems instantiate but do not produce the epistemic properties of data. In this paper, we argue that experimental systems' local functioning entails intrinsic capacities to produce the epistemic properties of data. We develop this idea by applying Derrida's model of arche-writing to study a case of theory-oriented experimental practice. Derrida's model (...) relativises or dissolves the conceptual distinction between the moment of data production and a subsequent moment of data dissemination. It thus has consequences for understanding both data production (despite being intrinsically local, data production a priori generates transferrable and modellable information) and data dissemination (when modelling information, researchers needs to refer this information to the context of its production). We study a case of data production in a non-exploratory experimental system designed to test a pre-existing hypothesis in visual neuroscience. A case of theory-oriented experimental practice should allow us to identify the autonomous functioning of experimental systems in data production more clearly, insofar as it allows us to study the limits of pre-existing theory in the activities of these systems. We suggest that pre-existing concepts, hypotheses and theories condition the relevance but not the production of experimental data. (shrink)

We propose that the epistemic functions of replication in science are best understood by relating them to kinds of experimental error/uncertainty. One kind of replication, which we call “direct replications,” principally serves to assess the reliability of an experiment through its precision: the presence and degree of random error/statistical uncertainty. The other kind of replication, which we call “conceptual replications,” principally serves to assess the validity of an experiment through its accuracy: the presence and degree of systematic errors/uncertainties. To illustrate (...) the aptness of this general view, we examine the Hubble constant controversy in astronomy, showing how astronomers have responded to the concordances and discordances in their results by carrying out the different kinds of replication that we identify, with the aim of establishing a precise, accurate value for the Hubble constant. We contrast our view with Machery's “re-sampling” account of replication, which maintains that replications only assess reliability. (shrink)

The replication or reproducibility crisis in psychological science has renewed attention to philosophical aspects of its methodology. I provide herein a new, functional account of the role of replication in a scientific discipline: to undercut the underdetermination of scientific hypotheses from data, typically by hypotheses that connect data with phenomena. These include hypotheses that concern sampling error, experimental control, and operationalization. How a scientific hypothesis could be underdetermined in one of these ways depends on a scientific discipline’s epistemic goals, theoretical (...) development, material constraints, institutional context, and their interconnections. I illustrate how these apply to the case of psychological science. I then contrast this “bottom-up” account with “top-down” accounts, which assume that the role of replication in a particular science, such as psychology, must follow from a uniform role that it plays in science generally. Aside from avoiding unaddressed problems with top-down accounts, my bottom-up account also better explains the variability of importance of replication of various types across different scientific disciplines. (shrink)

Recently, many scientists have become concerned about an excessive number of failures to reproduce statistically significant effects. The situation has become dire enough that the situation has been named the ‘reproducibility crisis’. After reviewing the relevant literature to confirm the observation that scientists do indeed view replication as currently problematic, I explain in philosophical terms why the replication of empirical phenomena, such as statistically significant effects, is important for scientific progress. Following that explanation, I examine various diagnoses of the reproducibility (...) crisis, and argue that for the majority of scientists the crisis is due, at least in part, to a form of publication bias. This conclusion sets the stage for an assessment of the view that evidential relations in science are inherently value-laden, a view championed by Heather Douglas and Kevin Elliott. I argue, in response to Douglas and Elliott, and as motivated by the meta-scientific resistance scientists harbour to a publication bias, that if we advocate the value-ladenness of science the result would be a deepening of the reproducibility crisis. (shrink)

A widespread need to explain the behavior and outcomes of AI-based systems has emerged, due to their ubiquitous presence. Thus, providing renewed momentum to the relatively new research area of eXplainable AI (XAI). Nowadays, the importance of XAI lies in the fact that the increasing control transference to this kind of system for decision making -or, at least, its use for assisting executive stakeholders- already affects many sensitive realms (as in Politics, Social Sciences, or Law). The decision-making power handover to (...) opaque AI systems makes mandatory explaining those, primarily in application scenarios where the stakeholders are unaware of both the high technology applied and the basic principles governing the technological solutions. The issue should not be reduced to a merely technical problem; the explainer would be compelled to transmit richer knowledge about the system (including its role within the informational ecosystem where he/she works). To achieve such an aim, the explainer could exploit, if necessary, practices from other scientific and humanistic areas. The first aim of the paper is to emphasize and justify the need for a multidisciplinary approach that is beneficiated from part of the scientific and philosophical corpus on Explaining, underscoring the particular nuances of the issue within the field of Data Science. The second objective is to develop some arguments justifying the authors’ bet by a more relevant role of ideas inspired by, on the one hand, formal techniques from Knowledge Representation and Reasoning, and on the other hand, the modeling of human reasoning when facing the explanation. This way, explaining modeling practices would seek a sound balance between the pure technical justification and the explainer-explainee agreement. (shrink)