Metaphors are found all throughout science: in published papers, working hypotheses, policy documents, lecture slides, grant proposals, and press releases. They serve different functions, but perhaps most striking is the way they enable understanding, of a theory, phenomenon, or idea. In this paper, we leverage recent advances on the nature of metaphor and the nature of understanding to explore how they accomplish this feat. We attempt to shift the focus away from the epistemic value of the content of metaphors, to (...) the epistemic value of the metaphor’s consequences. Many famous scientific metaphors are epistemically good, not primarily because of what they say about the world, but because of how they cause us to think. Specifically, metaphors increase understanding either by improving our sets of representations, or by making it easier for us to encode and process data about complex subjects by changing how we are disposed to conceptualize those subjects. This view hints towards new positions concerning testimonial understanding, factivity, abilities, discovery via metaphor, and the relation between metaphors and models. (shrink)

Preregistration has been proposed as a useful method for making a publicly verifiable distinction between confirmatory hypothesis tests, which involve planned tests of ante hoc hypotheses, and exploratory hypothesis tests, which involve unplanned tests of post hoc hypotheses. This distinction is thought to be important because it has been proposed that confirmatory hypothesis tests provide more compelling results (less uncertain, less tentative, less open to bias) than exploratory hypothesis tests. In this article, we challenge this proposition and argue that there (...) are several advantages of exploratory hypothesis tests that can make their results more compelling than those of confirmatory hypothesis tests. We also consider some potential disadvantages of exploratory hypothesis tests and conclude that their advantages can outweigh the disadvantages. We conclude that exploratory hypothesis tests avoid researcher commitment and researcher prophecy biases, reduce the probability of data fraud, are more appropriate in the context of unplanned deviations, facilitate inference to the best explanation, and allow peer reviewers to make additional contributions at the data analysis stage. In contrast, confirmatory hypothesis tests may lead to an inappropriate level of confidence in research conclusions, less appropriate analyses in the context of unplanned deviations, and greater bias and errors in theoretical inferences. (shrink)

, 3661–3678, 2020) argues that a positivistic defense of science’s objectivity is incoherent because bias in the generation of scientific theories (implies that the rational evaluation of theories will also be biased. Even though this is an idea easy to agree with, this approach is flawed for two different but related reasons. First, Dellsén’s notion of bias does not account for many ordinary biases. Second, Dellsén’s use of bias at the community-level is inconsistent. It shifts from individual scientists generating new (...) theories and making decisions to scientific communities evaluating and accepting what theories are valid. This article offers a stronger response than Dellsén’s about aseptic objectivity in science by providing a more adequate account of bias, where psychological and behavioral aspects of individual scientists and community-level scientific practices are considered. (shrink)

Metascientists have studied questionable research practices in science. The present article considers the parallel concept of questionable metascience practices (QMPs). A QMP is a research practice, assumption, or perspective that has been questioned by several commentators as being potentially problematic for metascience and/or the science reform movement. The present article reviews ten QMPs that relate to criticism, replication, bias, generalization, and the characterization of science. Specifically, the following QMPs are considered: (1) rejecting or ignoring self-criticism; (2) a fast ‘n’ bropen (...) scientific criticism style; (3) overplaying the role of replication in science; (4) assuming a replication rate is “too low” without specifying an “acceptable” rate; (5) an unacknowledged metabias towards explaining the replication crisis in terms of researcher bias; (6) assuming that researcher bias can be reduced; (7) devaluing exploratory results as being more “tentative” than confirmatory results; (8) presuming that questionable research practices are problematic research practices; (9) focusing on knowledge accumulation; and (10) focusing on specific scientific methods. It is stressed that only some metascientists engage in some QMPs some of the time, and that these QMPs may not always be problematic. Research is required to estimate the prevalence and impact of QMPs. In the meantime, QMPs should be viewed as invitations to ask questions about how we go about doing better metascience. (shrink)