Science is increasingly becoming automated. Tasks yet to be fully automated include the conjecturing, modifying, extending and testing of hypotheses. At present scientists have an array of methods to help them carry out those tasks. These range from the well-articulated, formal and unexceptional rules to the semi-articulated and variously understood rules-of-thumb and intuitive hunches. If we are to hand over at least some of the aforementioned tasks to machines, we need to clarify, refine and make formal, not to mention computable, (...) even the more obscure of the methods scientists successfully employ in their inquiries. The focus of this essay is one such less-than-transparent methodological rule. I am here referring to the rule that ad hoc hypotheses ought to be spurned. This essay begins with a brief examination of some notable conceptions of ad hoc-ness in the philosophical literature. It is pointed out that there is a general problem afflicting most such conceptions, namely the intuitive judgments that are supposed to motivate them are not universally shared. Instead of getting bogged down in what ad hoc-ness exactly means, I shift the focus of the analysis to one undesirable feature often present in alleged cases of ad hoc-ness. I call this feature the ‘monstrousness’ of a hypothesis. A fully articulated formal account of this feature is presented by specifying what it is about the internal constitution of a hypothesis that makes it monstrous. Using this account, a monstrousness measure is then proposed and somewhat sketchily compared with the minimum description length approach. (shrink)

This article argues that common intuitions regarding (a) the specialness of ‘use-novel’ data for confirmation and (b) that this specialness implies the ‘no-double-counting rule’, which says that data used in ‘constructing’ (calibrating) a model cannot also play a role in confirming the model’s predictions, are too crude. The intuitions in question are pertinent in all the sciences, but we appeal to a climate science case study to illustrate what is at stake. Our strategy is to analyse the intuitive claims in (...) light of prominent accounts of confirmation of model predictions. We show that on the Bayesian account of confirmation, and also on the standard classical hypothesis-testing account, claims (a) and (b) are not generally true; but for some select cases, it is possible to distinguish data used for calibration from use-novel data, where only the latter confirm. The more specialized classical model-selection methods, on the other hand, uphold a nuanced version of claim (a), but this comes apart from (b), which must be rejected in favour of a more refined account of the relationship between calibration and confirmation. Thus, depending on the framework of confirmation, either the scope or the simplicity of the intuitive position must be revised. (shrink)

This is a response to the papers in the special issue Logical Perspectives on Science and Cognition—The Philosophy of Gerhard Schurz.

Tacking by conjunction is a well-known problem for Bayesian confirmation theory. In the first section, disadvantages of existing Bayesian solution proposals to this problem are pointed out and an alternative solution proposal is presented: that of genuine confirmation. In the second section, the notion of GC is briefly recapitulated and three versions of GC are distinguished: full GC, partial GC and quantitative GC. In the third section, the application of partial GC to pure post-facto speculations is explained. In the fourth (...) section it is demonstrated that full GC is a necessary condition for Bayesian convergence to certainty based on the accumulation of conditionally independent pieces of evidence. It is found that whenever a hypothesis is equivalent to a disjunction of more fine-grained hypotheses conveying different probabilities to the evidence, then conditional independence of the evidence fails. This failure occurs typically for unspecific negations of hypotheses. A refined version of the convergence to certainty theorem that overcomes this difficulty is developed in the final section. (shrink)

Tacking by conjunction is a deep problem for Bayesian confirmation theory. It is based on the insight that to each hypothesis h that is confirmed by a piece of evidence e one can ‘tack’ an irrelevant hypothesis h′ so that h∧h′ is also confirmed by e. This seems counter-intuitive. Existing Bayesian solution proposals try to soften the negative impact of this result by showing that although h∧h′ is confirmed by e, it is so only to a lower degree. In this (...) article we outline some problems of these proposals and develop an alternative solution based on a new concept of confirmation that we call genuine confirmation. After pointing out that genuine confirmation is a necessary condition for cumulative confirmation we apply this notion to the tacking by conjunction problem. We consider both the question of what happens when irrelevant hypotheses are added to a hypothesis h that is confirmed by e as well as the question of what happens when h is disconfirmed. The upshot of our discussion will be that genuine confirmation provides a robust solution for each of the different perspectives. _1_ Introduction _2_ Tacking by Conjunction: Existing Solution Proposals _3_ Genuine Confirmation _3.1_ Content elements and content parts _3.2_ Qualitative genuine confirmation _3.3_ Quantitative genuine confirmation _4_ Tacking by Conjunction: The Case of Confirmation _5_ Tacking by Conjunction: The Case of Disconfirmation _6_ Tacking by Conjunction: Adding Multiple Hypotheses _7_ Conclusion Appendix. (shrink)

The concepts of coherence and confirmation are closely intertwined: according to a prominent proposal coherence is nothing but mutual confirmation. Accordingly, it should come as no surprise that both are confronted with similar problems. As regards Bayesian confirmation measures these are illustrated by the problem of tacking by conjunction. On the other hand, Bayesian coherence measures face the problem of belief individuation. In this paper we want to outline the benefit of an approach to coherence and confirmation based on content (...) elements. It will be shown that the resulting concepts, called genuine coherence and genuine confirmation, can be used in order to solve the two mentioned problems. In a final section we present some results on degrees of genuine coherence and genuine confirmation. (shrink)

An important distinction is that between selective abductions, which select an optimal candidate from given multitude of possible explanations, and creative abductions, which introduce new theoretical concepts and models. The article focuses on creative abductions, which are essential for scientific progress, although they are rarely discussed in the literature. Scientifically, fruitful creative abductions are demarcated from purely speculative abductions by means of three virtues which are possessed by the former but not by the latter: (i) providing unification, (ii) detecting common (...) causes and (iii) generating novel predictions by means of which they can be independently tested. Based on historical examples it is demonstrated that common cause abduction from correlated dispositions is the fundamental abductive operation by which new theoretical concepts and models are scientifically generated. Statistical factor analysis can be regarded as a statistical generalization of common cause abduction. (shrink)

In psychology, measurement instruments are constructed from scales, which are obtained on the grounds of exploratory and confirmatory factor analysis. Looking at the literature, one can find various recommendations regarding how these techniques should be used during the scale construction process. Some authors suggest to use exploratory factor analysis on the entire data set while others advice to perform an internal cross-validation by randomly splitting the data set in two and then either perform exploratory factor analysis on both parts or (...) exploratory factor analysis on the first part and confirmatory factor analysis on the other. In spite of all these divergent recommendations, there is no consensus on which method yields the best result. In this paper, we analyze this issue in light of the prediction versus accommodation debate and argue that the answer to this question depends on one’s conception of the criteria that should be used to achieve the goals of the scientific enterprise. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

The practice of HARKing---hypothesizing after results are known---is commonly maligned as undermining the reliability of scientific findings. There are several accounts in the literature as to why HARKing undermines the reliability of findings. We argue that none of these is right and that the correct account is a Bayesian one. HARKing can indeed decrease the reliability of scientific findings, but it can also increase it; which effect HARKing produces depends on the difference of the prior odds of hypotheses characteristically selected (...) ex ante and ex post to observing data. Further, we show how misdiagnosis of HARKing can lead to misprescription in the context of the replication crisis. (shrink)