We argue that concerns about double-counting—using the same evidence both to calibrate or tune climate models and also to confirm or verify that the models are adequate—deserve more careful scrutiny in climate modelling circles. It is widely held that double-counting is bad and that separate data must be used for calibration and confirmation. We show that this is far from obviously true, and that climate scientists may be confusing their targets. Our analysis turns on a Bayesian/relative-likelihood approach to incremental confirmation. (...) According to this approach, double-counting is entirely proper. We go on to discuss plausible difficulties with calibrating climate models, and we distinguish more and less ambitious notions of confirmation. Strong claims of confirmation may not, in many cases, be warranted, but it would be a mistake to regard double-counting as the culprit. 1 Introduction2 Remarks about Models and Adequacy-for-Purpose3 Evidence for Calibration Can Also Yield Comparative Confirmation3.1 Double-counting I3.2 Double-counting II4 Climate Science Examples: Comparative Confirmation in Practice4.1 Confirmation due to better and worse best fits4.2 Confirmation due to more and less plausible forcings values5 Old Evidence6 Doubts about the Relevance of Past Data7 Non-comparative Confirmation and Catch-Alls8 Climate Science Example: Non-comparative Confirmation and Catch-Alls in Practice9 Concluding Remarks. (shrink)

"Partial realism" is a common position in the contemporary philosophy of science literature. It states that the "essential" elements of empirically successful scientific theories accurately represent corresponding features the world. This thesis makes several novel contributions related to this position. Firstly, it offers a new definition of the concept of “empirical success”, representing a principled merger between the use-novelty and unification accounts. Secondly, it provides a comparative critical analysis of various accounts of which elements are "essential" to the success of (...) a theory, including structural realism and the divide et impera strategy. A novel account of essentialness, entitled the “empirically successful sub-theory "account", is defended. Thirdly, it is argued that the realism/anti-realism debate should put to the side metaphysical questions and focus instead on partial realism's commitment to the continuity of science. Because this commitment lacks metaphysical implications, it is referred to as "deflationary realism". Anti-realists cannot reject deflationary realism as a matter of a priori principle; its overall viability can therefore only be assessed by a careful examination of the history of science. Finally, another consequence of partial realism, named "partial rationalism", is defended. Partial rationalism states that, in cases where several competing theories have been suggested, scientists are rational just in case they accept the essential elements of each of the scientific theories on offer. This novel position subverts the existing literature on scientific "revolutions", as it sometimes demands that scientists devise a synthesis between competing scientific theories, instead of "choosing" only one. The philosophical points defended in this thesis are illustrated and supported by case studies from the history of science, including Fresnel’s wave theory of light, the Copernican revolution, the "neo-Darwinian synthesis" in evolutionary biology, the "prion revolution" in molecular biology, the miasma theory of disease, and the chemical revolution. (shrink)

This paper looks at an appeal to the authority of biomedical research that has recently been used by empirical economists to motivate and justify their methods. I argue that those who make this appeal mistake the nature of biomedical research. Randomised trials, which are said to have revolutionised biomedical research, are a central methodology, but according to only one paradigm. There is another paradigm at work in biomedical research, the inferentialist paradigm, in which randomised trials play no special role. I (...) outline the inferentialist alternative in broad strokes, apply it to a recent controversy in econometrics and draw some general conclusions concerning econometric methodology. (shrink)

A common intuition about evidence is that if data x have been used to construct a hypothesis H, then x should not be used again in support of H. It is no surprise that x fits H, if H was deliberately constructed to accord with x. The question of when and why we should avoid such “double-counting” continues to be debated in philosophy and statistics. It arises as a prohibition against data mining, hunting for significance, tuning on the signal, and (...) ad hoc hypotheses, and as a preference for predesignated hypotheses and “surprising” predictions. I have argued that it is the severity or probativeness of the test—or lack of it—that should determine whether a double-use of data is admissible. I examine a number of surprising ambiguities and unexpected facts that continue to bedevil this debate. (shrink)