Over the past three decades, the discourse on the mechanistic approach to scientific modelling and explanation has notably sidestepped the topic of simplicity and fit within the process of model selection. This paper aims to rectify this disconnect by delving into the topic of simplicity and fit within the context of mechanistic explanations. More precisely, our primary objective is to address whether simplicity metrics hold any significance within mechanistic explanations. If they do, then our inquiry extends to the suitability of (...) the Akaike Information Criterion (AIC), the Bayesian Information Criterion (BIC), and related criteria in determining the optimal balance of fit and simplicity of mechanistic models. As our main claims, we argue that mechanistic models inherently lend themselves to considerations of simplicity, and that the AIC and BIC and related criteria are applicable to some submodels of certain kinds of mechanistic models. However, these criteria and related criteria designed for curve fitting and causal modelling are of little help for a comparative assessment of full mechanistic models, and a fundamentally different approach is needed to make determinations of this kind. (shrink)

Bayesian model selection has frequently been the focus of philosophical inquiry (e.g., Forster, Br J Philos Sci 46:399–424, 1995; Bandyopadhyay and Boik, Philos Sci 66:S390–S402, 1999; Dowe et al., Br J Philos Sci 58:709–754, 2007). This paper argues that Bayesian model selection procedures are very diverse in their inferential target and their justification, and substantiates this claim by means of case studies on three selected procedures: MML, BIC and DIC. Hence, there is no tight link between Bayesian model selection and (...) Bayesian philosophy. Consequently, arguments for or against Bayesian reasoning based on properties of Bayesian model selection procedures should be treated with great caution. (shrink)

The number of adjustable parameters in a model or hypothesis is often taken as the formal expression of its simplicity. I take issue with this `definition´ and argue that comparative simplicity has a quasi-empirical measure, reflecting experts’ judgements who track past use of a model-type in or across domains. Since models are represented by restricted sets of functions in a suitable space, formally speaking, a general `measure of simplicity´ may be defined implicitly for the elements of a function space. This (...) paper sketches such a framework starting from intuitive constraints. It is shown how experts’ judgements feed into this framework and how the usual definition can be recovered. A theorem by H. Akaike in the theory of model-choice has recently been used to shine new light on the relationship between the demand for simplicity and empirical success, or even `truth´. The approach favored here permits an alternative answer based on a reliabilist account of justification: if judgements of simplicity track past successful use of a model-type comparative simplicity is evidential and inductive. (shrink)

We introduce a distinction, unnoticed in the literature, between four varieties of objective Bayesianism. What we call ' strong objective Bayesianism' is characterized by two claims, that all scientific inference is 'logical' and that, given the same background information two agents will ascribe a unique probability to their priors. We think that neither of these claims can be sustained; in this sense, they are 'dogmatic'. The first fails to recognize that some scientific inference, in particular that concerning evidential relations, is (...) not (in the appropriate sense) logical, the second fails to provide a non-question-begging account of 'same background information'. We urge that a suitably objective Bayesian account of scientific inference does not require either of the claims. Finally, we argue that Bayesianism needs to be fine-grained in the same way that Bayesians fine-grain their beliefs. (shrink)

The underdetermination thesis poses a threat to rational choice of scientific theories. We discuss two arguments for the thesis. One draws its strength from deductivism together with the existence thesis, and the other is defended on the basis of the failure of a reliable inductive method. We adopt a partially subjective/objective pragmatic Bayesian epistemology of science framework, and reject both arguments for the thesis. Thus, in science we are able to reinstate rational choice called into question by the underdetermination thesis.

The notion of a severe test has played an important methodological role in the history of science. But it has not until recently been analyzed in any detail. We develop a generally Bayesian analysis of the notion, compare it with Deborah Mayo’s error-statistical approach by way of sample diagnostic tests in the medical sciences, and consider various objections to both. At the core of our analysis is a distinction between evidence and confirmation or belief. These notions must be kept separate (...) if mistakes are to be avoided; combined in the right way, they provide an adequate understanding of severity. Those who think that the weight of the evidence always enables you to choose between hypotheses “ignore one of the factors (the prior probability) altogether, and treat the other (the likelihood) as though it ...meant something other than it actually does. This is the same mistake as is made by someone who has scruples about measuring the arms of a balance (having only a tape measure at his disposal ...), but is willing to assert that the heavier load will always tilt the balance (thereby implicitly assuming, although without admitting it, that the arms are of equal length!). (Bruno de Finetti, Theory of Probability)2. (shrink)

This book examines the philosophical conception of abductive reasoning as developed by Charles S. Peirce, the founder of American pragmatism. It explores the historical and systematic connections of Peirce's original ideas and debates about their interpretations. Abduction is understood in a broad sense which covers the discovery and pursuit of hypotheses and inference to the best explanation. The analysis presents fresh insights into this notion of reasoning, which derives from effects to causes or from surprising observations to explanatory theories. The (...) author outlines some logical and AI approaches to abduction as well as studies various kinds of inverse problems in astronomy, physics, medicine, biology, and human sciences to provide examples of retroductions and abductions. The discussion covers also everyday examples with the implication of this notion in detective stories, one of Peirce’s own favorite themes. The author uses Bayesian probabilities to argue that explanatory abduction is a method of confirmation. He uses his own account of truth approximation to reformulate abduction as inference which leads to the truthlikeness of its conclusion. This allows a powerful abductive defense of scientific realism. This up-to-date survey and defense of the Peircean view of abduction may very well help researchers, students, and philosophers better understand the logic of truth-seeking. (shrink)

Unsupervised learning algorithms are widely used for many important statistical tasks with numerous applications in science and industry. Yet despite their prevalence, they have attracted remarkably little philosophical scrutiny to date. This stands in stark contrast to supervised and reinforcement learning algorithms, which have been widely studied and critically evaluated, often with an emphasis on ethical concerns. In this article, I analyze three canonical unsupervised learning problems: clustering, abstraction, and generative modeling. I argue that these methods raise unique epistemological and (...) ontological questions, providing data-driven tools for discovering natural kinds and distinguishing essence from contingency. This analysis goes some way toward filling the lacuna in contemporary philosophical discourse on unsupervised learning, as well as bringing conceptual unity to a heterogeneous field more often described by what it isnot(i.e., supervised or reinforcement learning) than by what itis. I submit that unsupervised learning is not just a legitimate subject of philosophical inquiry but perhaps the most fundamental branch of all AI. However, an uncritical overreliance on unsupervised methods poses major epistemic and ethical risks. I conclude by advocating for a pragmatic, error-statistical approach that embraces the opportunities and mitigates the challenges posed by this powerful class of algorithms. (shrink)

Model simplicity in curve fitting is the fewness of parameters estimated. I use a vector model of least squares estimation to show that degrees of freedom, the difference between the number of observed parameters fit by the model and the number of explanatory parameters estimated, are the number of potential dimensions in which data are free to differ from a model and indicate the disconfirmability of the model. Though often thought to control for parameter estimation, the AIC and similar indices (...) do not do so for all model applications, while goodness of fit indices like chi-square, which explicitly take into account degrees of freedom, do. Hypothesis testing with prespecified values for parameters is based on a metaphoric regulative subject/object schema taken from object perception and has as its goal the accumulation of objective knowledge. (shrink)