The growing range of methods for statistical model selection is inspiring new debates about how to handle the potential for conflicting results when different methods are applied to the same data. While many factors enter into choosing a model selection method, we focus on the implications of disagreements among scientists about whether, and in what sense, the true probability distribution is included in the candidate set of models. While this question can be addressed empirically, the data often provide inconclusive results (...) in practice. In such cases, we argue that differences in prior metaphysical views about the local adequacy of the models can produce underdetermination of results, even for the same data and candidate models. As a result, data alone are sometimes insufficient to settle rational beliefs about nature. (shrink)

I discuss the philosophical significance of the statistical model selection criteria, in particular their relevance for philosophical of underdetermination. I present an easily comprehensible account of their simplest possible application and contrast it with their application to curve-fitting problems. I embed philosophers' earlier discussion concerning the situations in which the criteria yield implausible results into a more general framework. Among other things, I discuss a difficulty which is related to the so-called subfamily problem, and I show that it has analogies (...) in all legitimate applications of the model selection criteria, and that an analogy of Goodman's new riddle of induction can be formulated in only some of their applications. (shrink)

This thesis has two goals. Firstly, we consider the problem of model selection for the purposes of prediction. In modern science predictive mathematical models are ubiquitous and can be found in such diverse fields as weather forecasting, economics, ecology, mathematical psychology, sociology, etc. It is often the case that for a given domain of inquiry there are several plausible models, and the issue then is how to discriminate between them – this is the problem of model selection. We consider approaches (...) to model selection that are used in classical [also known as frequentist] statistics, and fashionable in recent years methods of Akaike Information Criterion [AIC] and Bayes Information Criterion [BIC], the latter being a part of a broader Bayesian approach. We show the connection between AIC and BIC, and provide comparison of performance of these methods. Secondly, we consider some philosophical arguments that arise within the setting of the model selection approaches investigated in the first part. These arguments aim to provide counterexamples to the epistemic thesis of scientific realism, viz., that predictively successful scientific theories are approximately true, and to the idea that truth and predictive accuracy go together. We argue for the following claims: 1) that none of the criticisms brought forward in the philosophical literature against the AIC methodology are devastating, and AIC remains a viable method of model selection; 2) that the BIC methodology likewise survives the numerous criticisms; 3) that the counterexamples to scientific realism that ostensibly arise within the framework of model selection are flawed; 4) that in general the model selection methods discussed in this thesis are neutral with regards to the issue of scientific realism; 5) that a plurality of methodologies should be applied to the problem of model selection with full awareness of the foundational issues that each of these methodologies has. (shrink)