Claims that science should be more democratic than it is frequently arouse opposition. In this essay, I distinguish my own views about the democratization of science from the more ambitious theses defended by Paul Feyerabend. I argue that it is unlikely that the complexity of some scientific debates will allow for resolution according to the methodological principles of any formal confirmation theory, suggesting instead that major revolutions rest on conflicts of values. Yet these conflicts should not be dismissed as irresoluble.

In this paper, we explore the extent to which issues of simulation model validation take on novel characteristics when the models in question become particularly complex. Our central claim is that complex simulation models in general, and global models of climate in particular, face a form of confirmation holism. This holism, moreover, makes analytic understanding of complex models of climate either extremely difficult or even impossible. We argue that this supports a position we call convergence skepticism: the belief that the (...) existence of a plurality of different models making a plurality of different forecasts of future climate is likely to be a persistent feature of global climate science. (shrink)

Introduction -- Sanctioning models : theories and their scope -- Methodology for a virtual world -- A tale of two methods -- When theories shake hands -- Models of climate : values and uncertainties -- Reliability without truth -- Conclusion.

Science's priority rule rewards those who are first to make a discovery, at the expense of all other scientists working towards the same goal, no matter how close they may be to making the same discovery. I propose an explanation of the priority rule that, better than previous explanations, accounts for the distinctive features of the rule. My explanation treats the priority system, and more generally, any scheme of rewards for scientific endeavor, as a device for achieving an allocation of (...) resources among different research programs that provides as much benefit as possible to society. I show that the priority system is especially well suited to finding an efficient allocation of resources in those situations, characteristic of scientific inquiry, in which any success in an endeavor subsequent to the first success brings little additional benefit to society. (shrink)

During the last three decades, reflections on the growth of scientific knowledge have inspired historians, sociologists, and some philosophers to contend that scientific objectivity is a myth. In this book, Kitcher attempts to resurrect the notions of objectivity and progress in science by identifying both the limitations of idealized treatments of growth of knowledge and the overreactions to philosophical idealizations. Recognizing that science is done not by logically omniscient subjects working in isolation, but by people with a variety of personal (...) and social interests, who cooperate and compete with one another, he argues that, nonetheless, we may conceive the growth of science as a process in which both our vision of nature and our ways of learning more about nature improve. Offering a detailed picture of the advancement of science, he sets a new agenda for the philosophy of science and for other "science studies" disciplines. (shrink)

How should one react when one has a belief, but knows that other people—who have roughly the same evidence as one has, and seem roughly as likely to react to it correctly—disagree? This paper argues that the disagreement of other competent inquirers often requires one to be much less confident in one’s opinions than one would otherwise be.

How should one react when one has a belief, but knows that other people—who have roughly the same evidence as one has, and seem roughly as likely to react to it correctly—disagree? This paper argues that the disagreement of other competent inquirers often requires one to be much less confident in one’s opinions than one would otherwise be.

Even though the philosophy of simulation is intended as a comprehensive reflection about the practice of computer simulation in contemporary science, its output has been disproportionately shaped by research on equation-based simulation in the physical and climate sciences. Hence, the particularities of alternative practices of computer simulation in other scientific domains are not sufficiently accounted for in the current philosophy of simulation literature. This article centres on agent-based social simulation, a relatively established type of simulation in the social sciences, to (...) exemplify this claim. The analysis advanced has a twofold goal. First, it shows that the philosophy of agent-based social simulation, mostly developed by practitioners themselves, is, on one hand, heavily influenced by the methodological features of agent-based modelling and by the loose and fragmented character of social theory and, on the other hand, distinctively shaped by contrasting views of what it implies to do social research with virtual or artificial societies. Second, it suggests ways in which cross-fertilisation could enrich the philosophical understanding of computer simulation both in agent-based social simulation and in the philosophy of simulation. (shrink)

Can computer simulation results be evidence for hypotheses about real-world systems and phenomena? If so, what sort of evidence? Can we gain genuinely new knowledge of the world via simulation? I argue that evidence from computer simulation is aptly characterized as higher-order evidence: it is evidence that other evidence regarding a hypothesis about the world has been collected. Insofar as particular epistemic agents do not have this other evidence, it is possible that they will gain genuinely new knowledge of the (...) world via simulation. I illustrate with examples inspired by uses of simulation in meteorology and astrophysics. (shrink)

Drawing on ‘interpretational’ accounts of scientific representation, I argue that the use of so-called ‘toy models’ provides no particular philosophical puzzle. More specifically; I argue that once one gives up the idea that models are accurate representations of their targets only if they are appropriately similar, then simple and highly idealized models can be accurate in the same way that more complex models can be. Their differences turn on trading precision for generality, but, if they are appropriately interpreted, toy models (...) should nevertheless be considered accurate representations. A corollary of my discussion is a novel way of thinking about idealization more generally: idealized models may distort features of their targets, but they needn’t misrepresent them. (shrink)

ABSTRACTIn his recent book, Rodrik [. Economics rules. Why economics works, when it fails, and how to tell the difference. Oxford University Press] proposes an account of model pluralism according to which multiple models of the same target are acceptable as long as one model is more useful for one purpose and another is more useful for another purpose. How, then, is the right model for the purpose selected? Rodrik roughly outlines a selection procedure, which we formalize to enhance understanding (...) of his account of model pluralism and to advance the critical discussion. (shrink)

In Economics Rules, Dani Rodrik (2015) argues that what makes economics powerful despite the limitations of each and every model is its diversity of models. Rodrik suggests that the diversity of models in economics improves its explanatory capacities, but he does not fully explain how. I offer a clearer picture of how models relate to explanations of particular economic facts or events, and suggest that the diversity of models is a means to better economic explanations.

We call attention to an underappreciated way in which non-epistemic values influence evidence evaluation in science. Our argument draws upon some well-known features of scientific modeling. We show that, when scientific models stand in for background knowledge in Bayesian and other probabilistic methods for evidence evaluation, conclusions can be influenced by the non-epistemic values that shaped the setting of priorities in model development. Moreover, it is often infeasible to correct for this influence. We further suggest that, while this value influence (...) is not particularly prone to the problem of wishful thinking, it could have problematic non-epistemic consequences in some cases. (shrink)

Real-world economies are open-ended dynamic systems consisting of heterogeneous interacting participants. Human participants are decision-makers who strategically take into account the past actions and potential future actions of other participants. All participants are forced to be locally constructive, meaning their actions at any given time must be based on their local states; and participant actions at any given time affect future local states. Taken together, these essential properties imply real-world economies are locally-constructive sequential games. This paper discusses a modeling approach, (...) Agent-based Computational Economics, that permits researchers to study economic systems from this point of view. ACE modeling principles and objectives are first concisely presented and explained. The remainder of the paper then highlights challenging issues and edgier explorations that ACE researchers are currently pursuing. (shrink)

Scientific discourse is rife with passages that appear to be ordinary descriptions of systems of interest in a particular discipline. Equally, the pages of textbooks and journals are filled with discussions of the properties and the behavior of those systems. Students of mechanics investigate at length the dynamical properties of a system consisting of two or three spinning spheres with homogenous mass distributions gravitationally interacting only with each other. Population biologists study the evolution of one species procreating at a constant (...) rate in an isolated ecosystem. And when studying the exchange of goods, economists consider a situation in which there are only two goods, two perfectly rational agents, no restrictions on available information, no transaction costs, no money, and dealings are done immediately. Their surface structure notwithstanding, no competent scientist would mistake descriptions of such systems as descriptions of an actual system: we know very well that there are no such systems. These descriptions are descriptions of a model-system, and scientists use model-systems to represent parts or aspects of the world they are interested in. Following common practice, I refer to those parts or aspects as target-systems. What are we to make of this? Is discourse about such models merely a picturesque and ultimately dispensable façon de parler? This was the view of some early twentieth century philosophers. Duhem (1906) famously guarded against confusing model building with scientific theorizing and argued that model building has no real place in science, beyond a minor heuristic role. The aim of science was, instead, to construct theories, with theories understood as classificatory or representative structures systematically presented and formulated in precise symbolic.. (shrink)

In an attempt to determine the epistemic status of computer simulation results, philosophers of science have recently explored the similarities and differences between computer simulations and experiments. One question that arises is whether and, if so, when, simulation results constitute novel empirical data. It is often supposed that computer simulation results could never be empirical or novel because simulations never interact with their targets, and cannot go beyond their programming. This paper argues against this position by examining whether, and under (...) what conditions, the features of empiricality and novelty could be displayed by computer simulation data. I show that, to the extent that certain familiar measurement results have these features, so can some computer simulation results. (shrink)

Using an example of a computer simulation of the convective structure of a red giant star, this paper argues that simulation is a rich inferential process, and not simply a “number crunching” technique. The scientific practice of simulation, moreover, poses some interesting and challenging epistemological and methodological issues for the philosophy of science. I will also argue that these challenges would be best addressed by a philosophy of science that places less emphasis on the representational capacity of theories and more (...) emphasis on the role of theory in guiding the construction of models. (shrink)

It is argued that one can learn from minimal economic models. Minimal models are models that are not similar to the real world, do not resemble some of its features, and do not adhere to accepted regularities. One learns from a model if constructing and analysing the model affects one’s confidence in hypotheses about the world. Economic models, I argue, are often assessed for their credibility. If a model is judged credible, it is considered to be a relevant possibility. Considering (...) such relevant possibilities may affect one’s confidence in necessity or impossibility hypotheses. Thus, one can learn from minimal economic models. (shrink)

This paper aims to identify the key characteristics of model organisms that make them a specific type of model within the contemporary life sciences: in particular, we argue that the term “model organism” does not apply to all organisms used for the purposes of experimental research. We explore the differences between experimental and model organisms in terms of their material and epistemic features, and argue that it is essential to distinguish between their representational scope and representational target. We also examine (...) the characteristics of the communities who use these two types of models, including their research goals, disciplinary affiliations, and preferred practices to show how these have contributed to the conceptualization of a model organism. We conclude that model organisms are a specific subgroup of organisms that have been standardized to fit an integrative and comparative mode of research, and that it must be clearly distinguished from the broader class of experimental organisms. In addition, we argue that model organisms are the key components of a unique and distinctively biological way of doing research using models.Keywords: Experimental organism; Genetics; Model organism; Modeling; Philosophy of biology; Representation. (shrink)

Virtually everything we know depends in some way or other on the testimony of others—what we eat, how things work, where we go, even who we are. We do not, after all, perceive firsthand the preparation of the ingredients in many of our meals, or the construction of the devices we use to get around the world, or the layout of our planet, or our own births and familial histories. These are all things we are told. Indeed, subtracting from our (...) lives the information that we possess via testimony leaves them barely recognizable. Scientific discoveries, battles won and lost, geographical developments, customs and traditions of distant lands—all of these facts would be completely lost to us. It is, therefore, no surprise that the importance of testimony, both epistemological and practical, is nearly universally accepted. Less consensus, however, is found when questions about the nature and extent of our dependence on the word of others arise. Is our justified reliance on testimony fundamentally basic, for instance, or is it ultimately reducible to perception, memory, and reason? Is trust, or some related interpersonal feature of our social interaction with one another, essential to the acquisition of beliefs that are testimonially justified? Is testimonial knowledge necessarily acquired through transmission from speaker to hearer? Can testimony generate epistemic features in its own right? These are the questions that will be taken up in this paper and, as will become clear, their answers have far-reaching consequences for how we understand our place in the social world. (shrink)

Despite their best efforts, scientists may be unable to construct models that simultaneously exemplify every theoretical virtue. One explanation for this is the existence of tradeoffs: relationships of attenuation that constrain the extent to which models can have such desirable qualities. In this paper, we characterize three types of tradeoffs theorists may confront. These characterizations are then used to examine the relationships between parameter precision and two types of generality. We show that several of these relationships exhibit tradeoffs and discuss (...) what consequences those tradeoffs have for theoretical practice. (shrink)

Like other mathematically intensive sciences, economics is becoming increasingly computerized. Despite the extent of the computation, however, there is very little true simulation. Simple computation is a form of theory articulation, whereas true simulation is analogous to an experimental procedure. Successful computation is faithful to an underlying mathematical model, whereas successful simulation directly mimics a process or a system. The computer is seen as a legitimate tool in economics only when traditional analytical solutions cannot be derived, i.e., only as a (...) purely computational aid. We argue that true simulation is seldom practiced because it does not fit the conception of understanding inherent in mainstream economics. According to this conception, understanding is constituted by analytical derivation from a set of fundamental economic axioms. We articulate this conception using the concept of economists' perfect model. Since the deductive links between the assumptions and the consequences are not transparent in ‘bottom‐up’ generative microsimulations, microsimulations cannot correspond to the perfect model and economists do not therefore consider them viable candidates for generating theories that enhance economic understanding. (shrink)

There are numerous sources of error and uncertaintyUncertainty in modeling and simulation. Some of these sources arise because of inherent randomness existing in the system of interest, while others arise due to incomplete knowledge on the part of the person conducting the modeling and simulation activity. Other sources arise due to the fact that all models are imperfect reflections of reality. Finally, when models are sufficiently complex to require approximate numerical solutions, then the numerical approximationsApproximation provide an additional source of (...) error and uncertainty. This chapter discusses these different sources of error and uncertainty as well as methods to characterize and treat them. Techniques for rolling up these different uncertaintyUncertainty sources into a total predictionPrediction uncertainty are briefly discussed. (shrink)

This chapter proposes benchmarking as an important, versatile and promising method in the process of validating simulation models with an empirical target. This excludes simulation models which only explore consequences of theoretical assumptions. A conceptual framework and descriptive theory of benchmarking in simulation validation is developed. Sources of benchmarks are outstanding experimental or observational dataObservational data, stylized facts or other characteristics of the target. They are outstanding because they are more effective, more reliable or more efficient than other such data, (...) stylized factsStylized fact or characteristics. BenchmarksBenchmark are set in a benchmarking process which offers a pathway to support the establishment of norms and standardsStandard in simulation validation. Benchmarks are indispensable in maintaining large simulation systems, e.g. for automatic quality checking of large-scale forecasts and when forecasting system upgrades are made. (shrink)

It has been argued that the Duhem problem is renewed with computational models since model assumptions having a representational aim and computational assumptions cannot be tested in isolation. In particular, while the Verification and Validation methodology is supposed to prevent such holism, Winsberg argues that verification and validation cannot be separated in practice. Morrison replies that Winsberg overstates the entanglement between the steps. The paper aims at arbitrating these two positions, by stressing their respective validity in relation to domains of (...) application. It importantly argues for an increasing use of formal methods in verification, that makes disentanglement possible. (shrink)

This unique volume introduces and discusses the methods of validating computer simulations in scientific research. The core concepts, strategies, and techniques of validation are explained by an international team of pre-eminent authorities, drawing on expertise from various fields ranging from engineering and the physical sciences to the social sciences and history. The work also offers new and original philosophical perspectives on the validation of simulations. Topics and features: introduces the fundamental concepts and principles related to the validation of computer simulations, (...) and examines philosophical frameworks for thinking about validation; provides an overview of the various strategies and techniques available for validating simulations, as well as the preparatory steps that have to be taken prior to validation; describes commonly used reference points and mathematical frameworks applicable to simulation validation; reviews the legal prescriptions, and the administrative and procedural activities related to simulation validation; presents examples of best practice that demonstrate how methods of validation are applied in various disciplines and with different types of simulation models; covers important practical challenges faced by simulation scientists when applying validation methods and techniques; offers a selection of general philosophical reflections that explore the significance of validation from a broader perspective. This truly interdisciplinary handbook will appeal to a broad audience, from professional scientists spanning all natural and social sciences, to young scholars new to research with computer simulations. Philosophers of science, and methodologists seeking to increase their understanding of simulation validation, will also find much to benefit from in the text. (shrink)

The epistemology of computer simulations has become a mainstream topic in the philosophy of technology. Within this large area, significant differences hold between the various types of models and simulation technologies. Agent-based and multi-agent systems simulations introduce a specific constraint on the types of agents and systems modelled. We argue that such difference is crucial and that simulation for the artificial sciences requires the formulation of its own specific epistemological principles. We present a minimally committed epistemology which relies on the (...) methodological principles of the Philosophy of Information and requires weak assumptions on the usability of the simulation and the controllability of the model. We use these principles to provide a new definition of simulation for the context of interest. (shrink)

Research on interdisciplinary science has for the most part concentrated on the institutional obstacles that discourage or hamper interdisciplinary work, with the expectation that interdisciplinary interaction can be improved through institutional reform strategies such as through reform of peer review systems. However institutional obstacles are not the only ones that confront interdisciplinary work. The design of policy strategies would benefit from more detailed investigation into the particular cognitive constraints, including the methodological and conceptual barriers, which also confront attempts to work (...) across disciplinary boundaries. Lessons from cognitive science and anthropological studies of labs in sociology of science suggest that scientific practices may be very domain specific, where domain specificity is an essential aspect of science that enables researchers to solve complex problems in a cognitively manageable way. The limit or extent of domain specificity in scientific practice, and how it constrains interdisciplinary research, is not yet fully understood, which attests to an important role for philosophers of science in the study of interdisciplinary science. This paper draws upon two cases of interdisciplinary collaboration; those between ecologists and economists, and those between molecular biologists and systems biologists, to illustrate some of the cognitive barriers which have contributed to failures and difficulties of interactions between these fields. Each exemplify some aspect of domain specificity in scientific practice and show how such specificity may constrain interdisciplinary work. (shrink)

Empirical agreement is often used as an important criterion when assessing the validity of scientific models. However, it is by no means a sufficient criterion as a model can be so adjusted as to fit available data even though it is based on hypotheses whose plausibility is known to be questionable. Our aim in this paper is to investigate into the uses of empirical agreement within the process of model validation.

The book examines issues related to the way modeling and simulation enable us to reconstruct aspects of the world we are investigating. It also investigates the processes by which we extract concrete knowledge from those reconstructions and how that knowledge is legitimated.

This paper discusses the epistemic import of highly abstract and simplified theoretical models using Thomas Schelling’s checkerboard model as an example. We argue that the epistemic contribution of theoretical models can be better understood in the context of a cluster of models relevant to the explanatory task at hand. The central claim of the paper is that theoretical models make better sense in the context of a menu of possible explanations. In order to justify this claim, we introduce a distinction (...) between causal scenarios and causal mechanism schemes. These conceptual tools help us to articulate the basis for modelers’ intuitive confidence that their models make an important epistemic contribution. By focusing on the role of the menu of possible explanations in the evaluation of explanatory hypotheses, it is possible to understand how a causal mechanism scheme can improve our explanatory understanding even in cases where it does not describe the actual cause of a particular phenomenon. (shrink)

Using an example of a computer simulation of the convective structure of a red giant star, this paper argues that simulation is a rich inferential process, and not simply a "number crunching" technique. The scientific practice of simulation, moreover, poses some interesting and challenging epistemological and methodological issues for the philosophy of science. I will also argue that these challenges would be best addressed by a philosophy of science that places less emphasis on the representational capacity of theories (and ascribes (...) that capacity instead to models) and more emphasis on the role of theory in guiding (rather than determining) the construction of models. (shrink)

This article explores some of the roles of computer simulation in measurement. A model-based view of measurement is adopted and three types of measurement—direct, derived, and complex—are distinguished. It is argued that while computer simulations on their own are not measurement processes, in principle they can be embedded in direct, derived, and complex measurement practices in such a way that simulation results constitute measurement outcomes. Atmospheric data assimilation is then considered as a case study. This practice, which involves combining information (...) from conventional observations and simulation-based forecasts, is characterized as a complex measuring practice that is still under development. The case study reveals challenges that are likely to resurface in other measuring practices that embed computer simulation. It is also noted that some practices that embed simulation are difficult to classify; they suggest a fuzzy boundary between measurement and non-measurement. 1 Introduction2 A Contemporary View of Measurement3 Three Types of Measurement4 Can Computer Simulations Measure Real-World Target Systems?5 Case Study: Atmospheric Data Assimilation5.1 Why data assimilation?5.2 A complex measuring practice under development5.3 Epistemic iteration6 The Boundaries of Measurement7 Epistemology, Not Terminology. (shrink)

This chapter gives a sympathetic account of how one might be drawn to a constructivist and hence relativist view of justification, according to which different communities might legitimately disagree about what justificatory force to assign to any particular item of evidence.

Claims that science should be more democratic than it is frequently arouse opposition. In this essay, I distinguish my own views about the democratization of science from the more ambitious theses defended by Paul Feyerabend. I argue that it is unlikely that the complexity of some scientific debates will allow for resolution according to the methodological principles of any formal confirmation theory, suggesting instead that major revolutions rest on conflicts of values. Yet these conflicts should not be dismissed as irresoluble.

The recent discussion on scientific representation has focused on models and their relationship to the real world. It has been assumed that models give us knowledge because they represent their supposed real target systems. However, here agreement among philosophers of science has tended to end as they have presented widely different views on how representation should be understood. I will argue that the traditional representational approach is too limiting as regards the epistemic value of modelling given the focus on the (...) relationship between a single model and its supposed target system, and the neglect of the actual representational means with which scientists construct models. I therefore suggest an alternative account of models as epistemic tools. This amounts to regarding them as concrete artefacts that are built by specific representational means and are constrained by their design in such a way that they facilitate the study of certain scientific questions, and learning from them by means of construction and manipulation. (shrink)

climate scientists have been engaged in a decades-long debate over the standing of satellite measurements of the temperature trends of the atmosphere above the surface of the earth. This is especially significant because skeptics of global warming and the greenhouse effect have utilized this debate to spread doubt about global climate models used to predict future states of climate. I use this case from an under-studied science to illustrate two distinct philosophical approaches to the relation among data, scientists, measurement, models, (...) and theory. I argue that distinguishing between 'direct' empiricist and 'complex' empiricist approaches helps us understand and analyze this important scientific episode. I also introduce a complex empiricist account of testing and evaluation, and contrast it with the basic Hypothetico-Deductive approach to the climate models used by the direct empiricists. This more developed complex empiricist apporach will serve philosophy of science well, as computational models become more wide-spread in the sciences. (shrink)

In this paper, we show that reproducibility is a severe problem that concerns simulation models. The reproducibility problem challenges the concept of numerical solution and hence the conception of what a simulation actually does. We provide an expanded picture of simulation that makes visible those steps of simulation modeling that are numerically relevant, but often escape notice in accounts of simulation. Examining these steps and analyzing a number of pertinent examples, we argue that numerical solutions are importantly different from usual (...) mathematical solutions. They are do not merely approximate the latter, but introduce new problems, including issues of artificiality, stability, and well-posedness. Consequently, simulation modelling can attain reproducibility only to a certain degree because it is working with numerical solutions. (shrink)

Computer simulations are widely used in current scientific practice, as a tool to obtain information about various phenomena. Scientists accordingly rely on the outputs of computer simulations to make statements about the empirical world. In that sense, simulations seem to enable scientists to acquire empirical knowledge. The aim of this paper is to assess whether computer simulations actually allow for the production of empirical knowledge, and how. It provides an epistemological analysis of present-day empirical science, to which the traditional epistemological (...) categories cannot apply in any simple way. Our strategy consists in acknowledging the complexity of scientific practice, and trying to assess its rationality. Hence, while we are careful not to abstract away from the details of scientific practice, our approach is not strictly descriptive: our goal is to state in what conditions empirical science can rely on computer simulations. In order to do so, we need to adopt a renewed epistemological framework, whose categories would enable us to give a finer-grained, and better-fitted analysis of the rationality of scientific practice. (shrink)

A published simulation model Riolo et al. 2001 ) was replicated in two independent implementations so that the results as well as the conceptual design align. This double replication allowed the original to be analysed and critiqued with confidence. In this case, the replication revealed some weaknesses in the original model, which otherwise might not have come to light. This shows that unreplicated simulation models and their results can not be trusted - as with other kinds of experiment, simulations need (...) to be independently replicated. (shrink)