Current theories of the division of cognitive labor are confined to the “context of justification,” assuming exogenous theories. But new theories are made from the same labor that is used for developing existing theories, and if none of this labor is ever allocated to create new alternatives, then scientific progress is impossible. A unified model is proposed in which theories are no longer given but a function of the division of labor in the model itself. The interactions of individuals balancing (...) the exploitation of existing theories and the exploration of new theories results in a robust cyclical pattern. (shrink)

Recent studies of scientific interaction based on agent-based models suggest that a crucial factor conducive to efficient inquiry is what Zollman has dubbed ‘transient diversity’. It signifies a process in which a community engages in parallel exploration of rivaling theories lasting sufficiently long for the community to identify the best theory and to converge on it. But what exactly generates transient diversity? And is transient diversity a decisive factor when it comes to the efficiency of inquiry? In this paper we (...) examine the impact of different conditions on the efficiency of inquiry, as well as the relation between diversity and efficiency. This includes certain diversity-generating mechanisms previously proposed in the literature, as well as some factors that have so far been neglected. This study is obtained via an argumentation-based ABM. Our results suggest that cautious decision-making does not always have a significant impact on the efficiency of inquiry while different evaluations underlying theory-choice and different social networks do. Moreover, we find a correlation between diversity and a successful performance of agents only under specific conditions, which indicates that transient diversity is sometimes not the primary factor responsible for efficiency. Altogether, when comparing our results to those obtained by structurally different ABMs based on Zollman’s work, the impact of specific factors on efficiency of inquiry, as well as the role of transient diversity in achieving efficiency, appear to be highly dependent on the underlying model. (shrink)

Recent studies of scientific interaction based on agent-based models suggest that a crucial factor conducive to efficient inquiry is what Zollman has dubbed ‘transient diversity’. It signifies a process in which a community engages in parallel exploration of rivaling theories lasting sufficiently long for the community to identify the best theory and to converge on it. But what exactly generates transient diversity? And is transient diversity a decisive factor when it comes to the efficiency of inquiry? In this paper we (...) examine the impact of different conditions on the efficiency of inquiry, as well as the relation between diversity and efficiency. This includes certain diversity-generating mechanisms previously proposed in the literature, as well as some factors that have so far been neglected. This study is obtained via an argumentation-based ABM. Our results suggest that cautious decision-making does not always have a significant impact on the efficiency of inquiry while different evaluations underlying theory-choice and different social networks do. Moreover, we find a correlation between diversity and a successful performance of agents only under specific conditions, which indicates that transient diversity is sometimes not the primary factor responsible for efficiency. Altogether, when comparing our results to those obtained by structurally different ABMs based on Zollman’s work, the impact of specific factors on efficiency of inquiry, as well as the role of transient diversity in achieving efficiency, appear to be highly dependent on the underlying model. (shrink)

This unique volume introduces and discusses the methods of validating computer simulations in scientific research. The core concepts, strategies, and techniques of validation are explained by an international team of pre-eminent authorities, drawing on expertise from various fields ranging from engineering and the physical sciences to the social sciences and history. The work also offers new and original philosophical perspectives on the validation of simulations. Topics and features: introduces the fundamental concepts and principles related to the validation of computer simulations, (...) and examines philosophical frameworks for thinking about validation; provides an overview of the various strategies and techniques available for validating simulations, as well as the preparatory steps that have to be taken prior to validation; describes commonly used reference points and mathematical frameworks applicable to simulation validation; reviews the legal prescriptions, and the administrative and procedural activities related to simulation validation; presents examples of best practice that demonstrate how methods of validation are applied in various disciplines and with different types of simulation models; covers important practical challenges faced by simulation scientists when applying validation methods and techniques; offers a selection of general philosophical reflections that explore the significance of validation from a broader perspective. This truly interdisciplinary handbook will appeal to a broad audience, from professional scientists spanning all natural and social sciences, to young scholars new to research with computer simulations. Philosophers of science, and methodologists seeking to increase their understanding of simulation validation, will also find much to benefit from in the text. (shrink)

We argue that the appraisal of models in social epistemology requires conceiving of them as argumentative devices, taking into account the argumentative context and adopting a family-of-models perspective. We draw up such an account and show how it makes it easier to see the value and limits of the use of models in social epistemology. To illustrate our points, we document and explicate the argumentative role of epistemic landscape models in social epistemology and highlight their limitations. We also claim that (...) our account could be fruitfully used in appraising other models in philosophy and science. (shrink)

This paper tries to answer the question why the epistemic value of so many social simulations is questionable. I consider the epistemic value of a social simulation as questionable if it contributes neither directly nor indirectly to the understanding of empirical reality. To examine this question, two classical social simulations are analyzed with respect to their possible epistemic justification: Schelling’s neighborhood segregation model and Axelrod’s reiterated Prisoner’s Dilemma simulations of the evolution of cooperation. It is argued that Schelling’s simulation is (...) useful because it can be related to empirical reality, while Axelrod’s simulations and those of his followers cannot and thus that their scientific value remains doubtful. I relate this findingto the background beliefs of modelers about the superiority of the modeling method as expressed in Joshua Epstein’s keynote address “Why model?”. (shrink)

Employing computer simulations for the study of the evolution of altruism has been popular since Axelrod's book "The Evolution of Cooperation". But have the myriads of simulation studies that followed in Axelrod's footsteps really increased our knowledge about the evolution of altruism or cooperation? This book examines in detail the working mechanisms of simulation based evolutionary explanations of altruism. It shows that the "theoretical insights" that can be derived from simulation studies are often quite arbitrary and of little use for (...) the empirical research. In the final chapter of the book, therefore, a set of epistemological requirements for computer simulations is proposed and recommendations for the proper research design of simulation studies are made. (shrink)

This article examines two questions about scientists’ search for knowledge. First, which search strategies generate discoveries effectively? Second, is it advantageous to diversify search strategies? We argue pace Weisberg and Muldoon, “Epistemic Landscapes and the Division of Cognitive Labor”, that, on the first question, a search strategy that deliberately seeks novel research approaches need not be optimal. On the second question, we argue they have not shown epistemic reasons exist for the division of cognitive labor, identifying the errors that led (...) to their conclusions. Furthermore, we generalize the epistemic landscape model, showing that one should be skeptical about the benefits of social learning in epistemically complex environments. (shrink)

Knowledge and its Limits presents a systematic new conception of knowledge as a kind of mental stage sensitive to the knower's environment. It makes a major contribution to the debate between externalist and internalist philosophies of mind, and breaks radically with the epistemological tradition of analyzing knowledge in terms of true belief. The theory casts new light on such philosophical problems as scepticism, evidence, probability and assertion, realism and anti-realism, and the limits of what can be known. The arguments are (...) illustrated by rigorous models based on epistemic logic and probability theory. The result is a new way of doing epistemology and a notable contribution to the philosophy of mind. (shrink)

Increasingly, epistemologists are becoming interested in social structures and their effect on epistemic enterprises, but little attention has been paid to the proper distribution of experimental results among scientists. This paper will analyze a model first suggested by two economists, which nicely captures one type of learning situation faced by scientists. The results of a computer simulation study of this model provide two interesting conclusions. First, in some contexts, a community of scientists is, as a whole, more reliable when its (...) members are less aware of their colleagues' experimental results. Second, there is a robust tradeoff between the reliability of a community and the speed with which it reaches a correct conclusion. ‡The author would like to thank Brian Skyrms, Kyle Stanford, Jeffrey Barrett, Bruce Glymour, and the participants in the Social Dynamics Seminar at University of California–Irvine for their helpful comments. Generous financial support was provided by the School of Social Science and Institute for Mathematical Behavioral Sciences at UCI. †To contact the author, please write to: Department of Philosophy, Baker Hall 135, Carnegie Mellon University, Pittsburgh, PA 15213-3890; e-mail: [email protected]. (shrink)

There is growing interest in understanding and eliciting division of labor within groups of scientists. This paper illustrates the need for this division of labor through a historical example, and a formal model is presented to better analyze situations of this type. Analysis of this model reveals that a division of labor can be maintained in two different ways: by limiting information or by endowing the scientists with extreme beliefs. If both features are present however, cognitive diversity is maintained indefinitely, (...) and as a result agents fail to converge to the truth. Beyond the mechanisms for creating diversity suggested here, this shows that the real epistemic goal is not diversity but transient diversity. (shrink)

This paper discusses the epistemic import of highly abstract and simplified theoretical models using Thomas Schelling’s checkerboard model as an example. We argue that the epistemic contribution of theoretical models can be better understood in the context of a cluster of models relevant to the explanatory task at hand. The central claim of the paper is that theoretical models make better sense in the context of a menu of possible explanations. In order to justify this claim, we introduce a distinction (...) between causal scenarios and causal mechanism schemes. These conceptual tools help us to articulate the basis for modelers’ intuitive confidence that their models make an important epistemic contribution. By focusing on the role of the menu of possible explanations in the evaluation of explanatory hypotheses, it is possible to understand how a causal mechanism scheme can improve our explanatory understanding even in cases where it does not describe the actual cause of a particular phenomenon. (shrink)

Because of its complexity, contemporary scientific research is almost always tackled by groups of scientists, each of which works in a different part of a given research domain. We believe that understanding scientific progress thus requires understanding this division of cognitive labor. To this end, we present a novel agent-based model of scientific research in which scientists divide their labor to explore an unknown epistemic landscape. Scientists aim to climb uphill in this landscape, where elevation represents the significance of the (...) results discovered by employing a research approach. We consider three different search strategies scientists can adopt for exploring the landscape. In the first, scientists work alone and do not let the discoveries of the community as a whole influence their actions. This is compared with two social research strategies, which we call the follower and maverick strategies. Followers are biased towards what others have already discovered, and we find that pure populations of these scientists do less well than scientists acting independently. However, pure populations of mavericks, who try to avoid research approaches that have already been taken, vastly outperform both of the other strategies. Finally, we show that in mixed populations, mavericks stimulate followers to greater levels of epistemic production, making polymorphic populations of mavericks and followers ideal in many research domains. (shrink)

In their recent book, Oreskes and Conway describe the ‘tobacco strategy’, which was used by the tobacco industry to influence policymakers regarding the health risks of tobacco products. The strategy involved two parts, consisting of promoting and sharing independent research supporting the industry’s preferred position and funding additional research, but selectively publishing the results. We introduce a model of the tobacco strategy, and use it to argue that both prongs of the strategy can be extremely effective—even when policymakers rationally update (...) on all evidence available to them. As we elaborate, this model helps illustrate the conditions under which the tobacco strategy is particularly successful. In addition, we show how journalists engaged in ‘fair’ reporting can inadvertently mimic the effects of industry on public belief. 1Introduction2Epistemic Network Models3Selective Sharing4Biased Production5Journalists as Unwitting Propagandists6ConclusionAppendix. (shrink)

One puzzle concerning highly idealized models is whether they explain. Some suggest they provide so-called ‘how-possibly explanations’. However, this raises an important question about the nature of how-possibly explanations, namely what distinguishes them from ‘normal’, or how-actually, explanations? I provide an account of how-possibly explanations that clarifies their nature in the context of solving the puzzle of model-based explanation. I argue that the modal notions of actuality and possibility provide the relevant dividing lines between how-possibly and how-actually explanations. Whereas how-possibly (...) explanations establish claims of possible explanations, how-actually explanations establish claims of actual ones. Models, in turn, simply provide evidence for these claims. (shrink)

This paper presents an account of how to evaluate formal models of science: models and simulations in social epistemology designed to draw normative conclusions about the social structure of scientific research. I argue that such models should be evaluated according to their representational and predictive accuracy. Using these criteria and comparisons with familiar models from science, I argue that most formal models of science are incapable of supporting normative conclusions.

We show that previous results from epistemic network models showing the benefits of decreased connectivity in epistemic networks are not robust across changes in parameter values. Our findings motivate discussion about whether and how such models can inform real-world epistemic communities. As we argue, only robust results from epistemic network models should be used to generate advice for the real-world, and, in particular, decreasing connectivity is a robustly poor recommendation.

When should a scientific community be cognitively diverse? This article presents a model for studying how the heterogeneity of learning heuristics used by scientist agents affects the epistemic efficiency of a scientific community. By extending the epistemic landscapes modeling approach introduced by Weisberg and Muldoon, the article casts light on the micro-mechanisms mediating cognitive diversity, coordination, and problem-solving efficiency. The results suggest that social learning and cognitive diversity produce epistemic benefits only when the epistemic community is faced with problems of (...) sufficient difficulty. (shrink)

Contemporary societies are often “polarized”, in the sense that sub-groups within these societies hold stably opposing beliefs, even when there is a fact of the matter. Extant models of polarization do not capture the idea that some beliefs are true and others false. Here we present a model, based on the network epistemology framework of Bala and Goyal, 784–811 1998), in which polarization emerges even though agents gather evidence about their beliefs, and true belief yields a pay-off advantage. As we (...) discuss, these results are especially relevant to polarization in scientific communities, for these reasons. The key mechanism that generates polarization involves treating evidence generated by other agents as uncertain when their beliefs are relatively different from one’s own. (shrink)

Science is a social epistemic enterprise. The complexity of research requires the division of cognitive labor. As a consequence, scientists have to present results and incorporate the results of others into their body of knowledge. This creates the possibility of strategic behavior, leading to phenomena such as publication bias. To analyze the dynamics of strategic behavior in epistemic communities, agent-based modeling suggests itself as a method. The phenomena generated by the developed agent-based simulation model reveal a diverse set of possible (...) dynamics in strategically heterogeneous groups and support the claim that there is a trade-off between a behavioral rule’s efficacy to generate accurate beliefs under optimal conditions and its robustness to variation in the composition of the epistemic environment. (shrink)

At least since Kuhn’s Structure, philosophers have studied the influence of social factors in science’s pursuit of truth and knowledge. More recently, formal models and computer simulations have allowed philosophers of science and social epistemologists to dig deeper into the detailed dynamics of scientific research and experimentation, and to develop very seemingly realistic models of the social organization of science. These models purport to be predictive of the optimal allocations of factors, such as diversity of methods used in science, size (...) of groups, and communication channels among researchers. In this paper we argue that the current research faces an empirical challenge. The challenge is to connect simulation models with data. We present possible scenarios about how the challenge may unfold. (shrink)

Derivational robustness may increase the degree to which various pieces of evidence indirectly confirm a robust result. There are two ways in which this increase may come about. First, if one can show that a result is robust, and that the various individual models used to derive it also have other confirmed results, these other results may indirectly confirm the robust result. Confirmation derives from the fact that data not known to bear on a result are shown to be relevant (...) when it is shown to be robust. Second, robustness may increase the degree to which the robust result is indirectly confirmed if it increases the weight with which existing evidence indirectly confirms it. This may happen when it strengthens the connection between the core and the robust result by showing that auxiliaries are not responsible for the result. (shrink)

Agent-based models derive the behavior of artificial socio-economic entities computationally from the actions of a large number of agents. One objection is that highly idealized ABMs fail to represent the real world in any reasonable sense. Another objection is that they at best show how observed patterns may have come about, because simulations are easy to produce and there is no evidence that this is really what happens. Moreover, different models may well yield the same result. I will rebut these (...) objections by focusing on an often neglected, but crucial function of ABMs. Building on Gelfert’s account of the exploratory uses of scientific models I show that, in the absence of an accepted underlying theory, successful ABMs lend inductive support to assumptions concerning certain structural feutures of the behavioral rules employed. One core step towards this goal is what I call multiple-model robustness analysis. (shrink)

In recent years the social nature of scientific inquiry has generated considerable interest. We examine the effect of an epistemically impure agent on a community of honest truth seekers. Extending a formal model of network epistemology pioneered by Zollman, we conclude that an intransigently biased agent prevents the community from ever converging to the truth. We explore two solutions to this problem, including a novel procedure for endogenous network formation in which agents choose whom to trust. We contend that our (...) model nicely captures aspects of current problems in medical research and gesture at some morals for medical epistemology more generally. (shrink)

A scientific community can be modeled as a collection of epistemic agents attempting to answer questions, in part by communicating about their hypotheses and results. We can treat the pathways of scientific communication as a network. When we do, it becomes clear that the interaction between the structure of the network and the nature of the question under investigation affects epistemic desiderata, including accuracy and speed to community consensus. Here we build on previous work, both our own and others’, in (...) order to get a firmer grasp on precisely which features of scientific communities interact with which features of scientific questions in order to influence epistemic outcomes. (shrink)

In this paper we examine the epistemic value of highly idealized agent-based models of social aspects of scientific inquiry. On the one hand, we argue that taking the results of such simulations as informative of actual scientific inquiry is unwarranted, at least for the class of models proposed in recent literature. Moreover, we argue that a weaker approach, which takes these models as providing only “how-possibly” explanations, does not help to improve their epistemic value. On the other hand, we suggest (...) that if ABMs of science underwent two types of robustness analysis, they could indeed have a clear epistemic function, namely by providing evidence for philosophical and historical hypotheses. In this sense, ABMs can obtain evidential and explanatory properties and thus be a useful tool for integrated history and philosophy of science. We illustrate our point with an example of a model—building on the work by Kevin Zollman—which we apply to a concrete historical case study. (shrink)

The article presents an agent-based model of scientific interaction aimed at examining how different degrees of connectedness of scientists impact their efficiency in knowledge acquisition. The model is built on the basis of Zollman’s ABM by changing some of its idealizing assumptions that concern the representation of the central notions underlying the model: epistemic success of the rivalling scientific theories, scientific interaction and the assessment in view of which scientists choose theories to work on. Our results suggest that whether and (...) to what extent the degree of connectedness of a scientific community impacts its efficiency is a highly context-dependent matter since different conditions deem strikingly different results. More generally, we argue that simplicity of ABMs may come at a price: the requirement to run extensive robustness analysis before we can specify the adequate target phenomenon of the model.1 1Introduction2Zollman's 2010 Model3Static versus Dynamic Epistemic Success 3.1Introducing the notion of dynamic epistemic success3.2Implementation and results for the basic setup4Critical Interaction 4.1Introducing critique4.2Implementation and results5Inertia of Inquiry 5.1Introducing rational inertia5.2Implementation and results6Threshold Below Which Theories Are Equally Promising 6.1An inquiry that is even more difficult6.2Implementation and results7Discussion8Conclusion. (shrink)

This paper examines lessons obtained by means of simulations in the form of agent-based models about the norms that are to guide disagreeing scientists. I focus on two types of epistemic and methodological norms: norms that guide one’s attitude towards one’s own theory, and norms that guide one’s attitude towards the opponent’s theory. Concerning I look into ABMs that have been designed to examine the context of peer disagreement. Here I challenge the conclusion that the given ABMs provide a support (...) for the so-called Steadfast Norm, according to which one is epistemically justified in remaining steadfast in their beliefs in face of disagreeing peers. I argue that the proposed models at best provide evidence for a weaker norm, which concerns methodological steadfastness. Concerning I look into ABMs aimed at examining epistemic effects of scientific interaction. Here I argue that the models provide diverging suggestions and that the link between each ABM and the type of represented inquiry is still missing. Moreover, I examine alternative strategies of arguing in favor of the benefits of scientific interaction, relevant for contemporary discussions on scientific pluralism. (shrink)

Formal models of scientific inquiry, aimed at capturing socio-epistemic aspects underlying the process of scientific research, have become an important method in formal social epistemology and philosophy of science. In this introduction to the special issue we provide a historical overview of the development of formal models of this kind and analyze their methodological contributions to discussions in philosophy of science. In particular, we show that their significance consists in different forms of ‘methodological iteration’ whereby the models initiate new lines (...) of inquiry, isolate and clarify problems with existing knowledge claims, and stimulate further research. (shrink)

argumentation has been shown to be a powerful tool within many fields such as artificial intelligence, logic and legal reasoning. In this paper we enhance Dung’s well-known abstract argumentation framework with explanatory capabilities. We show that an explanatory argumentation framework (EAF) obtained in this way is a useful tool for the modeling of scientific debates. On the one hand, EAFs allow for the representation of explanatory and justificatory arguments constituting rivaling scientific views. On the other hand, different procedures for selecting (...) arguments, corresponding to different methodological and epistemic requirements of theory evaluation, can be formulated in view of our framework. (shrink)

It has been claimed that epistemic peers, upon discovering that they disagree on some issue, should give up their opposing views and ‘split the difference’. The present paper challenges this claim by showing, with the help of computer simulations, that what the rational response to the discovery of peer disagreement is—whether it is sticking to one’s belief or splitting the difference—depends on factors that are contingent and highly context-sensitive.Keywords: Peer disagreement; Computer simulations; Opinion dynamics; Hegselmann–Krause model; Social epistemology.

Taking scientific practice as its starting point, this book charts the complex territory of models used in science. It examines what scientific models are and what their function is. Reliance on models is pervasive in science, and scientists often need to construct models in order to explain or predict anything of interest at all. The diversity of kinds of models one finds in science – ranging from toy models and scale models to theoretical and mathematical models – has attracted attention (...) not only from scientists, but also from philosophers, sociologists, and historians of science. This has given rise to a wide variety of case studies that look at the different uses to which models have been put in specific scientific contexts. By exploring current debates on the use and building of models via cutting-edge examples drawn from physics and biology, the book provides broad insight into the methodology of modelling in the natural sciences. It pairs specific arguments with introductory material relating to the ontology and the function of models, and provides some historical context to the debates as well as a sketch of general positions in the philosophy of scientific models in the process. (shrink)

Pluralism about scientific method is more-or-less accepted, but the consequences have yet to be drawn out. Scientists adopt different methods in response to different epistemic situations: depending on the system they are interested in, the resources at their disposal, and so forth. If it is right that different methods are appropriate in different situations, then mismatches between methods and situations are possible. This is most likely to occur due to method bias: when we prefer a particular kind of method, despite (...) that method clashing with evidential context or our aims. To explore these ideas, we sketch a kind of method pluralism which turns on two properties of evidence, before using agent-based models to examine the relationship between methods, epistemic situations, and bias. Based on our results, we suggest that although method bias can undermine the efficiency of a scientific community, it can also be productive through preserving a diversity of evidence. We consider circumstances where method bias could be particularly egregious, and those where it is a potential virtue, and argue that consideration of method bias reveals that community standards deserve a central place in the epistemology of science. (shrink)

We employ data envelopment analysis on a series of experiments performed in Fermilab, one of the major high-energy physics laboratories in the world, in order to test their efficiency (as measured by publication and citation rates) in terms of variations of team size, number of teams per experiment, and completion time. We present the results and analyze them, focusing in particular on inherent connections between quantitative team composition and diversity, and discuss them in relation to other factors contributing to scientific (...) production in a wider sense. Our results concur with the results of other studies across the sciences showing that smaller research teams are more productive, and with the conjecture on curvilinear dependence of team size and efficiency. (shrink)