This paper looks at an appeal to the authority of biomedical research that has recently been used by empirical economists to motivate and justify their methods. I argue that those who make this appeal mistake the nature of biomedical research. Randomised trials, which are said to have revolutionised biomedical research, are a central methodology, but according to only one paradigm. There is another paradigm at work in biomedical research, the inferentialist paradigm, in which randomised trials play no special role. I (...) outline the inferentialist alternative in broad strokes, apply it to a recent controversy in econometrics and draw some general conclusions concerning econometric methodology. (shrink)

The aim of this article is to contribute to the discussion about the so-called “empirical claim” and “empirical basis” of theory testing. First, the proposals of reconceptualization of the standard notions of partial potential model, intended application and empirical claim of a theory made by Balzer (1982, 1988, 1997a, 1997b, 2006, Balzer, Lauth & Zoubek 1993) and Gähde (1996, 2002, 2008) will be first discussed. Then, the distinction between “global” and “local empirical basis” will be introduced, linking it with that (...) of “global” and “local or particular empirical claim”. After that, following Balzer (1997a), along the lines of Suppes (1962), I will present a way in which what count as ‘data’ for a theory can be modeltheoretically represented and conceptualized. Finally, the proposed analysis will be exemplified with the case of classical genetics (reconstructed in Balzer & Lorenzano 2000, Lorenzano, 1995, 2000, 2002). (shrink)

This paper surveys and critically assesses existing theories of evidence with respect to four desiderata. A good theory of evidence should be both a theory of evidential support (i.e., be informative about what kinds of facts speak in favour of a hypothesis), and of warrant (i.e., be informative about how strongly a given set of facts speaks in favour of the hypothesis), it should apply to the non-ideal cases in which scientists typically find themselves, and it should be ‘descriptively adequate’, (...) i.e., able to adequately represent typical episodes of evidentiary reasoning. The theories surveyed here—Bayesianism, hypotheticodeductivism,satisfaction theories, error statistics as well as Achinstein’s and Cartwright’s theories—are all found wanting in important respects. I finally argue that a deficiency all these theories have in common is a neglect or underplaying of the epistemic context in which the episode of evidentiary reasoning takes place.Este artículo describe y valora críticamente diversas teorías de la evidencia en relación a cuatro desiderata. Una buena teoría de la evidencia debería ser tanto una teoría sobre el apoyo evidencial [evidential support] (ser informativa sobre qué tipos de hechos hablan a favor de la hipótesis) como sobre la justificación [warrant]; debería aplicarse en las situaciones no ideales en las que normalmente se encuentran los científicos; y debería ser ‘descriptivamente adecuada’, esto es, capaz de representar correctamente episodios típicos de razonamiento evidencial. Las teorías aquí revisadas—bayesianismo, hipotético-deductivismo, teorías de la satisfacibilidad, la estadística del error, así como las propuestas de Achinstein y Cartwright—se consideran deficientes en aspectos básicos. Argumentaré que un defecto común en todas ellas es que olvidan, o minusvaloran, el contexto epistémico en el que el episodio de razonamiento evidencial tiene lugar. (shrink)

Engineering deals with different problem situations than science, and theories in engineering are different to theories in science. So, the growth of knowledge in engineering is also different to that in science. Nonetheless, methodological issues in engineering epistemology can be explored by adapting frameworks already established in the philosophy of science. In this paper I use critical rationalism and Popper’s three worlds framework to investigate error elimination and the growth of knowledge in engineering. I discuss engineering failure arising from the (...) falsification of engineering theories, and present taxonomies of the sources of falsification and responses to falsification in engineering. From this I discuss contexts of research and design in engineering, ad hoc rescue of engineering theories, and engineering assurance. (shrink)

Many philosophers are skeptical about the scientific value of the concept of biological information. However, several have recently proposed a more positive view of ascribing information as an exercise in scientific modeling. I argue for an alternative role: guiding empirical data collection for the sake of theorizing about the evolution of semantics. I clarify and expand on Bergstrom and Rosvall’s suggestion of taking a “diagnostic” approach that defines biological information operationally as a procedure for collecting empirical cases. The more recent (...) modeling-based accounts still perpetuate a theory-centric view of scientific concepts, which motivated philosophers’ misplaced skepticism in the first place. (shrink)

I present a new proof of the likelihood principle that avoids two responses to a well-known proof due to Birnbaum ([1962]). I also respond to arguments that Birnbaum’s proof is fallacious, which if correct could be adapted to this new proof. On the other hand, I urge caution in interpreting proofs of the likelihood principle as arguments against the use of frequentist statistical methods. 1 Introduction2 The New Proof3 How the New Proof Addresses Proposals to Restrict Birnbaum’s Premises4 A Response (...) to Arguments that the Proofs Are Fallacious5 Conclusion. (shrink)

Debates about the ontological implications of the general theory of relativity have long oscillated between spacetime substantivalism and relationism. I evaluate such debates by claiming that we need a third option, which I refer to as “structural spacetime realism.” Such a tertium quid sides with the relationists in defending the relational nature of the spacetime structure, but joins the substantivalists in arguing that spacetime exists, at least in part, independently of particular physical objects and events, the degree of “independence” being (...) given by the extent to which geometrical laws exist “over and above” physical events exemplifying them. By showing that structural spacetime realism is the natural outcome of a semantic, model-theoretic approach to the nature of scientific theories, I conclude by arguing that the notion of partial isomorphic representation is the most plausible candidate to connect spacetime models with reality. (shrink)

A familiar adage in the philosophy of science is that general hypotheses are better supported by varied evidence than by uniform evidence. Several studies suggest that young children do not respect this principle, and thus suffer from a defect in their inductive methodology. We argue that the diversity principle does not have the normative status that psychologists attribute to it, and should be replaced by a simple rule of probability. We then report experiments designed to detect conformity to the latter (...) rule in children's inductive judgment. The results suggest that young children in both the United States and Taiwan are sensitive to the constraints imposed by the rule on judgments of probability and evidential strength. We conclude with a suggested reinterpretation of the thesis that children's inductive methodology qualifies them as “little scientists.”. (shrink)

Medical scientists employ ‘quality assessment tools’ (QATs) to measure the quality of evidence from clinical studies, especially randomized controlled trials (RCTs). These tools are designed to take into account various methodological details of clinical studies, including randomization, blinding, and other features of studies deemed relevant to minimizing bias and error. There are now dozens available. The various QATs on offer differ widely from each other, and second-order empirical studies show that QATs have low inter-rater reliability and low inter-tool reliability. This (...) is an instance of a more general problem I call the underdetermination of evidential significance. Disagreements about the strength of a particular piece of evidence can be due to different—but in principle equally good—weightings of the fine-grained methodological features which constitute QATs. (shrink)

Neuroscience is a laboratory-based science that spans multiple levels of analysis from molecular genetics to behavior. At every level of analysis experiments are designed in order to answer empirical questions about phenomena of interest. Understanding the nature and structure of experimentation in neuroscience is fundamental for assessing the quality of the evidence produced by such experiments and the kinds of claims that are warranted by the data. This article provides a general conceptual framework for thinking about evidence and experimentation in (...) neuroscience with a particular focus on two research areas: cognitive neuroscience and cognitive neurobiology. (shrink)

Normal 0 0 1 85 487 UBC 4 1 598 11.773 0 0 0 Under what conditions is the failure to have evidence that p evidence that p is false? Absent evidence reasoning is common in many sciences, including astronomy, archeology, biology and medicine. An often-repeated epistemological motto is that “the absence of evidence is not evidence of absence.” Analysis of absent evidence reasoning usually takes place in a deductive or frequentist hypothesis-testing framework. Instead, I develop a Bayesian analysis of (...) this motto and prove that, under plausible assumptions about the nature of evidence, the absence of evidence is evidence of absence. (shrink)

A number of areas of biology raise questions about what is of value in the natural environment and how we ought to behave towards it: conservation biology, environmental science, and ecology, to name a few. Based on my experience teaching students from these and similar majors, I argue that the field of environmental ethics has much to teach these students. They come to me with pent-up questions and a feeling that more is needed to fully engage in their subjects, and (...) I believe some exposure to environmental ethics can help focus their interests and goals. I identify three primary areas in which environmental ethics can con- tribute to their education. The first is an examination of who (or what) should be considered to be part of our moral community (i.e., the community to whom we owe direct duties). Is it humans only? Or does it include all sentient life? Or all life? Or ecosystems considered holistically? Often, readings implicitly assume one or more of these answers; the goal is to make the student more sensitive to these implicit claims and to get them to think about the different reasons that support them. The second area, related to the first, is the application of the different answers concerning the extent of the ethical community to real environmental issues and problems. Students need to be aware of how the different answers concerning the moral community can imply conflicting answers for how we should act in certain cases and to think about ways to move toward conflict resolution. The third area in which environmental ethics can contribute is a more conceptual one, focusing on central concepts such as biodiversity, sustainability, species, and ecosystems. Exploring and evaluating various meanings of these terms will make students more reflective and thoughtful citizens and biologists, sensitive to the implications that different conceptual choices make. (shrink)

This paper synthesizes confirmation by instances and confirmation by successful predictions, and thereby the Hempelian and the hypothetico-deductive traditions in confirmation theory. The merger of these two approaches is subsequently extended to the piecemeal confirmation of entire theories. It is then argued that this synthetic account makes a useful contribution from both a historical and a systematic perspective.

The main objective of the paper is to propose a frequentist interpretation of probability in the context of model-based induction, anchored on the Strong Law of Large Numbers (SLLN) and justifiable on empirical grounds. It is argued that the prevailing views in philosophy of science concerning induction and the frequentist interpretation of probability are unduly influenced by enumerative induction, and the von Mises rendering, both of which are at odds with frequentist model-based induction that dominates current practice. The differences between (...) the two perspectives are brought out with a view to defend the model-based frequentist interpretation of probability against certain well-known charges, including [i] the circularity of its definition, [ii] its inability to assign ‘single event’ probabilities, and [iii] its reliance on ‘random samples’. It is argued that charges [i]–[ii] stem from misidentifying the frequentist ‘long-run’ with the von Mises collective. In contrast, the defining characteristic of the long-run metaphor associated with model-based induction is neither its temporal nor its physical dimension, but its repeatability (in principle); an attribute that renders it operational in practice. It is also argued that the notion of a statistical model can easily accommodate non-IID samples, rendering charge [iii] simply misinformed. (shrink)

One important aspect of biological explanation is detailed causal modeling of particular phenomena in limited experimental background conditions. Recognising this allows one to appreciate that a sufficient condition for a reduction in biology is a molecular model of (1) only the demonstrated causal parameters of a biological model and (2) only within a replicable experimental background. These identities—which are ubiquitous in biology and form the basis of ruthless reductions (Bickle, Philosophy and neuroscience: a ruthlessly reductive account, 2003)—are criticised as merely (...) “local” (Sullivan, Synthese 167:511–539, 2009) or “fragmentary” (Schaffner, Synthese, 151(3):377–402, 2006). However, in an instructive case, a biological model is preserved in molecular terms, demonstrating a complex phenomenon that has been successfully reduced. (shrink)

In a recent paper McCain (2012) argues that weak predictivism creates an important challenge for external world scepticism. McCain regards weak predictivism as uncontroversial and assumes the thesis within his argument. There is a sense in which the predictivist literature supports his conviction that weak predictivism is uncontroversial. This absence of controversy, however, is a product of significant plasticity within the thesis, which renders McCain’s argument worryingly vague. For McCain’s argument to work he either needs a stronger version of weak (...) predictivism than has been defended within the literature, or must commit to a more precise formulation of the thesis and argue that weak predictivism, so understood, creates the challenge to scepticism that he hopes to achieve. The difficulty with the former is that weak predictivism is not uncontroversial in the respect that McCain’s argument would require. I consider the prospects of saving McCain’s argument by committing to a particular version of weak predictivism, but find them unpromising for several reasons. (shrink)

Randomized Controlled Trials are currently the gold standard within evidence-based medicine. Usually, they are conducted as sequential trials allowing for monitoring for early signs of effectiveness or harm. However, evidence from early stopped trials is often charged with being biased towards implausibly large effects. To our mind, this skeptical attitude is unfounded and caused by the failure to perform appropriate conditioning in the statistical analysis of the evidence. We contend that a shift from unconditional hypothesis tests in the style of (...) Neyman and Pearson to conditional hypothesis tests gives a superior appreciation of the obtained evidence and significantly improves the practice of sequential medical trials, while staying firmly rooted in frequentist methodology. (shrink)

The interpretation of tests of a point null hypothesis against an unspecified alternative is a classical and yet unresolved issue in statistical methodology. This paper approaches the problem from the perspective of Lindley's Paradox: the divergence of Bayesian and frequentist inference in hypothesis tests with large sample size. I contend that the standard approaches in both frameworks fail to resolve the paradox. As an alternative, I suggest the Bayesian Reference Criterion: it targets the predictive performance of the null hypothesis in (...) future experiments; it provides a proper decision-theoretic model for testing a point null hypothesis and it convincingly accounts for Lindley's Paradox. (shrink)

Hypothetico-deductive (H-D) confirmation builds on the idea that confirming evidence consists of successful predictions that deductively follow from the hypothesis under test. This article reviews scope, history and recent development of the venerable H-D account: First, we motivate the approach and clarify its relationship to Bayesian confirmation theory. Second, we explain and discuss the tacking paradoxes which exploit the fact that H-D confirmation gives no account of evidential relevance. Third, we review several recent proposals that aim at a sounder and (...) more comprehensive formulation of H-D confirmation. Finally, we conclude that the reputation of hypothetico-deductive confirmation as outdated and hopeless is undeserved: not only can the technical problems be addressed satisfactorily, the hypothetico-deductive method is also highly relevant for scientific practice. (shrink)

The present work constitutes an attempt to make explicit those pragmatic norms successfully operating in empirical science. I will first comment on the initial presuppositions of the discussion, in particular, on those concerning the instrumental character of scientific practice and the nature of scientific goals. Then I will depict the moderately naturalistic frame in which, from this approach, the pragmatic norms make sense. Third, I will focus on the specificity of the pragmatic norms, making special emphasis on what I regard (...) as a key idea underlying them, namely, the view, vigorously advocated by classical pragmatists like C. S. Peirce and G. Vailati, that the best test for objectivity is the test of action. Finally, I am going to put forward a tentative list of pragmatic norms that can be abstracted from a careful observation and analysis of scientific practice as provided by current philosophers of experimentation (A. Franklin and F. Steinle among others). The norms will be divided into four classes corresponding to four aspects of science in which they rule, that is, self-correction, prediction, explanation and both experimentation and computation. In the following account, the formulation of those pragmatic norms successfully governing science will be understood as a contribution that scientifically-oriented pragmatism can make to the normative naturalistic project in epistemology. (shrink)

This article outlines a philosophy of science in practice that focuses on the engineering sciences. A methodological issue is that these practices seem to be divided by two different styles of scientific reasoning, namely, causal-mechanistic and mathematical reasoning. These styles are philosophically characterized by what Kuhn called ?disciplinary matrices?. Due to distinct metaphysical background pictures and/or distinct ideas of what counts as intelligible, they entail distinct ideas of the character of phenomena and what counts as a scientific explanation. It is (...) argued that the two styles cannot be reduced to each other. At the same time, although they are incompatible, they must not be regarded as competing. Instead, they produce different kinds of epistemic results, which serve different kinds of epistemic functions. Moreover, some scientific breakthroughs essentially result from relating them. This view of complementary styles of scientific reasoning is supported by pluralism about metaphysical background pictures. (shrink)

Additionally, the text shows how to develop computationally feasible methods to mesh with this framework.

Amalgamating evidence of different kinds for the same hypothesis into an overall confirmation is analogous, I argue, to amalgamating individuals’ preferences into a group preference. The latter faces well-known impossibility theorems, most famously “Arrow’s Theorem”. Once the analogy between amalgamating evidence and amalgamating preferences is tight, it is obvious that amalgamating evidence might face a theorem similar to Arrow’s. I prove that this is so, and end by discussing the plausibility of the axioms required for the theorem.

Stem cell biology is driven by experiment. Its major achievements are striking experimental productions: "immortal" human cell lines from spare embryos (Thomson et al. 1998); embryo-like cells from "reprogrammed" adult skin cells (Takahashi and Yamanaka 2006); muscle, blood and nerve tissue generated from stem cells in culture (Lanza et al. 2009, and references therein). Well-confirmed theories are not so prominent, though stem cell biologists do propose and test hypotheses at a profligate rate. 1 This paper aims to characterize the role (...) of experiment in stem cell biology, so as to answer the following question: how do experiments contribute to our knowledge of stem cells and related phenomena? The .. (shrink)

Proponents of Evidence-based medicine (EBM) do not provide a clear role for basic science in therapeutic decision making. Of what they do say about basic science, most of it is negative. Basic science resides on the lower tiers of EBM's hierarchy of evidence. Therapeutic decisions, according to proponents of EBM, should be informed by evidence from randomised studies (and systematic reviews of randomised studies) rather than basic science. A framework of models explicates the links between the mechanisms of basic science, (...) experimental inquiry, and observed data. Relying on the framework of models I show that basic science often plays a role not only in specifying experiments, but also analysing and interpreting the data that is provided. Further, and contradicting what is implied in EBM's hierarchy of evidence, appeals to basic science are often required to apply clinical research to therapeutic questions. © 2010 Springer Science+Business Media B.V. (shrink)

Some prominent accounts of scientific evidence treat evidence as an unrelativized concept. But whether belief in a hypothesis is justified seems relative to the epistemic situation of the believer. The issue becomes yet more complicated in the context of group epistemic agents, for then one confronts the problem of relativizing to an epistemic situation that may include conflicting beliefs. As a step toward resolution of these difficulties, an ideal of justification is here proposed that incorporates both an unrelativized evidence requirement (...) and the requirement of the security of the evidence on which a conclusion from data is based. The latter requirement incorporates the consideration of epistemic modal statements. (shrink)

Starting from the sixties of the past century theory change has become a main concern of philosophy of science. Two of the best known formal accounts of theory change are the post-Popperian theories of verisimilitude (PPV for short) and the AGM theory of belief change (AGM for short). In this paper, we will investigate the conceptual relations between PPV and AGM and, in particular, we will ask whether the AGM rules for theory change are effective means for approaching the truth, (...) i.e., for achieving the cognitive aim of science pointed out by PPV. First, the key ideas of PPV and AGM and their application to a particular kind of propositional theories - the so called "conjunctive propositions" - will be illustrated. Afterwards, we will prove that, as far as conjunctive propositions are concerned, AGM belief change is an effective tool for approaching the truth. (shrink)

Robustness is a common platitude: hypotheses are better supported with evidence generated by multiple techniques that rely on different background assumptions. Robustness has been put to numerous epistemic tasks, including the demarcation of artifacts from real entities, countering the “experimenter’s regress,” and resolving evidential discordance. Despite the frequency of appeals to robustness, the notion itself has received scant critique. Arguments based on robustness can give incorrect conclusions. More worrying is that although robustness may be valuable in ideal evidential circumstances (i.e., (...) when evidence is concordant), often when a variety of evidence is available from multiple techniques, the evidence is discordant. †To contact the author, please write to: Jacob Stegenga, Department of Philosophy, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA 92093; e‐mail: [email protected]. (shrink)

While epistemic justification is a central concern for both contemporary epistemology and philosophy of science, debates in contemporary epistemology about the nature of epistemic justification have not been discussed extensively by philosophers of science. As a step toward a coherent account of scientific justification that is informed by, and sheds light on, justificatory practices in the sciences, this paper examines one of these debates—the internalist-externalist debate—from the perspective of objective accounts of scientific evidence. In particular, we focus on Deborah Mayo’s (...) error-statistical theory of evidence because it is a paradigmatically objective theory of evidence that is strongly informed by methodological practice. We contend that from the standpoint of such an objective theory of evidence, justification in science has both externalist and internalist characteristics. In reaching this conclusion, however, we find that the terms of the contemporary debate between internalists and externalists have to be redefined to be applicable to scientific contexts. (shrink)

Whereas an inference (deductive as well as inductive) is usually viewed as being valid in virtue of its argument form, the present paper argues that scientific reasoning is material inference, i.e., justified in virtue of its content. A material inference is licensed by the empirical content embodied in the concepts contained in the premises and conclusion. Understanding scientific reasoning as material inference has the advantage of combining different aspects of scientific reasoning, such as confirmation, discovery, and explanation. This approach explains (...) why these different aspects (including discovery) can be rational without conforming to formal schemes, and why scientific reasoning is local, i.e., justified only in certain domains and contingent on particular empirical facts. The notion of material inference also fruitfully interacts with accounts of conceptual change and psychological theories of concepts. (shrink)

Charles Peirce’s model of inquiry is supposed to demarcate appropriate methods of inquiry from specious ones. Cheryl Misak points out that Peirce’s explicit account fails, but can nevertheless be rescued by elements of his own system. While Misak’s criticism is a propos, her own attempt to fortify Peirce’s account does not succeed, as it falls prey to the same criticism she raises against Peirce’s explicit account. The account provided in this paper—the ‘open path’ alternative—draws from Peirce’s corollary to his “first (...) rule of reason”, that one should not block the road to inquiry. The ‘open path’ account is able to withstand Misak’s objections, and when combined with other aspects of Peirce’s work, shows us why the optimal way to conduct inquiry is to follow the path of greatest resistance. Inquiry, however, is rarely conducted in optimal conditions. Actual, constrained conditions of inquiry require a measure of economy in terms of what can be reasonably pursued and how. The question, then, is how to conduct our inquiries so that they are as nearly optimal as possible given actual constraints. As a working scientist, Peirce was acutely aware of the need to economize in research. Nicholas Rescher has recognized this issue’s significance for Peirce, and noted its neglect in discussions of Peirce’s work. One issue that has been largely neglected in the literature on Peirce is what specifically he recommends, based on considerations of economy, for how to go about gathering evidence. Kronz & McLaughlin points out that Peirce’s primary recommendation is that in gathering evidence relevant to a particular hypothesis we should test for empirical consequences that would not have been expected otherwise. The view that is developed in this paper is that economy in research, according to Peirce, follows the general line of his theory of inquiry. Peirce’s theory of inquiry implies that pursuit of truth requires maximizing resistance. I argue that his considerations about how to navigate within the constraints introduced in the context of actual research are also best understood as recommendations for maximizing resistance. (shrink)

This paper investigates some metaphysical and epistemological assumptions behind Bogen and Woodward’s data-to-phenomena inferences. I raise a series of points and suggest an alternative possible Kantian stance about data-to-phenomena inferences. I clarify the nature of the suggested Kantian stance by contrasting it with McAllister’s view about phenomena as patterns in data sets.

: Evidence claims depend on fallible assumptions. Three strategies for making true evidence claims in spite of this fallibility are strengthening the support for those assumptions, weakening conclusions, and using multiple independent tests to produce robust evidence. Reliability itself, understood in frequentist terms, does not explain the usefulness of all three strategies; robustness, in particular, sometimes functions in a way that is not well-characterized in terms of reliability. I argue that, in addition to reliability, the security of evidence claims is (...) of epistemic value, where an evidence claim is secure relative to an epistemic situation if it remains true in all scenarios that are epistemically possible relative to that epistemic situation. (shrink)

Allan Franklin has identified a number of strategies that scientists use to build confidence in experimental results. This paper shows that Franklin's strategies have direct analogues in the context of computer simulation and then suggests that one of his strategies—the so-called 'Sherlock Holmes' strategy—deserves a privileged place within the epistemologies of experiment and simulation. In particular, it is argued that while the successful application of even several of Franklin's other strategies (or their analogues in simulation) may not be sufficient for (...) justified belief in results, the successful application of a slightly elaborated version of the Sherlock Holmes strategy is sufficient. (shrink)

The issues of double-counting, use-constructing, and selection effects have long been the subject of debate in the philosophical as well as statistical literature. I have argued that it is the severity, stringency, or probativeness of the test—or lack of it—that should determine if a double-use of data is admissible. Hitchcock and Sober ([2004]) question whether this ‘severity criterion' can perform its intended job. I argue that their criticisms stem from a flawed interpretation of the severity criterion. Taking their criticism as (...) a springboard, I elucidate some of the central examples that have long been controversial, and clarify how the severity criterion is properly applied to them. Severity and Use-Constructing: Four Points (and Some Clarificatory Notes) 1.1 Point 1: Getting beyond ‘all or nothing’ standpoints 1.2 Point 2: The rationale for prohibiting double-counting is the requirement that tests be severe 1.3 Point 3: Evaluate severity of a test T by its associated construction rule R 1.4 Point 4: The ease of passing vs. ease of erroneous passing: Statistical vs. ‘Definitional’ probability The False Dilemma: Hitchcock and Sober 2.1 Marsha measures her desk reliably 2.2 A false dilemma Canonical Errors of Inference 3.1 How construction rules may alter the error-probing performance of tests 3.2 Rules for accounting for anomalies 3.3 Hunting for statistically significant differences Concluding Remarks. (shrink)

To what extent does the design of statistical experiments, in particular sequential trials, affect their interpretation? Should postexperimental decisions depend on the observed data alone, or should they account for the used stopping rule? Bayesians and frequentists are apparently deadlocked in their controversy over these questions. To resolve the deadlock, I suggest a three‐part strategy that combines conceptual, methodological, and decision‐theoretic arguments. This approach maintains the pre‐experimental relevance of experimental design and stopping rules but vindicates their evidential, postexperimental irrelevance. †To (...) contact the author, please write to: Tilburg Center for Logic and Philosophy of Science, Tilburg University, P.O. Box 90153, 5000 LE Tilburg, The Netherlands; e‐mail: [email protected]. (shrink)

Descriptive accounts of the nature of explanation in neuroscience and the global goals of such explanation have recently proliferated in the philosophy of neuroscience and with them new understandings of the experimental practices of neuroscientists have emerged. In this paper, I consider two models of such practices; one that takes them to be reductive; another that takes them to be integrative. I investigate those areas of the neuroscience of learning and memory from which the examples used to substantiate these models (...) are culled, and argue that the multiplicity of experimental protocols used in these research areas presents specific challenges for both models. In my view, these challenges have been overlooked largely because philosophers have hitherto failed to pay sufficient attention to fundamental features of experimental practice. I demonstrate that when we do pay attention to such features, evidence for reduction and integrative unity in neuroscience is simply not borne out. I end by suggesting some new directions for the philosophy of neuroscience that pertain to taking a closer look at the nature of neuroscientific experiments. (shrink)

Scientific theories are developed in response to a certain set of phenomena and subsequently evaluated, at least partially, in terms of the quality of fit between those same theories and appropriately distinctive phenomena. To differentiate between these two stages it is popular to describe the former as involving the accommodation of data and the latter as involving the prediction of data. Predictivism is the view that, ceteris paribus, correctly predicting data confers greater confirmation than successfully accommodating data. In this paper, (...) I take issue with a variety of predictivist theses, argue that their role for issues of confirmation is extremely limited, and attempt to account for the appeal that predictivism has enjoyed. Introduction Temporal Predictivism Heuristic Predictivism Weak Predictivism 4.1 Inference to better theories 4.2 Inference to better methods Arguments for Strong Heuristic Predictivism 5.1 Best explanations argument 5.2 Conditional support 5.3 Unique explanations Increased Explanatory Unification 6.1 Explaining what other theories can't 6.2 Contrived hypotheses 6.2 Strength and simplicity Conclusions CiteULike Connotea Del.icio.us What's this? (shrink)

The main aim of this paper is to revisit the curve fitting problem using the reliability of inductive inference as a primary criterion for the ‘fittest' curve. Viewed from this perspective, it is argued that a crucial concern with the current framework for addressing the curve fitting problem is, on the one hand, the undue influence of the mathematical approximation perspective, and on the other, the insufficient attention paid to the statistical modeling aspects of the problem. Using goodness-of-fit as the (...) primary criterion for ‘best', the mathematical approximation perspective undermines the reliability of inference objective by giving rise to selection rules which pay insufficient attention to ‘accounting for the regularities in the data'. A more appropriate framework is offered by the error-statistical approach, where (i) statistical adequacy provides the criterion for assessing when a curve captures the regularities in the data adequately, and (ii) the relevant error probabilities can be used to assess the reliability of inductive inference. Broadly speaking, the fittest curve (statistically adequate) is not determined by the smallness if its residuals, tempered by simplicity or other pragmatic criteria, but by the nonsystematic (e.g. white noise) nature of its residuals. The advocated error-statistical arguments are illustrated by comparing the Kepler and Ptolemaic models on empirical grounds. ‡I am grateful to Deborah Mayo and Clark Glymour for many valuable suggestions and comments on an earlier draft of the paper; estimating the Ptolemaic model was the result of Glymour's prompting and encouragement. †To contact the author, please write to: Department of Economics, Virginia Tech 3019 Pamplin Hall (0316), Blacksburg, VA 24061; e-mail: [email protected]. (shrink)

Although theoretical results for several algorithms in many application domains were presented during the last decades, not all algorithms can be analyzed fully theoretically. Experimentation is necessary. The analysis of algorithms should follow the same principles and standards of other empirical sciences. This article focuses on stochastic search algorithms, such as evolutionary algorithms or particle swarm optimization. Stochastic search algorithms tackle hard real-world optimization problems, e.g., problems from chemical engineering, airfoil optimization, or bio-informatics, where classical methods from mathematical optimization fail. (...) Nowadays statistical tools that are able to cope with problems like small sample sizes, non-normal distributions, noisy results, etc. are developed for the analysis of algorithms. Although there are adequate tools to discuss the statistical significance of experimental data, statistical significance is not scientifically meaningful per se. It is necessary to bridge the gap between the statistical significance of an experimental result and its scientific meaning. We will propose some ideas on how to accomplish this task based on Mayo’s learning model (NPT*). (shrink)

My purpose in this chapter is to survey some of the principal approaches to inductive inference in the philosophy of science literature. My first concern will be the general principles that underlie the many accounts of induction in this literature. When these accounts are considered in isolation, as is more commonly the case, it is easy to overlook that virtually all accounts depend on one of very few basic principles and that the proliferation of accounts can be understood as efforts (...) to ameliorate the weaknesses of those few principles. In the earlier sections, I will lay out three inductive principles and the families of accounts of induction they engender. In later sections I will review standard problems in the philosophical literature that have supported some pessimism about induction and suggest that their import has been greatly overrated. In the final sections I will return to the proliferation of accounts of induction that frustrates efforts at a final codification. I will suggest that this proliferation appears troublesome only as long as we expect inductive inference to be subsumed under a single formal theory. If we adopt a material theory of induction in which individual inductions are licensed by particular facts that prevail only in local domains, then the proliferation is expected and not problematic. (shrink)

: For philosophers of science interested in elucidating the social character of science, an important question concerns the manner in which and degree to which the objectivity of scientific knowledge is socially constituted. We address this broad question by focusing specifically on philosophical theories of evidence. To get at the social character of evidence, we take an interdisciplinary approach informed by categories from argumentation studies. We then test these categories by exploring their applicability to a case study from high-energy physics. (...) Our central claim is that normative philosophy of science must move beyond abstract theories of justification, confirmation, or evidence conceived impersonally and incorporate a theoretical perspective that includes dialogical elements, either as adjuncts to impersonal theories of evidence or as intrinsic to the cogency of scientific argumentation. (shrink)

Despite the widespread use of key concepts of the Neyman–Pearson (N–P) statistical paradigm—type I and II errors, significance levels, power, confidence levels—they have been the subject of philosophical controversy and debate for over 60 years. Both current and long-standing problems of N–P tests stem from unclarity and confusion, even among N–P adherents, as to how a test's (pre-data) error probabilities are to be used for (post-data) inductive inference as opposed to inductive behavior. We argue that the relevance of error probabilities (...) is to ensure that only statistical hypotheses that have passed severe or probative tests are inferred from the data. The severity criterion supplies a meta-statistical principle for evaluating proposed statistical inferences, avoiding classic fallacies from tests that are overly sensitive, as well as those not sensitive enough to particular errors and discrepancies. Introduction and overview 1.1 Behavioristic and inferential rationales for Neyman–Pearson (N–P) tests 1.2 Severity rationale: induction as severe testing 1.3 Severity as a meta-statistical concept: three required restrictions on the N–P paradigm Error statistical tests from the severity perspective 2.1 N–P test T(): type I, II error probabilities and power 2.2 Specifying test T() using p-values Neyman's post-data use of power 3.1 Neyman: does failure to reject H warrant confirming H? Severe testing as a basic concept for an adequate post-data inference 4.1 The severity interpretation of acceptance (SIA) for test T() 4.2 The fallacy of acceptance (i.e., an insignificant difference): Ms Rosy 4.3 Severity and power Fallacy of rejection: statistical vs. substantive significance 5.1 Taking a rejection of H0 as evidence for a substantive claim or theory 5.2 A statistically significant difference from H0 may fail to indicate a substantively important magnitude 5.3 Principle for the severity interpretation of a rejection (SIR) 5.4 Comparing significant results with different sample sizes in T(): large n problem 5.5 General testing rules for T(), using the severe testing concept The severe testing concept and confidence intervals 6.1 Dualities between one and two-sided intervals and tests 6.2 Avoiding shortcomings of confidence intervals Beyond the N–P paradigm: pure significance, and misspecification tests Concluding comments: have we shown severity to be a basic concept in a N–P philosophy of induction? (shrink)

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness can (...) enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis. (shrink)

Contrary to formal theories of induction, I argue that there are no universal inductive inference schemas. The inductive inferences of science are grounded in matters of fact that hold only in particular domains, so that all inductive inference is local. Some are so localized as to defy familiar characterization. Since inductive inference schemas are underwritten by facts, we can assess and control the inductive risk taken in an induction by investigating the warrant for its underwriting facts. In learning more facts, (...) we extend our inductive reach by supplying more localized inductive inference schemes. Since a material theory no longer separates the factual and schematic parts of an induction, it proves not to be vulnerable to Hume's problem of the justification of induction. (shrink)

A notion of experimental series is developed, in which experiments or experimental sets are connected through experimental suggestions arising from previous experimental outcomes. To that end, the justification of Howard Temin’s DNA provirus hypothesis is examined. The hypothesis originated with evidence from two exploratory experimental sets on an oncogenic virus and was substantiated by including evidence from three additional experimental sets. Collectively these sets comprise an experimental series and the accumulative evidence from the series was adequate to justify the hypothesis (...) by persuading the virology community of its veracity. The notion of crucial experiment is also discussed in terms of experimental series. (shrink)

We describe the three place relation of contrastive knowledge, which holds between a person, a target proposition, and a contrasting proposition. The person knows that p rather than that q. We argue for three claims about this relation. (a) Many common sense and philosophical ascriptions of knowledge can be understood in terms of it. (b) Its application is subject to fewer complications than non-contrastive knowledge is. (c) It applies over a wide range of human and nonhuman cases.

The concept of randomness has been unjustly neglected in recent philosophical literature, and when philosophers have thought about it, they have usually acquiesced in views about the concept that are fundamentally flawed. After indicating the ways in which these accounts are flawed, I propose that randomness is to be understood as a special case of the epistemic concept of the unpredictability of a process. This proposal arguably captures the intuitive desiderata for the concept of randomness; at least it should suggest (...) that the commonly accepted accounts cannot be the whole story and more philosophical attention needs to be paid. 1. Randomness in science1.1Random systems1.2Random behaviour1.3Random sampling1.4Caprice, arbitrariness and noise2. Concepts of randomness2.1Von Mises/church/martin-löf randomness2.2KCS-randomness3. Randomness is unpredictability: preliminaries3.1Process and product randomness3.2Randomness is indeterminism?4. Predictability4.1Epistemic constraints on prediction4.2Computational constraints on prediction4.3Pragmatic constraints on prediction4.4Prediction defined5. Unpredictability6. Randomness is unpredictability6.1Clarification of the definition of randomness6.2Randomness and probability6.3Subjectivity and context sensitivity of randomness7. Evaluating the analysis[R]andomness … is going to be a concept which is relative to our body of knowledge, which will somehow reflect what we know and what we don't know. Henry E. Kyburg, Jr ([1974], p. 217)Phenomena that we cannot predict must be judged random. Patrick Suppes ([1984], p. 32). (shrink)