While the term “reactivity” has come to be associated with specific phenomena in the social sciences, having to do with subjects’ awareness of being studied, this paper takes a broader stance on this concept. I argue that reactivity is a ubiquitous feature of the psychological subject matter and that this fact is a precondition of experimental research, while also posing potential problems for the experimenter. The latter are connected to the worry about distorted data and experimental artifacts. (...) But what are experimental artifacts and what is the most productive way of dealing with them? In this paper, I approach these questions by exploring the ways in which experimenters in psychology simultaneously exploit and suppress the reactivity of their subject matter in order to produce experimental data that speak to the question or subject matter at hand. Highlighting the artificiality of experimental data, I raise the question of what distinguishes a genuine experimental result from an experimental artifact. My analysis construes experimental results as the outcomes of inferences from the data that take material background assumptions as auxiliary premises. Artifacts occur when one or more of these background assumptions are false, such that the data do not reliably serve the purposes they were generated for. I conclude by laying out the ways in which my analysis of data quality is relevant to, and informed by, recent debates about the replicability of experimental results. (shrink)

This special issue on what some regard as a crisis of replicability in cognitive science (i.e. the observation that a worryingly large proportion of experimental results across a number of areas cannot be reliably replicated) is informed by three recent developments. -/- First, philosophers of mind and cognitive science rely increasingly on empirical research, mainly in the psychological sciences, to back up their claims. This trend has been noticeable since the 1960s (see Knobe, 2015). This development has allowed philosophers (...) to draw on a wider range of relevant resources, but it also makes them vulnerable to relying on claims that may not survive further scrutiny. If we have reasons to believe that a large proportion of findings in the psychological sciences cannot be reliably replicated, this would be a problem for philosophers who use such findings in their work. Second, philosophers are increasingly designing and carrying out their own experiments to back up claims, or to test claims earlier made from the armchair, for example, on the perceived permissibility of diverting trolleys or on the nature of free will. This growing field of experimental philosophy has diversified the intellectual field in philosophy, but may also be vulnerable to issues of replicability that philosophers did not face before. -/- Third, the recent evidence of apparently widespread non-replicability in the social sciences (and other fields) has forced philosophers of science to grapple with long standing questions from their field from a new perspective. To what extent does replicability matter for theory construction? How do the notions of replicability and scientific progress interact? How can normative insights from philosophy of science be used in order to improve scientific practice? -/- It is with these three developments in mind—the increasing importance of empirically-informed philosophy, of experimental philosophy, and of philosophy of science around replicability—that this special issue has been conceived. (shrink)

In light of the recent credibility crisis in psychology, this paper argues for a greater emphasis on theorizing in scientific research. Although reliable experimental evidence, preregistration, methodological rigor, and new computational frameworks for modeling are important, scientific progress also relies on properly functioning theories. However, the current understanding of the role of theorizing in psychology is lacking, which may lead to future crises. Theories should not be viewed as mere speculations or simple inductive generalizations. To address this issue, the (...) author introduces a framework called “cognitive metascience,” which studies the processes and results of evaluating scientific practice. This study should proceed both qualitatively, as in traditional science and technology studies and cognitive science, and quantitatively, by analyzing scientific discourse using language technology. By analyzing theories as cognitive artifacts that support cognitive tasks, this paper aims to shed more light on their nature. This perspective reveals that multiple distinct theories serve entirely different roles, and studying these roles, along with their epistemic vices and virtues, can provide insight into how theorizing should proceed. The author urges a change in research culture to appreciate the variety of distinct theories and to systematically advance scientific progress. . (shrink)

Neuroscience is a laboratory-based science that spans multiple levels of analysis from molecular genetics to behavior. At every level of analysis experiments are designed in order to answer empirical questions about phenomena of interest. Understanding the nature and structure of experimentation in neuroscience is fundamental for assessing the quality of the evidence produced by such experiments and the kinds of claims that are warranted by the data. This article provides a general conceptual framework for thinking about evidence and experimentation in (...) neuroscience with a particular focus on two research areas: cognitive neuroscience and cognitive neurobiology. (shrink)

Qualitative fieldwork research on sensitive topics sometimes requires that interviewees be granted confidentiality and anonymity. When qualitative researchers later publish their findings, they must ensure that any statements obtained during fieldwork interviews cannot be traced back to the interviewees. Given these protections to interviewees, the integrity of the published findings cannot usually be verified or replicated by third parties, and the scholarly community must trust the word of qualitative researchers when they publish their results. This trust is fundamentally abused, however, (...) when researchers publish articles reporting qualitative fieldwork data that they never collected. Using only publicly available information, I argue that a 2017 article in an Elsevier foreign policy and international relations journal presents anonymised fieldwork interviews that could not have occurred as described. As an exercise in post-publication peer review (PPPR), this paper examines the evidence that calls into question the reliability of the putative fieldwork quotations. I show further that the 2017 article is not a unique case. The anonymity and confidentiality protections common in some areas of research create an ethical problem: the protections necessary for obtaining research data can be used as a cover to hide substandard research practices as well as research misconduct. (shrink)

According to Richard Swinburne, the principle of simplicity is of great importance to theory choice scenarios and theoretical changes in the sciences. In particular, he holds that the theory choice criterion of fit with background evidence can be reduced to the criteria of simplicity and of yielding the data. We will, however, rebut this reduction thesis and show that three central aspects of theoretical change (confirming power of empirical data, reliability of experimental methods, and truth of new theoretical proposals) (...) cannot be adequately reconstructed if simplicity is regarded as a key criterion of theory choice. (shrink)

Increasingly, in data-intensive areas of the life sciences, experimental results are being described in algorithmically useful ways with the help of ontologies. Such ontologies are authored and maintained by scientists to support the retrieval, integration and analysis of their data. The proposition to be defended here is that ontologies of this type – the Gene Ontology (GO) being the most conspicuous example – are a part of science. Initial evidence for the truth of this proposition (which some will find (...) self-evident) is the increasing recognition of the importance of empirically-based methods of evaluation to the ontology development work being undertaken in support of scientific research. Ontologies created by scientists must, of course, be associated with implementations satisfying the requirements of software engineering. But the ontologies are not themselves engineering artifacts, and to conceive them as such brings grievous consequences. Rather, ontologies such as the GO are in different respects comparable to scientific theories, to scientific databases, and to scientific journal publications. Such a view implies a new conception of what is involved in the authoring, maintenance and application of ontologies in scientific contexts, and therewith also a new approach to the evaluation of ontologies and to the training of ontologists. (shrink)

Reactivity, or the phenomenon by which subjects tend to modify their behavior in virtue of their being studied upon, is often cited as one of the most important difficulties involved in social scientific experiments, and yet, there is to date a persistent conceptual muddle when dealing with the many dimensions of reactivity. This paper offers a conceptual framework for reactivity that draws on an interventionist approach to causality. The framework allows us to offer an unambiguous definition of reactivity and distinguishes (...) it from placebo effects. Further, it allows us to distinguish between benign and malignant forms of the phenomenon, depending on whether reactivity constitutes a danger to the validity of the causal inferences drawn from experimental data. (shrink)

Increasingly, in data-intensive areas of the life sciences, experimental results are being described in algorithmically useful ways with the help of ontologies. Such ontologies are authored and maintained by scientists to support the retrieval, integration and analysis of their data. The proposition to be defended here is that ontologies of this type – the Gene Ontology (GO) being the most conspicuous example – are a part of science. Initial evidence for the truth of this proposition (which some will find (...) self-evident) is the increasing recognition of the importance of empirically-based methods of evaluation to the ontology development work being undertaken in support of scientific research. The ontologies created by scientists must, of course, be associated with implementations satisfying the requirements of software engineering. But these ontologies are not themselves engineering artifacts, and to conceive them as such brings grievous consequences. Rather, we shall argue, ontologies such as the GO are comparable to scientific theories, to scientific databases, or to scientific journal publications. Such a view implies a radically new conception of what is involved in the authoring, maintenance and application of ontologies in scientific contexts, and therewith also a radically new approach to the evaluation of ontologies and to the training of ontologists. (shrink)

Archaeological data are shadowy in a number of senses. Not only are they notoriously fragmentary but the conceptual and technical scaffolding on which archaeologists rely to constitute these data as evidence can be as constraining as it is enabling. A recurrent theme in internal archaeological debate is that reliance on sedimented layers of interpretative scaffolding carries the risk that “preunderstandings” configure what archaeologists recognize and record as primary data, and how they interpret it as evidence. The selective and destructive nature (...) of data capture in archeology further suggests that there may be little scope for putting “legacy” data to work in new ways. And yet archaeologists have been strikingly successful in mining old datasets for new insights. I situate these concerns in the broader context of debate about the epistemic standing of the historical sciences, and then consider three strategies by which archaeologists address the challenges posed by legacy data. The first two – secondary retrieval and recontextualization – are a matter of reconfiguring the scaffolding that underpins evidential reasoning. The third turns on redeploying old data in the context of computational models that support the experimental simulation of the cultural systems and contexts under study. (shrink)

In recent years, some defenders of traditional philosophical methodology have argued that certain critiques of armchair methods are mistaken in assuming that intuitions play central evidential roles in traditional philosophical methods. According to this kind of response, experimental philosophers attack a straw man; it doesn’t matter whether intuitions are reliable, because philosophers don’t use intuitions in the way assumed. Deutsch (2010), Williamson (2007), and Cappelen (2012) all defend traditional methods in something like this way. I also endorsed something like (...) this line in Ichikawa (2014a). -/- In this contribution, I will follow up on this sort of defence of traditional philosophical methods in three ways. In §1, I will rehearse and extend some of my reasons for challenging the idea that traditional methods depend on intuitions in an evidential role. (My reasons are very different from those discussed in (Cappelen, 2012).) I will also engage with some recent more sophisticated attempts to establish the idea that intuitions play evidential roles in philosophy, such as that of Chudnoff (2013). In §2, I will consider and argue against a dismissive response to such positions from experimental philosophers, who consider the question of philosophical reliance on intuitions to be irrelevant to the experimentalist critique. But in §3, I will argue that it would also be a mistake to conclude (as Herman Cappelen does) that the critique is rendered totally irrelevant by the denial of the evidential role of intuitions; I defend a more moderate view on which the bearing of experimental studies of philosophical intuitions is relevant for philosophical methodology, but only in a relatively limited way. (shrink)

It is common to assume that the problem of induction arises only because of small sample sizes or unreliable data. In this paper, I argue that the piecemeal collection of data can also lead to underdetermination of theories by evidence, even if arbitrarily large amounts of completely reliable experimental and observational data are collected. Specifically, I focus on the construction of causal theories from the results of many studies (perhaps hundreds), including randomized controlled trials and observational studies, where the (...) studies focus on overlapping, but not identical, sets of variables. Two theorems reveal that, for any collection of variables V, there exist fundamentally different causal theories over V that cannot be distinguished unless all variables are simultaneously measured. Underdetermination can result from piecemeal measurement, regardless of the quantity and quality of the data. Moreover, I generalize these results to show that, a priori, it is impossible to choose a series of small (in terms of number of variables) observational studies that will be most informative with respect to the causal theory describing the variables under investigation. This final result suggests that scientific institutions may need to play a larger role in coordinating differing research programs during inquiry. (shrink)

Some investigators of the rubber hand illusion (RHI) have suggested that when standard RHI induction procedures are employed, if the rubber hand is experienced by participants as owned, their corresponding biological hands are experienced as disowned. Others have demurred: drawing upon a variety of experimental data and conceptual considerations, they infer that experience of the RHI might include the experience of a supernumerary limb, but that experienced disownership of biological hands does not occur. Indeed, some investigators even categorically deny (...) that any experimental paradigm has been employed or any evidence can be adduced to support the claim that disownership experiences occur during the RHI. It goes without saying that RHI experiences can be elusive, and that there is some evidence to support claims that supernumerary limb experiences can sometimes occur. Here, however, we test the claim that the conscious experience of disownership can occur during the RHI. In order to test this claim, we developed two new online proxies—onset time for the illusion and illusion duration—and combined these with established questionnaires that concern the conscious contents of the RHI, in particular ownership/disownership experiences. Both online proxy data and post hoc questionnaire data converge in supporting the claim that disownership experiences do occur, at least when the left hand is the object of investigation. Our findings that onset time and illusion duration are reliable measures suggest that investigations of the RHI stand to benefit by devoting more attention to data collected while the RHI is being experienced, in particular data concerning temporal dynamics. (shrink)

Many philosophers have claimed that evidence for a theory is better when multiple independent tests yield the same result, i.e., when experimental results are robust. Little has been said about the grounds on which such a claim rests, however. The present essay presents an analysis of the evidential value of robustness that rests on the fallibility of assumptions about the reliability of testing procedures and a distinction between the strength of evidence and the security of an evidence claim. Robustness (...) can enhance the security of an evidence claim either by providing what I call second-order evidence, or by providing back-up evidence for a hypothesis. (shrink)

Much discussion about experimental philosophy and philosophical methodology has been framed in terms of the reliability of intuitions, and even when it has not been about reliability per se, it has been focused on whether intuitions meet whatever conditions they need to meet to be trustworthy as evidence. But really that question cannot be answered independently from the questions, evidence for what theories arrived at by what sorts of inferences? I will contend here that not just philosophy's sources of (...) evidence, but also its inferential resources, are in great need of closer examination. (shrink)

The thesis of theory-ladenness of observations, in its various guises, is widely considered as either ill-conceived or harmless to the rationality of science. The latter view rests partly on the work of the proponents of New Experimentalism who have argued, among other things, that experimental practices are efficient in guarding against any epistemological threat posed by theory-ladenness. In this paper I show that one can generate a thesis of theory-ladenness for experimental practices from an influential New Experimentalist account. (...) The notion I introduce for this purpose is the concept of ‘theory-driven data reliability judgments’, according to which theories which are sought to be tested with a particular set of data guide reliability judgments about those very same data. I provide various prominent historical examples to show that TDRs are used by scientists to resolve data conflicts. I argue that the rationality of the practices which employ TDRs can be saved if the independent support of the theories driving TDRs is construed in a particular way. (shrink)

To obtain effective fusion results of multi source evidences with different importance, an evidence fusion method with importance discounting factors based on neutrosopic probability analysis in DSmT framework is proposed. First, the reasonable evidence sources are selected out based on the statistical analysis of the pignistic probability functions of single focal elements. Secondly, the neutrosophic probability analysis is conducted based on the similarities of the pignistic probability functions from the prior evidence knowledge of the reasonable evidence sources. Thirdly, the importance (...) discounting factors of the reasonable evidence sources are obtained based on the neutrosophic probability analysis and the reliability discounting factors of the real-time evidences are calculated based on probabilistic-based distances. Fourthly, the real-time evidences are discounted by the importance discounting factors and then the evidences with the mass assignments of neutrosophic empty sets are discounted by the reliability discounting factors. Finally, DSmT+PCR5 of importance discounted evidences is applied. Experimental examples show that the decision results based on the proposed fusion method are different from the results based on the existed fusion methods. Simulation experiments of recognition fusion are performed and the superiority of proposed method is testified well by the simulation results. (shrink)

Can experimental philosophy help us answer central questions about the nature of moral responsibility, such as the question of whether moral responsibility is compatible with determinism? Specifically, can folk judgments in line with a particular answer to that question provide support for that answer. Based on reasoning familiar from Condorcet’s Jury Theorem, such support could be had if individual judges track the truth of the matter independently and with some modest reliability: such reliability quickly aggregates as the number of (...) judges goes up. In this chapter, however, I argue, partly based on empirical evidence, that although non-specialist judgments might on average be more likely than not to get things right, their individual likelihoods fail to aggregate because they do not track truth with sufficient independence. (shrink)

Descriptive accounts of the nature of explanation in neuroscience and the global goals of such explanation have recently proliferated in the philosophy of neuroscience and with them new understandings of the experimental practices of neuroscientists have emerged. In this paper, I consider two models of such practices; one that takes them to be reductive; another that takes them to be integrative. I investigate those areas of the neuroscience of learning and memory from which the examples used to substantiate these (...) models are culled, and argue that the multiplicity of experimental protocols used in these research areas presents specific challenges for both models. In my view, these challenges have been overlooked largely because philosophers have hitherto failed to pay sufficient attention to fundamental features of experimental practice. I demonstrate that when we do pay attention to such features, evidence for reduction and integrative unity in neuroscience is simply not borne out. I end by suggesting some new directions for the philosophy of neuroscience that pertain to taking a closer look at the nature of neuroscientific experiments. (shrink)

Until recently, experimental philosophy has been associated with the questionnaire-based study of intuitions; however, experimental philosophers now adapt a wide range of empirical methods for new philosophical purposes. New methods include paradigms for behavioural experiments from across the social sciences as well as computational methods from the digital humanities that can process large bodies of text and evidence. This book offers an accessible overview of these exciting innovations. The volume brings together established and emerging research leaders from several (...) areas of experimental philosophy to explore how new empirical methods can contribute to philosophical debates. Each chapter presents one or several methods new to experimental philosophy, demonstrating their application in a key area of philosophy and discussing their strengths and limitations. Methods covered include eye tracking, virtual reality technology, neuroimaging, statistical learning, and experimental economics as well as corpus linguistics, visualisation techniques and data and text mining. The volume explores their use in moral philosophy and moral psychology, epistemology, philosophy of science, metaphysics, philosophy of language, philosophy of mind and the history of ideas. Methodological Advances in Experimental Philosophy is essential reading for undergraduates, graduate students and researchers working in experimental philosophy. (shrink)

Experimental philosophy involves subjecting philosophical methods and judgments to empirical scrutiny. I begin by exploring conceptual, confirmational, and empirical factors that limit the significance of experiment-based and survey-based approaches to the evaluation of philosophical epistemic activities. I then consider specific criticisms of experimental philosophy: its experimental conditions lack ecological validity; it wrongly assumes that philosophers rely on psychologized data; it overlooks the reflective and social elements of philosophical case analysis; it misconstrues the importance of both procedural and (...) evaluative forms of philosophical expertise; it incorrectly views psychological bias as incompatible with reliability; and it generalizes to a global, self-defeating skepticism about case judgment. I explain why these criticisms should be understood as converging and interdependent. I also set out a three-level model of philosophical case judgment that frames the criticisms. (shrink)

Various studies show moral intuitions to be susceptible to framing effects. Many have argued that this susceptibility is a sign of unreliability and that this poses a methodological challenge for moral philosophy. Recently, doubt has been cast on this idea. It has been argued that extant evidence of framing effects does not show that moral intuitions have an unreliability problem. I argue that, even if the extant evidence suggests that moral intuitions are fairly stable with respect to what intuitions we (...) have, the effect of framing on the strength of those intuitions still needs to be taken into account. I argue that this by itself poses a methodological challenge for moral philosophy. (shrink)

Assertion is fundamental to our lives as social and cognitive beings. Philosophers have recently built an impressive case that the norm of assertion is factive. That is, you should make an assertion only if it is true. Thus far the case for a factive norm of assertion been based on observational data. This paper adds experimental evidence in favor of a factive norm from six studies. In these studies, an assertion’s truth value dramatically affects whether people think it should (...) be made. Whereas nearly everyone agreed that a true assertion supported by good evidence should be made, most people judged that a false assertion supported by good evidence should not be made. The studies also suggest that people are consciously aware of criteria that guide their evaluation of assertions. Evidence is also presented that some intuitive support for a non-factive norm of assertion comes from a surprising tendency people have to misdescribe cases of blameless rule-breaking as cases where no rule is broken. (shrink)

In “Normativity and Epistemic Intuitions”, Weinberg, Nichols and Stich famously argue from empirical data that East Asians and Westerners have different intuitions about Gettier -style cases. We attempted to replicate their study about the Car case, but failed to detect a cross - cultural difference. Our study used the same methods and case taken verbatim, but sampled an East Asian population 2.5 times greater than NEI’s 23 participants. We found no evidence supporting the existence of cross - cultural difference about (...) the intuition concerning the Gettier car case. Taken together with the failures of both of the existing replication studies, our results provide strong evidence that the purported cross - cultural difference in Gettier intuitions does not exist. (shrink)

In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors claim, are more in line with traditionally accepted solutions of classical problems. This inherent bias, so the argument goes, is one of the factors that leads more men than women to pursue degrees and careers in philosophy. These findings have received a considerable amount of attention and the (...) paper is to appear in the second edition of Experimental Philosophy edited by Knobe and Nichols , which itself is an influential outlet. Given the exposure of these results, we attempted to replicate three of the classes of questions that Buckwalter and Stich review in their paper and for which they report significant differences. We failed to replicate the results using several different sources for data collection (one being identical to the original procedures.. (shrink)

In one of the earlier influential papers in the field of experimental philosophy titled Normativity and Epistemic Intuitions published in 2001, Jonathan M. Weinberg, Shaun Nichols and Stephen Stich reported that respondents answered Gettier type questions differently depending on their ethnic background as well as socioeconomic status. There is currently a debate going on, on the significance of the results of Weinberg et al. (2001) and its implications for philosophical methodology in general and epistemology in specific. Despite the debates, (...) however, to our knowledge, there has not been a replication attempt of the experiments of the original paper. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes and hence greater power to detect differences, we failed to detect significant differences between the above-mentioned ethnic and socioeconomic groups. Our results suggest that epistemic intuitions are more robust across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups that follows from Weinberg et al. (2001) needs to be corrected. (shrink)

I describe two traditions of philosophical accounts of evidence: one characterizes the notion in terms of signs of success, the other characterizes the notion in terms of conditions of success. The best examples of the former rely on the probability calculus, and have the virtues of generality and theoretical simplicity. The best examples of the latter describe the features of evidence which scientists appeal to in practice, which include general features of methods, such as quality and relevance, and general features (...) of evidence, such as patterns in data, concordance with other evidence, and believability of the evidence. Two infamous episodes from biomedical research help to illustrate these features. Philosophical characterization of these latter features—conditions of success—has the virtue of potential relevance to, and descriptive accuracy of, practices of experimental scientists. (shrink)

How do archaeologists make effective use of physical traces and material culture as repositories of evidence? Material Evidence is a collection of 19 essays that take a resolutely case-based approach to this question, exploring key instances of exemplary practice, instructive failures, and innovative developments in the use of archaeological data as evidence. The goal is to bring to the surface the wisdom of practice, teasing out norms of archaeological reasoning from evidence. -/- Archaeologists make compelling use of an enormously diverse (...) range of material evidence, from garbage dumps to monuments, from finely crafted artifacts rich with cultural significance to the inadvertent transformation of landscapes over the long term. Each contributor to Material Evidence identifies a particular type of evidence with which they grapple and considers, with reference to concrete examples, how archaeologists construct evidential claims, critically assess them, and bring them to bear on pivotal questions about the cultural past. -/- Historians, cultural anthropologists, philosophers, and science studies scholars are increasingly interested in working with material "things" as objects of inquiry and as evidence – and they acknowledge on all sides just how challenging this is. One of the central messages of the book is that close analysis of archaeological best practice can yield constructive guidelines for practice that have much to offer practitioners within archaeology and well beyond. (shrink)

In 1988, three laboratories performed a radiocarbon analysis of the Turin Shroud. The results, which were centralized by the British Museum and published in Nature in 1989, provided ‘conclusive evidence’ of the medieval origin of the artefact. However, the raw data were never released by the institutions. In 2017, in response to a legal request, all raw data kept by the British Museum were made accessible. A statistical analysis of the Nature article and the raw data strongly suggests that homogeneity (...) is lacking in the data and that the procedure should be reconsidered. (shrink)

Research in experimental philosophy has increasingly been turning to corpus methods to produce evidence for empirical claims, as they open up new possibilities for testing linguistic claims or studying concepts across time and cultures. The present article reviews the quasi-experimental studies that have been done using textual data from corpora in philosophy, with an eye for the modeling and experimental design that enable statistical inference. I find that most studies forego comparisons that could control for confounds, and (...) that only a little less than half employ statistical testing methods to control for chance results. Furthermore, at least some researchers make modeling decisions that either do not take into account the nature of corpora and of the word-concept relationship, or undermine the experiment's capacity to answer research questions. I suggest that corpus methods could both provide more powerful evidence and gain more mainstream acceptance by improving their modeling practices. (shrink)

What is data? That question is the fundamental investigation of this dissertation. I have developed a methodology from social-scientific processes to explore how different people understand the concept of data, rather than to rely on my own philosophical intuitions or thought experiments about the “nature” of data. The evidence I have gathered as to different individuals' constructions of data can be used to inform further inquiry of data and the design of information systems. My research demonstrates that people have different (...) constructions of data. The methodology of the SDFN, created for this dissertation, has proven able to probe those understandings. The SDFN, loosely based on a DFD and combined with ideas from SNA, provides a way of discovering practical definitions of hard-to-operationalize terms like data. The process of repeatedly categorizing various items as data allows the methodology to explore how participants actually use the term, rather than relying on theoretical dictionary-based definitions. Analysis of the interviews found three different constructions of data: data as communications, a container for meaning; data as subjective observations, sense-impressions filtered by knowledge; and data as objective facts, measurements revealing the relationships of reality. (shrink)

Using placebos in day-to-day practice is an ethical problem. This paper summarises the available epidemiological evidence to support this difficult decision. Based on these data we propose to differentiate between placebo and “knowledge framing”. While the use of placebo should be confined to experimental settings in clinical trials, knowledge framing — which is only conceptually different from placebo — is a desired, expected and necessary component of any doctor-patient encounter. Examples from daily practice demonstrate both, the need to investigate (...) the effects of knowledge framing and its impact on ethical, medical, economical and legal decisions. (shrink)

ABSTRACTThe proper role of intuitions in philosophy has been debated throughout its history, and especially since the turn of the twenty-first century. The context of this recent debate within analytic philosophy has been the heightened interest in intuitions as data points that need to be accommodated or explained away by philosophical theories. This, in turn, has given rise to a sceptical movement called experimental philosophy, whose advocates seek to understand the nature and reliability of such intuitions. Yet such scepticism (...) of intuition or introspective methods can be found in earlier periods and across philosophical traditions. Indeed, the Neo-Confucian philosophers of the Song and Ming dynasties seem to exemplify this very tension, as they can be divided into an intuitionistic school on the one hand and an investigative school on the other. In this paper, I argue that, notwithstanding some obvious d... (shrink)

This paper presents empirical evidence regarding the nature of our commonsense concept of belief. The findings have significant bearing upon claims made by authors concerned with the Folk Psychology Debate - in particular, they challenge Stephen Stich's (1983) claims that folk psychology is committed to a broad account of belief states. In contrast it is found that folk psychology favours a narrow account of belief. This result is important in refuting Stich's claim that the folk psychological concept of belief has (...) no role to play in a developed cognitive science. The paper also presents evidence regarding the influence of several factors on folk psychological judgements of belief individuation (emphasised similarities/differences between the referents of beliefs, nature of past beliefs, goal of classification), and introduces a methodology by which to investigate further factors. It is argued that the observed conflict between individual speculations about likely folk psychological intuitions within the philosophical literature and actual empirical data regarding subjects' responses highlights the important contribution of experimental psychology in exploring such philosophical issues. (shrink)

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 (...) main journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field. (shrink)

Behavioural flexibility is often treated as the gold standard of evidence for more sophisticated or complex forms of animal cognition, such as planning, metacognition and mindreading. However, the evidential link between behavioural flexibility and complex cognition has not been explicitly or systematically defended. Such a defence is particularly pressing because observed flexible behaviours can frequently be explained by putatively simpler cognitive mechanisms. This leaves complex cognition hypotheses open to ‘deflationary’ challenges that are accorded greater evidential weight precisely because they offer (...) putatively simpler explanations of equal explanatory power. This paper challenges the blanket preference for simpler explanations, and shows that once this preference is dispensed with, and the full spectrum of evidence—including evolutionary, ecological and phylogenetic data—is accorded its proper weight, an argument in support of the prevailing assumption that behavioural flexibility can serve as evidence for complex cognitive mechanisms may begin to take shape. An adaptive model of cognitive-behavioural evolution is proposed, according to which the existence of convergent trait–environment clusters in phylogenetically disparate lineages may serve as evidence for the same trait–environment clusters in other lineages. This, in turn, could permit inferences of cognitive complexity in cases of experimental underdetermination, thereby placing the common view that behavioural flexibility can serve as evidence for complex cognition on firmer grounds. (shrink)

Conwy Lloyd Morgan (1852–1936) is widely regarded as the father of modern comparative psychology. Yet, Morgan initially had significant doubts about whether a genuine science of comparative psychology was even possible, only later becoming more optimistic about our ability to make reliable inferences about the mental capacities of non-human animals. There has been a fair amount of disagreement amongst scholars of Morgan’s work about the nature, timing, and causes of this shift in Morgan’s thinking. We argue that Morgan underwent two (...) quite different shifts of attitude towards the proper practice of comparative psychology. The first was a qualified acceptance of the Romanesian approach to comparative psychology that he had initially criticized. The second was a shift away from Romanes’ reliance on systematizing anecdotal evidence of animal intelligence towards an experimental approach, focused on studying the development of behaviour. We emphasize the role of Morgan’s evolving epistemological views in bringing about the first shift – in particular, his philosophy of science. We emphasize the role of an intriguing but overlooked figure in the history of comparative psychology in explaining the second shift, T. Mann Jones, whose correspondence with Morgan provided an important catalyst for Morgan’s experimental turn, particularly the special focus on development. We also shed light on the intended function of Morgan’s Canon, the methodological principle for which Morgan is now mostly known. The Canon can only be properly understood by seeing it in the context of Morgan’s own unique experimental vision for comparative psychology. (shrink)

The use of neuroscientific evidence in criminal trials has been steadily increasing. Despite progress made in recent decades in understanding the mechanisms of psychological and behavioral functioning, neuroscience is still in an early stage of development and its potential for influencing legal decision-making is highly contentious. Scholars disagree about whether or how neuroscientific evidence might impact prescriptions of criminal culpability, particularly in instances in which evidence of an accused’s history of mental illness or brain abnormality is offered to support a (...) plea of not criminally responsible. In the context of these debates, philosophers and legal scholars have identified numerous problems with admitting neuroscientific evidence in legal contexts. To date, however, less has been said about the challenges of evaluating the evidence upon which integrative mechanistic explanations that bring together evidence from different areas of neuroscience are based. As we explain, current criteria for evaluating such evidence to determine its admissibility in legal contexts are inadequate. Appealing to literature in the philosophy of scientific experimentation and theoretical work in the social, cognitive and behavioral sciences, we lay the groundwork for reforming these criteria and identify some of the implications of modifying them. (shrink)

To address the underrepresentation of women in philosophy effectively, we must understand the causes of the early loss of women. In this paper we challenge one of the few explanations that has focused on why women might leave philosophy at early stages. Wesley Buckwalter and Stephen Stich offer some evidence that women have different intuitions than men about philosophical thought experiments. We present some concerns about their evidence and we discuss our own study, in which we attempted to replicate their (...) results for 23 different responses to 14 scenarios . We also conducted a literature search to see if other philosophers or psychologists have tested for gender differences in philosophical intuitions. Based on our findings, we argue that that it is unlikely that gender differences in intuitions play a significant role in driving women from philosophy. (shrink)

The investigation of the degree of amotivation and subsequent intervention towards the motivation of undergraduate vocational and technical education (VTE) students has not received the same amount of attention as other disciplines. Despite the negative impact of a lack of volitional drive on students' practical skills learning, there is scarcity of literature on amotivation among VTE undergraduate students. This study aimed to demonstrate the effectiveness of problem-based learning (PBL) in transitioning undergraduate students from a state of being amotivated to motivated. (...) The study utilized a quasi-experimental research design and selected 168 students in their penultimate and final years majoring in agricultural education, business education, computer education, home economics, and industrial technical education who met the study's inclusion criteria. The intervention consisted of eight weeks of treatment and four weeks of follow-up meetings. An existing academic motivation scale was adapted for use, and data was collected through a self-report questionnaire. Data analysis was conducted using independent sample t-tests, and paired sample t-tests. The findings revealed that the level of amotivation among the students was high, and PBL had a significant impact on transitioning VTE students from being amotivated to motivated in the treatment group compared to those in the control group. Furthermore, the positive gains were maintained by the treatment group at follow-up. The study suggests that a PBL program can effectively address students' lack of volitional drive to engage in academic activities among undergraduate students majoring in agricultural education, business education, computer education, home economics, and industrial technical in Nigeria. (shrink)

In this paper, we propose the introduction of a neutrosophic chi-square-test for consistency, incorporating neutrosophic statistics. Our aim is to modify the existing chi-square -test for consistency in order to analyze imprecise data. We present a novel test statistic for the neutrosophic chi-square -test for consistency, which accounts for the uncertainties inherent in the data. To evaluate the performance of the proposed test, we compare it with the traditional chi-square -test for consistency based on classical statistics. By conducting a comparative (...) analysis, we assess the efficiency and effectiveness of our proposed neutrosophic chi-square-test for consistency. Furthermore, we illustrate the application of the proposed test through a numerical example, demonstrating how it can be utilized in practical scenarios. Through this implementation, we aim to provide empirical evidence of the improved performance of our proposed test when compared to the traditional chi-square-test for consistency based on classical statistics. We anticipate that the proposed neutrosophic chi-square-test for consistency will outperform its classical counterpart, offering enhanced accuracy and reliability when dealing with imprecise data. This advancement has the potential to contribute significantly to the field of statistical analysis, particularly in situations where data uncertainty and imprecision are prevalent. (shrink)

Why scientists reach an agreement on new experimental methods when there are conflicts of interest about the evidence they yield? I argue that debiasing methods play a crucial role in this consensus, providing a warrant about the impartiality of the outcome regarding the preferences of different parties involved in the experiment. From a contractarian perspective, I contend that an epistemic pre-requisite for scientists to agree on an experimental method is that this latter is neutral regarding their competing interests. (...) I present two medical experiments (on smallpox inoculation and Mesmerism) in which debiasing procedures such as blinding and data tabulation provided warrants of impartiality that made people agree on the experimental design even if they disagreed on the outcome. (shrink)

In the face of continuing assumptions by many scientists and journal editors that p-values provide a gold standard for inference, counter warnings are published periodically. But the core problem is not with p-values, per se. A finding that “p-value is less than α” could merely signal that a critical value has been exceeded. The question is why, when estimating a parameter, we provide a range (a confidence interval), but when testing a hypothesis about a parameter (e.g. µ = x) we (...) proceed as if “=” entails exact equality of the parameter with x. That standard is hard to meet, and is not a standard expected for power calculations, where we are satisfied to reject a null hypothesis H0 if the result is merely “detectably” different from (exact) H0. This paper explores, with resampling (simulation) methods, the impacts on p-values, and alternatives, if the null hypothesis is defined as a thick or thin range of values. It also examines, empirically, the extent to which the p-value may or may not be a good predictor of the probability that H0 is true, given the distribution of the data. (shrink)

We simulate trial data to test speculative claims about research methods, such as the impact of publication bias.

The study was conducted to compare manual and computerized software techniques of data management and analysis in educational research. Specifically, the study investigated whether there was a significant difference in the results of Pearson correlation, independent t-test and ANOVA obtained from using manual and computerized software technique of data analyses. Three null hypotheses were formulated accordingly to guide the study. The study adopted a quasi-experimental research design where several data were generated by the researchers and analyzed using manual and (...) computerized software techniques. The data were generated to suit the required data of each statistical method of analysis. CASIO fx-991ES PLUS NATURAL DISPLAY scientific calculator and statistical tables were used for manual analysis; while data analysis tool pack of Microsoft Excel version 2013 were used for computerized software analysis. The results of the analysis revealed that both manual and computerized software techniques yielded the same results for Pearson correlation, independent t-test and ANOVA. It was concluded that though both manual and computerized techniques are reliable and dependable, computerized technique is faster and efficient in managing and analyzing data than manual technique. It was recommended, among other things, that any of the techniques should be used without fear when computing Pearson, independent t-test and one-way ANOVA as it is the same results that will be gotten. (shrink)

Attempts to introduce Gestalt theory into the realm of visual neuroscience are discussed on both theoretical and experimental grounds. To define the framework in which these proposals can be defended, this paper outlines the characteristics of a standard model, which qualifies as a received view in the visual neurosciences, and of the research into natural images statistics. The objections to the standard model and the main questions of the natural images research are presented. On these grounds, this paper defends (...) the view that Gestalt psychology and experimental phenomenology provide a contribution to the research into perception by the construction of phenomenological models for an ecologically meaningful interpretation of the empirical evidence and the hypothetical constructs of the natural image research within the visual neuroscience. A formal framework for the phenomenological models is proposed, wherein Gestalt theoretical principles and empirical evidence are represented in terms of topological properties and relationships, which account for the order and structures that make the environment accessible to observers at a relevant behavioural level. It is finally argued that these models allow us to evaluate the principles and the empirical evidence of various natures which are integrated from different fields into the research into perception, and in particular into visual neurosciences. (shrink)

The human brain consists of approximately 100 billion electrically active neurones that generate an endogenous electromagnetic field, whose role in neuronal computing has not been fully examined. The source, magnitude and likely influence of the brain's endogenous em field are here considered. An estimate of the strength and magnitude of the brain's em field is gained from theoretical considerations, brain scanning and microelectrode data. An estimate of the likely influence of the brain's em field is gained from theoretical principles and (...) considerations of the experimental effects of external em fields on neurone firing both in vitro and in vivo. Synchronous firing of distributed neurones phase-locks induced em field fluctuations to increase their magnitude and influence. Synchronous firing has previously been demonstrated to correlate with awareness and perception, indicating that perturbations to the brain's em field also correlate with awareness. The brain's em field represents an integrated electromagnetic field representation of distributed neuronal information and has dynamics that closely map to those expected for a correlate of consciousness. I propose that the brain's em information field is the physical substrate of conscious awareness - the cemi field - and make a number of predictions that follow from this proposal. Experimental evidence pertinent to these predictions is examined and shown to be entirely consistent with the cemi field theory. This theory provides solutions to many of the intractable problems of consciousness - such as the binding problem - and provides new insights into the role of consciousness, the meaning of free will and the nature of qualia. It thus places consciousness within a secure physical framework and provides a route towards constructing an artificial consciousness. (shrink)

While children’s interaction with digital technologies is a matter of interest around the world, evidence based on nationally representative data about how integrated these tools are in children’s everyday life is still limited in New Zealand. This research report presents findings from a study that explores children’s internet access, online skills, practices, and opportunities. This report is part of Netsafe’s research project Ngā taiohi matihiko o Aotearoa - New Zealand Kids Online, and our first publication as a member of Global (...) Kids Online. Generating insightful, reliable evidence about New Zealand children’s online experiences is vital to develop adequate support that reflects children’s experiences and needs. This, in turn, will help them to manage online risks and potential harm from behaviours such as cyberbullying, harassment, and other forms of abuse and intimidation. (shrink)

DOI: 10.1080/00031305.2018.1564697 When the editors of Basic and Applied Social Psychology effectively banned the use of null hypothesis significance testing (NHST) from articles published in their journal, it set off a fire-storm of discussions both supporting the decision and defending the utility of NHST in scientific research. At the heart of NHST is the p-value which is the probability of obtaining an effect equal to or more extreme than the one observed in the sample data, given the null hypothesis and (...) other model assumptions. Although this is conceptually different from the probability of the null hypothesis being true, given the sample, p-values nonetheless can provide evidential information, toward making an inference about a parameter. Applying a 10,000-case simulation described in this article, the authors found that p-values’ inferential signals to either reject or not reject a null hypothesis about the mean (α = 0.05) were consistent for almost 70% of the cases with the parameter’s true location for the sampled-from population. Success increases if a hybrid decision criterion, minimum effect size plus p-value (MESP), is used. Here, rejecting the null also requires the difference of the observed statistic from the exact null to be meaningfully large or practically significant, in the researcher’s judgment and experience. The simulation compares performances of several methods: from p-value and/or effect size-based, to confidence-interval based, under various conditions of true location of the mean, test power, and comparative sizes of the meaningful distance and population variability. For any inference procedure that outputs a binary indicator, like flagging whether a p-value is significant, the output of one single experiment is not sufficient evidence for a definitive conclusion. Yet, if a tool like MESP generates a relatively reliable signal and is used knowledgeably as part of a research process, it can provide useful information. (shrink)

The question of when to stop an unsuccessful experiment can be difficult to answer from an individual perspective. To help to guide these decisions, we turn to the social epistemology of science and investigate knowledge inquisition within a group. We focused on the expensive and lengthy experiments in high energy physics, which were suitable for citation-based analysis because of the relatively quick and reliable consensus about the importance of results in the field. In particular, we tested whether the time spent (...) on a scientific project correlates with the project output. Our results are based on data from the high energy physics laboratory Fermilab. They point out that there is an epistemic saturation point in experimenting, after which the likelihood of obtaining major results drops. With time the number of less significant publications does increase, but highly cited ones do not get published. Since many projects continue to run after the epistemic saturation point, it becomes clearer that decisions made about continuing them are not always rational. (shrink)