The modern abundance and prominence of data has led to the development of “data science” as a new field of enquiry, along with a body of epistemological reflections upon its foundations, methods, and consequences. This article provides a systematic analysis and critical review of significant open problems and debates in the epistemology of data science. We propose a partition of the epistemology of data science into the following five domains: (i) the constitution of data science; (ii) the kind of enquiry (...) that it identifies; (iii) the kinds of knowledge that data science generates; (iv) the nature and epistemological significance of “black box” problems; and (v) the relationship between data science and the philosophy of science more generally. (shrink)

There is now a general consensus amongst philosophers in the values in science literature that values necessarily play a role in core areas of scientific inquiry. We argue that attention should now be turned from debating the value-free ideal to delineating legitimate from illegitimate influences of values in science, a project we dub “The New Demarcation Problem.” First, we review past attempts to demarcate the uses of values and propose a categorization of the strategies by where they seek to draw (...) legitimacy from. Next, we propose a set of desiderata for what we take to be a satisfactory solution and present a case study where conflicting sets of values clearly impinge on science, but where the legitimacy of their influence is ambiguous. We use these desiderata and the case study to illustrate what we take to be the strengths and weaknesses of current strategies. To be clear, our goal is not to answer the question we pose, but to articulate a framework within which a solution can be judged. (shrink)

Dubljević and company’s proposed approach for incorporating a socio-political perspective into neuroethics has clear potential to help mitigate the effects of research ‘hype’ relating to neuroethics. Their approach serves as a social regulation meant to improve the realizability of neuroethics research. Drawing on Dubljević et al. s suggestion, we consider how incorporating a socio-political perspective in other scientific disciplines could help the scientific community as a whole move beyond the infamous ‘reproducibility crisis’ in science. The reproducibility crisis is a concern (...) in science stemming from the revelation that most scientific results are difficult, or impossible, to replicate (Frias-Navarro et al., 2020). By applying the four principles proposed by Dubljević et al., the scientific community can avoid many of the pitfalls that have led to the reproducibility crisis, such as the file drawer effect, a publication bias preventing negative results from being published, or the publish-or-perish culture - the pressure for scientists to publish highly influential papers in high impact journals in order to keep their funding (Rosenthal, 1979; Begley & Ioannidis, 2015). As such, we argue that, in its final form, this socio-political framework begs for true open science, wherein systematically sharing data would enable enlightened policymaking by showing a picture closer to the ground-level realities of scientific research. (shrink)

The cross-cultural differences in epistemic intuitions reported by Weinberg, Nichols and Stich (2001; hereafter: WNS) laid the ground for the negative program of experimental philosophy. However, most of WNS’s findings were not corroborated in further studies. The exception here is the study concerning purported differences between Westerners and Indians in knowledge ascriptions concerning the Zebra Case, which was never properly replicated. Our study replicates the above-mentioned experiment on a considerably larger sample of Westerners (n = 211) and Indians (n = (...) 204). The analysis found a significant difference between the ethnic groups in question in the predicted direction: Indians were more likely to attribute knowledge in the Zebra Case than Westerners. In this paper, we offer an explanation of our result that takes into account the fact that replications of WNS’s other experiments did not find any cross-cultural differences. We argue that the Zebra Case is unique among the vignettes tested by WNS since it should not be regarded as a Gettier case but rather as a scenario exhibiting skeptical pressure concerning the reliability of sense-perception. We argue that skepticism towards perception as a means of gaining knowledge is a trope that is deeply rooted in Western epistemology but is very much absent from Classical Indian philosophical inquiry. This line of reasoning is based on a thorough examination of the skeptical scenarios discussed by philosophers of the Indian Nyaya tradition and their adversaries. (shrink)

The literature in agent-based social simulation suggests that a model is validated when it is shown to ‘successfully’, ‘adequately’ or ‘satisfactorily’ represent the target phenomenon. The notion of ‘successful’, ‘adequate’ or ‘satisfactory’ representation, however, is both underspecified and difficult to generalise, in part, because practitioners use a multiplicity of criteria to judge representation, some of which are not entirely dependent on the testing of a computational model during validation processes. This article argues that practitioners should address social epistemology to achieve (...) a deeper understanding of how warrants for belief in the adequacy of representation are produced. Two fundamental social processes for validation: interpretation and commensuration, are discussed to justify this claim. The analysis is advanced with a twofold aim. First, it shows that the conceptualisation of validation could greatly benefit from incorporating elements of social epistemology, for the criteria used to judge adequacy of representation are influenced by the social, cognitive and physical organisation of social simulation. Second, it evidences that standardisation tools such as protocols and frameworks fall short in accounting for key elements of social epistemology that affect different instances of validation processes. (shrink)

Given the reproducibility crisis (or replication crisis), more psychologists and social-cultural scientists are getting involved with Bayesian inference. Therefore, the current article provides a brief overview of programs (or software) and steps to conduct Bayesian data analysis in social sciences.

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction (...) of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. (shrink)

The replicability crisis refers to the apparent failures to replicate both important and typical positive experimental claims in psychological science and biomedicine, failures which have gained increasing attention in the past decade. In order to provide evidence that there is a replicability crisis in the first place, scientists have developed various measures of replication that help quantify or “count” whether one study replicates another. In this nontechnical essay, I critically examine five types of replication measures used in the landmark article (...) “Estimating the reproducibility of psychological science” (Open Science Collaboration, Science, 349, ac4716, 2015) based on the following techniques: subjective assessment, null hypothesis significance testing, comparing effect sizes, comparing the original effect size with the replication confidence interval, and meta-analysis. The first four, I argue, remain unsatisfactory for a variety of conceptual or formal reasons, even taking into account various improvements. By contrast, at least one version of the meta-analytic measure does not suffer from these problems. It differs from the others in rejecting dichotomous conclusions, the assumption that one study replicates another or not simpliciter. I defend it from other recent criticisms, concluding however that it is not a panacea for all the multifarious problems that the crisis has highlighted. (shrink)

BackgroundEven though research integrity (RI) training programs have been developed in the last decades, it is argued that current training practices are not always able to increase RI-related awareness within the scientific community. Defining and understanding the capacities and lacunas of existing RI training are becoming extremely important for developing up-to-date educational practices to tackle present-day challenges. Recommendations on how to implement RI education have been primarily made by selected people with specific RI-related expertise. Those recommendations were developed mainly without (...) consulting a broader audience with no specific RI expertise. Moreover, the academic literature lacks qualitative studies on RI training practices. For these reasons, performing in-depth focus groups with non-RI expert stakeholders are of a primary necessity to understand and outline how RI education should be implemented.MethodsIn this qualitative analysis, different focus groups were conducted to examine stakeholders’ perspectives on RI training practices. Five stakeholders' groups, namely publishers and peer reviewers, researchers on RI, RI trainers, PhDs and postdoctoral researchers, and research administrators working within academia, have been identified to have a broader overview of state of the art.ResultsA total of 39 participants participated in five focus group sessions. Eight training-related themes were highlighted during the focus group discussions. The training goals, timing and frequency, customisation, format and teaching approach, mentoring, compulsoriness, certification and evaluation, and RI-related responsibilities were discussed. Although confirming what was already proposed by research integrity experts in terms of timing, frequency, duration, and target audience in organising RI education, participants proposed other possible implementations strategies concerning the teaching approach, researchers' obligations, and development an evaluation-certification system.ConclusionsThis research aims to be a starting point for a better understanding of necessary, definitive, and consistent ways of structuring RI education. The research gives an overview of what has to be considered needed in planning RI training sessions regarding objectives, organisation, and teaching approach. (shrink)

Computational reproducibility possesses its own dynamics and narratives of crisis. Alongside the difficulties of computing as an ubiquitous yet complex scientific activity, computational reproducibility suffers from a naive expectancy of total reproducibility and a moral imperative to embrace the principles of free software as a non-negotiable epistemic virtue. We argue that the epistemic issues at stake in actual practices of computational reproducibility are best unveiled by focusing on software as a pivotal concept, one that is surprisingly often overlooked in accounts (...) of reproducibility issues. Software is not only about designing and coding but also about maintaining, supporting, distributing, licensing, and governance; it is not only about developers but also about users. We focus on openness debates among computational chemists involved in molecular modeling software packages as empirical grounding for our argument. We then identify and analyse four epistemic characteristics as key to the role of software in computational reproducibility. (shrink)

Open access-introduction into moral philosophy in German language that contains chapters on the concept of morality, on the development and the main positions of normative ethics, on meta-ethics, and on the various fields of applied ethics. One of its distinctive features is that it explicitly reflects on the role of morality and ethics in modern society and that it analyses the import of alternative conceptual and normative positions for determining this role. The book can be freely downloaded from the publisher's (...) website via the URL below. (shrink)

The replication or reproducibility crisis in psychological science has renewed attention to philosophical aspects of its methodology. I provide herein a new, functional account of the role of replication in a scientific discipline: to undercut the underdetermination of scientific hypotheses from data, typically by hypotheses that connect data with phenomena. These include hypotheses that concern sampling error, experimental control, and operationalization. How a scientific hypothesis could be underdetermined in one of these ways depends on a scientific discipline’s epistemic goals, theoretical (...) development, material constraints, institutional context, and their interconnections. I illustrate how these apply to the case of psychological science. I then contrast this “bottom-up” account with “top-down” accounts, which assume that the role of replication in a particular science, such as psychology, must follow from a uniform role that it plays in science generally. Aside from avoiding unaddressed problems with top-down accounts, my bottom-up account also better explains the variability of importance of replication of various types across different scientific disciplines. (shrink)

Most discussions of the reproducibility crisis focus on its epistemic aspect: the fact that the scientific community fails to follow some norms of scientific investigation, which leads to high rates of irreproducibility via a high rate of false positive findings. The purpose of this paper is to argue that there is a heretofore underappreciated and understudied dimension to the reproducibility crisis in experimental psychology and neuroscience that may prove to be at least as important as the epistemic dimension. This is (...) the communication dimension. The link between communication and reproducibility is immediate: independent investigators would not be able to recreate an experiment whose design or implementation were inadequately described. I exploit evidence of a replicability and reproducibility crisis in computational science, as well as research into quality of reporting to support the claim that a widespread failure to adhere to reporting standards, especially the norm of descriptive completeness, is an important contributing factor in the current reproducibility crisis in experimental psychology and neuroscience. (shrink)

In the last decade Open Science principles, such as Open Access, study preregistration, use of preprints, making available data and code, and open peer review, have been successfully advocated for and are being slowly adopted in many different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of some of these Open Science practices, sometimes embracing them fully and sometimes partially or in a sub-optimal manner. In this article, we express concerns about (...) the violation of some of the Open Science principles and its potential impact on the quality of research output. We provide evidence of the misuses of these principles at different stages of the scientific process. We call for a wider adoption of Open Science practices in the hope that this work will encourage a broader endorsement of Open Science principles and serve as a reminder that science should always be a rigorous process, reliable and transparent, especially in the context of a pandemic where research findings are being translated into practice even more rapidly. (shrink)

It is relatively easy to state that information retrieval is a scientific discipline but it is rather difficult to understand why it is science because what is science is still under debate in the philosophy of science. To be able to convince others that IR is science, our ability to explain why is crucial. To explain why IR is a scientific discipline, we use a theory and a model of scientific study, which were proposed recently. The explanation involves mapping the (...) knowledge structure of IR to that of well-known scientific disciplines like physics. In addition, the explanation involves identifying the common aim, principles and assumptions in IR and in well-known scientific disciplines like physics, so that they constrain the scientific investigation in IR in a similar way as in physics. Therefore, there are strong similarities in terms of the knowledge structure and the constraints of the scientific investigations between IR and scientific disciplines like physics. Based on such similarities, IR is considered a scientific discipline. (shrink)

Objectivity, as one of the key attributes of science, has become an indispensable part of its ethos and a central theme of the philosophy of science. As such, it has been a subject of philosophical reflection by a number of authors. In our project – in which both philosophers of science and scientists participate – we examine the concept of objectivity in the natural sciences with the tools of experimental philosophy. We aim to identify specific operational dimensions of objectivity, those (...) with which current scientist actually work, thus making them accessible for further theoretical analysis and research. In this text, we present results from the first, qualitative phase of our research based on in-depth interviews and focus groups with scientists working in the Czech Republic. Further, we confront this empirical data with theoretical notions of objectivity. We also present other findings from the research and formulate hypotheses for the research’s subsequent phases. (shrink)

Some experiments are risky in that they cannot repeatedly produce certain phenomenon at will for study because the scientific knowledge of the process generating the uncertain phenomenon is poorly understood or may directly contradict with existing scientific knowledge. These experiments may have great impact not just to the scientific community but to mankind in general. Banning them from study may incur societies a great opportunity cost but accepting them runs the risk that scientists are doing junk science. How to make (...) an informed decision to accept/reject such study scientifically for the mainstream scientific community is of great importance to mankind. Here, we propose a statistical methodology to handle the situation. Specifically, we consider the likelihood of not observing the phenomenon after n trails so that it is statistically significant to have nil result. Consequently, we reject the hypothesis that there is some probability that we observe the phenomenon. (shrink)

We characterize access to empirical objects in biology from a theoretical perspective. Unlike objects in current physical theories, biological objects are the result of a history and their variations continue to generate a history. This property is the starting point of our concept of measurement. We argue that biological measurement is relative to a natural history which is shared by the different objects subjected to the measurement and is more or less constrained by biologists. We call symmetrization the theoretical and (...) often concrete operation which leads to considering biological objects as equivalent in a measurement. Last, we use our notion of measurement to analyze research strategies. Some strategies aim to bring biology closer to the epistemology of physical theories, by studying objects as similar as possible, while others build on biological diversity. (shrink)

"Why should we care about having true beliefs? And why do demonstrably false beliefs persist and spread despite consequences for the people who hold them? Philosophers of science Cailin O’Connor and James Weatherall argue that social factors, rather than individual psychology, are what’s essential to understanding the spread and persistence of false belief. It might seem that there’s an obvious reason that true beliefs matter: false beliefs will hurt you. But if that’s right, then why is it irrelevant to many (...) people whether they believe true things or not? In an age riven by "fake news," "alternative facts," and disputes over the validity of everything from climate change to the size of inauguration crowds, the authors argue that social factors, not individual psychology, are what’s essential to understanding the persistence of false belief and that we must know how those social forces work in order to fight misinformation effectively."–Publisher’s description. (shrink)

It has been argued that implicit biases are operative in philosophy and lead to significant epistemic costs in the field. Philosophers working on this issue have focussed mainly on implicit gender and race biases. They have overlooked ideological bias, which targets political orientations. Psychologists have found ideological bias in their field and have argued that it has negative epistemic effects on scientific research. I relate this debate to the field of philosophy and argue that if, as some studies suggest, the (...) same bias also exists in philosophy then it will lead to hitherto unrecognised epistemic hazards in the field. Furthermore, the bias is epistemically different from the more familiar biases in respects that are important for epistemology, ethics, and metaphilosophy. (shrink)

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)

In 1979 astronomer Carl Sagan popularized the aphorism “extraordinary claims require extraordinary evidence”. But Sagan never defined the term “extraordinary.” Ambiguity in what constitutes “extraordinary” has led to misuse of the aphorism. ECREE is commonly invoked to discredit research dealing with scientific anomalies, and has even been rhetorically employed in attempts to raise doubts concerning mainstream scientific hypotheses that have substantive empirical support. The origin of ECREE lies in eighteenth-century Enlightenment criticisms of miracles. The most important of these was Hume’s (...) essay On Miracles. Hume precisely defined an extraordinary claim as one that is directly contradicted by a massive amount of existing evidence. For a claim to qualify as extraordinary there must exist overwhelming empirical data of the exact antithesis. Extraordinary evidence is not a separate category or type of evidence--it is an extraordinarily large number of observations. Claims that are merely novel or those which violate human consensus are not properly characterized as extraordinary. Science does not contemplate two types of evidence. The misuse of ECREE to suppress innovation and maintain orthodoxy should be avoided as it must inevitably retard the scientific goal of establishing reliable knowledge. (shrink)

Social psychologists typically explain human behavior as a result of the relationship between mental states and social situations, studying the social conditions under which thoughts, feelings, and behaviors occur, and how these variables influence social interactions.

Straightening the current ‘value-laden turn’ (VLT) in the philosophical literature on values in science, and reviving the legacy of the value-free ideal of science (VFI), this paper argues that the influence of extra-scientific values should be minimised—not excluded—in the core phase of scientific inquiry where claims are accepted or rejected. Noting that the original arguments for the VFI (ensuring the truth of scientific knowledge, respecting the autonomy of science results users, preserving public trust in science) have not been satisfactorily addressed (...) by proponents of the VLT, it proposes four prerequisites which any model for values in the acceptance/rejection phase of scientific inquiry should respect, coming from the fundamental requirement to distinguish between facts and values: (1) the truth of scientific knowledge must be ensured; (2) the uncertainties associated with scientific claims must be stated clearly; (3) claims accepted into the scientific corpus must be distinguished from claims taken as a basis for action. An additional prerequisite of (4) simplicity and systematicity is desirable, if the model is to be applicable. Methodological documents from international institutions and regulation agencies are used to illustrate the prerequisites. A model combining Betz’s conception (stating uncertainties associated with scientific claims) and Hansson’s corpus model (ensuring the truth of the scientific corpus and distinguishing it from other claims taken as a basis for action) is proposed. Additional prerequisites are finally suggested for future research, stemming from the requirement for philosophy of science to self-reflect on its own values: (5) any model for values in science must be descriptively and normatively relevant; and (6) its consequences must be thoroughly assessed. (shrink)

In light of the recent credibility crisis in psychology, this paper argues for a greater emphasis on theorizing in scientific research. Although reliable experimental evidence, preregistration, methodological rigor, and new computational frameworks for modeling are important, scientific progress also relies on properly functioning theories. However, the current understanding of the role of theorizing in psychology is lacking, which may lead to future crises. Theories should not be viewed as mere speculations or simple inductive generalizations. To address this issue, the author (...) introduces a framework called “cognitive metascience,” which studies the processes and results of evaluating scientific practice. This study should proceed both qualitatively, as in traditional science and technology studies and cognitive science, and quantitatively, by analyzing scientific discourse using language technology. By analyzing theories as cognitive artifacts that support cognitive tasks, this paper aims to shed more light on their nature. This perspective reveals that multiple distinct theories serve entirely different roles, and studying these roles, along with their epistemic vices and virtues, can provide insight into how theorizing should proceed. The author urges a change in research culture to appreciate the variety of distinct theories and to systematically advance scientific progress. . (shrink)

Misconduct in science is often viewed and analyzed through the lenses of normative ethics and moral philosophy. However, notions and methods in the philosophy of science could also provide rather penetrative explanatory insights into the nature and causes of scientific misconduct. A brief illustration in this regard, using as examples the widely popular Popperian falsification and the Kuhnian scientific paradigm, is provided. In multiple areas of scientific research, failure to seek falsification in a Popperian manner constitutes a questionable research practice (...) and could lead to “falsification” in the context of research misconduct. On the other hand, scientific misconduct is often facilitated by its perpetrators using the familiarity, expectations and confines of a Kuhnian paradigm to blend in fabricated data/results. A rudimentary application of these philosophical notions could be useful in our understanding of the nature and cause of research misconduct, and facilitate mitigation of the latter through educational means. (shrink)

Publication pressure has been touted to promote questionable research practices (QRP) and scientific or research misconduct (RM). However, logically attractively as it is, there is no unequivocal evidence for this notion, and empirical studies have produced conflicting results. Other than difficulties in obtaining unbiased empirical data, a direct causal relationship between perceived publication pressure (PPP) and QRP/RM is inherently difficult to establish, because the former is a complex biopsychosocial construct that is variedly influenced by multiple personal and environmental factors. To (...) effectively address QRP/RM by tackling the sources of PPP would also be difficult because of the competitive nature of the reward and merit system of contemporary science. We might do better with efforts in enhancing knowledge in research ethics and integrity among the practitioners, as well as institutional infrastructures and mechanisms to fairly and efficiently adjudicate cases of QRP/RM. (shrink)

Many scientists routinely generalize from study samples to larger populations. It is commonly assumed that this cognitive process of scientific induction is a voluntary inference in which researchers assess the generalizability of their data and then draw conclusions accordingly. We challenge this view and argue for a novel account. The account describes scientific induction as involving by default a generalization bias that operates automatically and frequently leads researchers to unintentionally generalize their findings without sufficient evidence. The result is unwarranted, overgeneralized (...) conclusions. We support this account of scientific induction by integrating a range of disparate findings from across the cognitive sciences that have until now not been connected to research on the nature of scientific induction. The view that scientific induction involves by default a generalization bias calls for a revision of the current thinking about scientific induction and highlights an overlooked cause of the replication crisis in the sciences. Commonly proposed interventions to tackle scientific overgeneralizations that may feed into this crisis need to be supplemented with cognitive debiasing strategies against generalization bias to most effectively improve science. (shrink)

This commentary suggests that the ongoing malaise of biomedical research results from adopting a doctrine that is incompatible with the principles of creative scientific discovery and thus should be treated as a mental rather than somatic disorder. I overview the progression of the malaise, outline the doctrine and the history of its marriage to science, formulate the diagnosis, justify it by reviewing the symptoms of the malaise, and suggest how to begin to cure the disease.

Academic integrity is an essential pillar of any educational system. It is defined as acting in a manner consistent with the values and accepted standards of ethical practices in teaching, learning, and scholarship (Fishman, 2015). Contract cheating, or ghostwriting, is currently one of the most severe violations of academic integrity. It involves students engaging a third party, usually an online essay writing service, to complete their academic works on their behalf (Draper et al., 2021). Some of these services offer pre-written (...) essays, whereas others offer bespoke custom-written essays. According to the academic literature, the advent of the internet and digital technologies underlay this rapid deterioration of academic integrity (Ison, 2020; Lancaster & Clarke, 2014). Different learning environments, such as face-to-face (i.e., a learning environment involving the physical presence of both instructor and students) and online web-based (i.e., teaching mode that takes place partially or entirely over the internet), have been shown to affect academic integrity in different ways (Eshet et al., 2021). While contract cheating is common in both conventional face-to-face (F2F) and online settings, it is more likely to take place in the latter (Lancaster & Clarke, 2014; Slade et al., 2018). There are several possible explanations for why online students engage in contract cheating more often than F2F students. In particular, this includes the problem issue of psychological distance, which adversely affects interpersonal relationships; and the problem issue of moral distancing, because the internet can obscure the line between academically honest and dishonest behavior (Sharma & Maleyeff, 2003). These issues were further exacerbated by the sudden shift from F2F to emergency remote teaching (ERT) in response to the COVID-19 pandemic (Ahsan et al., 2021; Bjelobaba, 2021). Indeed, contract cheating had become a significant COVID-19 side effect for higher education institutions. In contrast to the well-planned F2F or online learning courses, ERTbased courses are not originally designed to be delivered virtually (Fatonia et al., 2020). The chaos brought by the abrupt campus closure and related unexpected transition to ERT provided both the opportunity and the incentive for contract cheating (Hill et al., 2021). Through social media, students have very quickly become fully aware of the possibilities of a wide variety of options to carry out Plagiarism (Bautista et al., 2022). There has been an increase in ways to try to bypass text-matching or text-reuse (i.e., plagiarism) detection systems, for example using micro-spaces, white ink, punctuation, and typos (Abdelhamid et al., 2022). Even though ghostwriters, especially commercial ones, claim their essays are original and therefore cannot be detected using text-matching software, third-party assignments may still contain recycled text (Aitken et al., 2017; Newton & Lang, 2015). Text matching detection software could use these breaches to identify outsourced academic work (Lancaster & Clarke, 2016; Wang & Xu, 2021). This study compared about four thousand term papers written in languages other than Hebrew. (shrink)

The results of forensic science are believed to be reliable, and are widely used in support of verdicts around the world. However, due to the lack of suitable empirical studies, we actually know very little about the reliability of such results. In this paper, I argue that phenomena analogous to the main culprits for the replication crisis in psychology are also present in forensic science. Therefore forensic results are significantly less reliable than is commonly believed. I conclude that in order (...) to obtain reliable estimates for the reliability of forensic results, we need to conduct studies analogous to the large-scale replication projects in psychology. Additionally, I point to some ways for improving the reliability of forensic science, inspired by the reforms proposed in response to the replicability crisis. (shrink)

The replication (replicability, reproducibility) crisis in social psychology and clinical medicine arises from the fact that many apparently well-confirmed experimental results are subsequently overturned by studies that aim to replicate the original study. The culprit is widely held to be poor science: questionable research practices, failure to publish negative results, bad incentives, and even fraud. In this article I argue that the high rate of failed replications is consistent with high-quality science. We would expect this outcome if the field of (...) science in question produces a high proportion of false hypotheses prior to testing. If most of the hypotheses under test are false, then there will be many false hypotheses that are apparently supported by the outcomes of well conducted experiments and null hypothesis significance tests with a type-I error rate (α) of 5%. Failure to recognize this is to commit the fallacy of ignoring the base rate. I argue that this is a plausible diagnosis of the replication crisis and examine what lessons we thereby learn for the future conduct of science. (shrink)

Replicability is usually considered to be one of the cornerstones of science; however, the growing recognition of nonreplicable experiments and studies in scientific journals—a phenomenon that has been called ‘replicability crisis’—has spurred a debate on the meaning, function, and significance of replicability in science. Amid this discussion, it has become clear that replicability is not a monolithic concept; what is still controversial is exactly how the distinction between different kinds of replicability should be laid out terminologically and conceptually, and to (...) what extent it bears on the more general debate on the centrality of replicability in science. This paper’s goals are to clarify the different uses of the terms related to replicability and, more importantly, to conceptually specify the kinds of replicability and their respective epistemic functions. (shrink)

Nowadays, almost everyone seems to agree that science is facing an epistemological crisis – namely the replicability crisis – and that we need to take action. But as to precisely what to do or how...

Recently, many scientists have become concerned about an excessive number of failures to reproduce statistically significant effects. The situation has become dire enough that the situation has been named the ‘reproducibility crisis’. After reviewing the relevant literature to confirm the observation that scientists do indeed view replication as currently problematic, I explain in philosophical terms why the replication of empirical phenomena, such as statistically significant effects, is important for scientific progress. Following that explanation, I examine various diagnoses of the reproducibility (...) crisis, and argue that for the majority of scientists the crisis is due, at least in part, to a form of publication bias. This conclusion sets the stage for an assessment of the view that evidential relations in science are inherently value-laden, a view championed by Heather Douglas and Kevin Elliott. I argue, in response to Douglas and Elliott, and as motivated by the meta-scientific resistance scientists harbour to a publication bias, that if we advocate the value-ladenness of science the result would be a deepening of the reproducibility crisis. (shrink)

To improve the quality and efficiency of research, groups within the scientific community seek to exploit the value of data sharing. Funders, institutions, and specialist organizations are developing and implementing strategies to encourage or mandate data sharing within and across disciplines, with varying degrees of success. Academic journals in ecology and evolution have adopted several types of public data archiving policies requiring authors to make data underlying scholarly manuscripts freely available. The effort to increase data sharing in the sciences is (...) one part of a broader “data revolution” that has prompted discussion about a paradigm shift in scientific research. Yet anecdotes from the community and studies evaluating data availability suggest that these policies have not obtained the desired effects, both in terms of quantity and quality of available datasets. We conducted a qualitative, interview-based study with journal editorial staff and other stakeholders in the academic publishing process to examine how journals enforce data archiving policies. We specifically sought to establish who editors and other stakeholders perceive as responsible for ensuring data completeness and quality in the peer review process. Our analysis revealed little consensus with regard to how data archiving policies should be enforced and who should hold authors accountable for dataset submissions. Themes in interviewee responses included hopefulness that reviewers would take the initiative to review datasets and trust in authors to ensure the completeness and quality of their datasets. We highlight problematic aspects of these thematic responses and offer potential starting points for improvement of the public data archiving process. (shrink)

Appendix 1 was incomplete in the initial online publication. The original article has been corrected.

Data fraud and selective reporting both present serious threats to the credibility of science. However, there remains considerable disagreement among scientists about how best to sanction data fraud, and about the ethicality of selective reporting. The public is arguably the largest stakeholder in the reproducibility of science; research is primarily paid for with public funds, and flawed science threatens the public’s welfare. Members of the public are able to make meaningful judgments about the morality of different behaviors using moral intuitions. (...) Legal scholars emphasize that to maintain legitimacy, social control policies must be developed with some consideration given to the public’s moral intuitions. Although there is a large literature on popular attitudes toward science, there is no existing evidence about public opinion on data fraud or selective reporting. We conducted two studies—a survey experiment with a nationwide convenience sample, and a follow-up survey with a representative sample of US adults —to explore community members’ judgments about the morality of data fraud and selective reporting in science. The findings show that community members make a moral distinction between data fraud and selective reporting, but overwhelmingly judge both behaviors to be immoral and deserving of punishment. Community members believe that scientists who commit data fraud or selective reporting should be fired and banned from receiving funding. For data fraud, most Americans support criminal penalties. Results from an ordered logistic regression analysis reveal few demographic and no significant partisan differences in punitiveness toward data fraud. (shrink)

The term – “đi tắt, đón đầu,” whose translation is “to gain a head start by taking a shortcut,” has been regularly mentioned by Vietnamese policymakers in the recent years as a means to successfully adopt the Industrial Revolution 4.0. Being inspired by the term and my recent contribution to a book, I argue that Vietnamese Social Sciences is also be able “to gain a head start by taking a shortcut" by adopting open movement and promoting interdisciplinary research.

Humanity is facing a crisis of survival. In order to save humanity and nature, we must rebuild their foundations. This paper proposes integral studies and integral practices as a possible new paradigm for the 21st century. First, we investigated the necessity of integral studies and integral practices, which were suggested by the following three evidences: (1) limitations of the Spiritual Revolution and modern philosophy, (2) limitations of the Scientific Revolution and modern science, and (3) contemporary practical problems that threaten the (...) future of humanity and nature. Second, we investigated the purpose and the principle of integral studies and integral practices from a viewpoint of the nature of both human beings and universe. One of the fundamental questions for humanity is how to overcome the egoism of individuals as well as the entire human race. In this avenue, we think the first step is to transcend toraware, which is a Japanese word meaning both “states of being caught” and “what catches us”. The state of being caught manifests itself when the ego emerges while we begin to distinguish between the self and others. Therefore, integrity and intrinsic nature become principles of integral studies and integral practices. Consequently, integral studies and integral practices serve for the sake of nature including humanity. Third, we discussed the methodology of integral studies and integral practices. We argue its core is integral exploration and reframing of the self and others, ourselves and the world (universe), and humanity and nature. It consequently reveals integrity and harmonizes intellect, emotion, and volition as well as goodness, truth, and beauty while revealing integrity and opening up or unfolding the intrinsic nature of the individual and the collective. Finally, we addressed limitations and future agendas of integral studies and integral practices. We suggest it is essential to raise and discuss fundamental questions on humanity and nature as well as to elucidate the truly unknown, which cannot be understood within existing frameworks. However, whether it is correct or not will come to be verified over time. No one in the history of humanity has ever attained universal truth, which is absolutely true in light of absolute criteria that are not relativized by differences in space, time, or people, or which is absolutely true even without referring to any criteria. Therefore, it is necessary for each of us to discern what is right and maintain a critical gaze. (shrink)

Recent controversies about the level of replicability of behavioral research analyzed using statistical inference have cast interest in developing more efficient techniques for analyzing the results of psychological experiments. Here we claim that complementing the analytical workflow of psychological experiments with Machine Learning-based analysis will both maximize accuracy and minimize replicability issues. As compared to statistical inference, ML analysis of experimental data is model agnostic and primarily focused on prediction rather than inference. We also highlight some potential pitfalls resulting from (...) adoption of Machine Learning based experiment analysis. If not properly used it can lead to over-optimistic accuracy estimates similarly observed using statistical inference. Remedies to such pitfalls are also presented such and building model based on cross validation and the use of ensemble models. ML models are typically regarded as black boxes and we will discuss strategies aimed at rendering more transparent the predictions. (shrink)

The life sciences are said to be in the midst of a replication crisis because a majority of published results are irreproducible, and scientists rarely replicate existing data. Here I argue that point 2 of this assessment is flawed because there is a hitherto unidentified form of replication in the experimental life sciences, which I call ‘microreplications’. Using a case study from biochemistry, I illustrate how MRs depend on a key element of experimentation, namely, experimental controls. I end by reflecting (...) on what MRs mean for the broader debate about the replication crisis. (shrink)

Academic corruption (AC) is a threat to the world community that disturbs the mission of the university and negatively affects the quality of higher education (HE).This study aimed to design a model to reduce academic corruption (RAC) in HE. The qualitative research method is due to the grounded theory, which was implemented in the population of faculty members based on purposive random sampling with a sample of n = 22 until theoretical saturation. The research tool was a semi-structured interview. The (...) analysis method was based on open, axial and selective coding. The results showed that the causal variables of AC were identified in five main categories of Weak laws, and regulations, weak meritocracy, reduction in the quality of education, weak values and ethics and weakness in improvement and empowerment. The contextual factors were discovered across five categories: motivational weakness, time constraints and pressure, utilitarianism and one-sidedness, poor societal welfare, and weak attitude. The confounding variables of AC were identified in four categories of economic weakness, not focusing on society, cultural and political weakness, centralization and decision-making institutions, and strategies to RAC were proposed in eight transparency and accountability, equality and justice, quality of education and research, relationship between university and society, structural and organizational, spirituality and ethics, laws and regulations, psychological categories. Then, five consequential categories of organizational health, organizational excellence, social capital, strengthening participation, and excellence of cultural values were presented to RAC. (shrink)

Research misconduct is harmful because it threatens public health and public safety, and also undermines public confidence in science. Efforts to eradicate ongoing and prevent future misconduct are numerous and varied, yet the question of “what works” remains largely unanswered. To shed light on this issue, this study used data from both mail and online surveys administered to a stratified random sample of tenured and tenure-track faculty members (N = 613) in the social, natural, and applied sciences at America’s top (...) 100 research universities. Participants were asked to gauge the effectiveness of various intervention strategies: formal sanctions (professional and legal), informal sanctions (peers), prevention efforts (ethics and professional training), and reducing the pressures associated with working in research-intensive units. Results indicated that (1) formal sanctions received the highest level of support, (2) female scholars and researchers working in the applied sciences favored formal sanctions, and (3) a nontrivial portion of the sample supported an integrated approach that combined elements of different strategies. A key takeaway for university administrators is that a multifaceted approach to dealing with the problem of research misconduct, which prominently features enhanced formal sanctions, will be met with the support of university faculty. (shrink)

Why the replication crisis might be less severe than it seems at first.

Multiple simultaneous independent discoveries, so well enunciated by Robert K. Merton in the early 1960s but already discussed for several hundreds of years, is a classic concept in the sociology of science. In this paper, the concept of multiple simultaneous independent errors is proposed, analyzed, and discussed. The concept of Selective Pessimistic Induction is proposed and used to connect MIDs with MIEs. Five types of MIEs are discussed: multiple errors in the interpretation of experimental data or computational results; multiple misjudgments (...) of the value of another’s research results or conclusions; multiple cases of false anticipation of achieving a certain experimental result; multiples of ignoring or omitting relevant precedents; and multiple instances of failure due to a not-yet-conceived scientific concept or principle. Causal MIDs and MIEs are those that can be traced directly to antecedent knowledge. Acausal MIDs and MIEs are those involving a consequential and identifiable leap from antecedent knowledge. Examples of causal and acausal MIEs are provided, mostly but not exclusively from the discipline of chemistry. Comparisons are made between MIDs and MIEs. Topics for future research are discussed and implications of these concepts are proposed. (shrink)