This commentary suggests that the ongoing malaise of biomedical research results from adopting a doctrine that is incompatible with the principles of creative scientific discovery and thus should be treated as a mental rather than somatic disorder. I overview the progression of the malaise, outline the doctrine and the history of its marriage to science, formulate the diagnosis, justify it by reviewing the symptoms of the malaise, and suggest how to begin to cure the disease.

Academic integrity is an essential pillar of any educational system. It is defined as acting in a manner consistent with the values and accepted standards of ethical practices in teaching, learning, and scholarship (Fishman, 2015). Contract cheating, or ghostwriting, is currently one of the most severe violations of academic integrity. It involves students engaging a third party, usually an online essay writing service, to complete their academic works on their behalf (Draper et al., 2021). Some of these services offer pre-written (...) essays, whereas others offer bespoke custom-written essays. According to the academic literature, the advent of the internet and digital technologies underlay this rapid deterioration of academic integrity (Ison, 2020; Lancaster & Clarke, 2014). Different learning environments, such as face-to-face (i.e., a learning environment involving the physical presence of both instructor and students) and online web-based (i.e., teaching mode that takes place partially or entirely over the internet), have been shown to affect academic integrity in different ways (Eshet et al., 2021). While contract cheating is common in both conventional face-to-face (F2F) and online settings, it is more likely to take place in the latter (Lancaster & Clarke, 2014; Slade et al., 2018). There are several possible explanations for why online students engage in contract cheating more often than F2F students. In particular, this includes the problem issue of psychological distance, which adversely affects interpersonal relationships; and the problem issue of moral distancing, because the internet can obscure the line between academically honest and dishonest behavior (Sharma & Maleyeff, 2003). These issues were further exacerbated by the sudden shift from F2F to emergency remote teaching (ERT) in response to the COVID-19 pandemic (Ahsan et al., 2021; Bjelobaba, 2021). Indeed, contract cheating had become a significant COVID-19 side effect for higher education institutions. In contrast to the well-planned F2F or online learning courses, ERTbased courses are not originally designed to be delivered virtually (Fatonia et al., 2020). The chaos brought by the abrupt campus closure and related unexpected transition to ERT provided both the opportunity and the incentive for contract cheating (Hill et al., 2021). Through social media, students have very quickly become fully aware of the possibilities of a wide variety of options to carry out Plagiarism (Bautista et al., 2022). There has been an increase in ways to try to bypass text-matching or text-reuse (i.e., plagiarism) detection systems, for example using micro-spaces, white ink, punctuation, and typos (Abdelhamid et al., 2022). Even though ghostwriters, especially commercial ones, claim their essays are original and therefore cannot be detected using text-matching software, third-party assignments may still contain recycled text (Aitken et al., 2017; Newton & Lang, 2015). Text matching detection software could use these breaches to identify outsourced academic work (Lancaster & Clarke, 2016; Wang & Xu, 2021). This study compared about four thousand term papers written in languages other than Hebrew. (shrink)

The results of forensic science are believed to be reliable, and are widely used in support of verdicts around the world. However, due to the lack of suitable empirical studies, we actually know very little about the reliability of such results. In this paper, I argue that phenomena analogous to the main culprits for the replication crisis in psychology are also present in forensic science. Therefore forensic results are significantly less reliable than is commonly believed. I conclude that in order (...) to obtain reliable estimates for the reliability of forensic results, we need to conduct studies analogous to the large-scale replication projects in psychology. Additionally, I point to some ways for improving the reliability of forensic science, inspired by the reforms proposed in response to the replicability crisis. (shrink)

The replication (replicability, reproducibility) crisis in social psychology and clinical medicine arises from the fact that many apparently well-confirmed experimental results are subsequently overturned by studies that aim to replicate the original study. The culprit is widely held to be poor science: questionable research practices, failure to publish negative results, bad incentives, and even fraud. In this article I argue that the high rate of failed replications is consistent with high-quality science. We would expect this outcome if the field of (...) science in question produces a high proportion of false hypotheses prior to testing. If most of the hypotheses under test are false, then there will be many false hypotheses that are apparently supported by the outcomes of well conducted experiments and null hypothesis significance tests with a type-I error rate (α) of 5%. Failure to recognize this is to commit the fallacy of ignoring the base rate. I argue that this is a plausible diagnosis of the replication crisis and examine what lessons we thereby learn for the future conduct of science. (shrink)

The modern abundance and prominence of data has led to the development of “data science” as a new field of enquiry, along with a body of epistemological reflections upon its foundations, methods, and consequences. This article provides a systematic analysis and critical review of significant open problems and debates in the epistemology of data science. We propose a partition of the epistemology of data science into the following five domains: (i) the constitution of data science; (ii) the kind of enquiry (...) that it identifies; (iii) the kinds of knowledge that data science generates; (iv) the nature and epistemological significance of “black box” problems; and (v) the relationship between data science and the philosophy of science more generally. (shrink)

There is now a general consensus amongst philosophers in the values in science literature that values necessarily play a role in core areas of scientific inquiry. We argue that attention should now be turned from debating the value-free ideal to delineating legitimate from illegitimate influences of values in science, a project we dub “The New Demarcation Problem.” First, we review past attempts to demarcate the uses of values and propose a categorization of the strategies by where they seek to draw (...) legitimacy from. Next, we propose a set of desiderata for what we take to be a satisfactory solution and present a case study where conflicting sets of values clearly impinge on science, but where the legitimacy of their influence is ambiguous. We use these desiderata and the case study to illustrate what we take to be the strengths and weaknesses of current strategies. To be clear, our goal is not to answer the question we pose, but to articulate a framework within which a solution can be judged. (shrink)

Dubljević and company’s proposed approach for incorporating a socio-political perspective into neuroethics has clear potential to help mitigate the effects of research ‘hype’ relating to neuroethics. Their approach serves as a social regulation meant to improve the realizability of neuroethics research. Drawing on Dubljević et al. s suggestion, we consider how incorporating a socio-political perspective in other scientific disciplines could help the scientific community as a whole move beyond the infamous ‘reproducibility crisis’ in science. The reproducibility crisis is a concern (...) in science stemming from the revelation that most scientific results are difficult, or impossible, to replicate (Frias-Navarro et al., 2020). By applying the four principles proposed by Dubljević et al., the scientific community can avoid many of the pitfalls that have led to the reproducibility crisis, such as the file drawer effect, a publication bias preventing negative results from being published, or the publish-or-perish culture - the pressure for scientists to publish highly influential papers in high impact journals in order to keep their funding (Rosenthal, 1979; Begley & Ioannidis, 2015). As such, we argue that, in its final form, this socio-political framework begs for true open science, wherein systematically sharing data would enable enlightened policymaking by showing a picture closer to the ground-level realities of scientific research. (shrink)

This paper advocates for making epistemic interests a central object of philosophical analysis in epistemology and philosophy of science. It is argued that the importance of epistemic interests derives from their fundamental importance for the notion of objectivity. Epistemic interests are defined as individuated by a set of objectives, each of which represents a dimension of the search for truth. Among these dimensions, specificity, sensitivity, and productivity are discussed in detail. It is argued that the relevance of productivity is often (...) overlooked in debates about the ends and means of science. A definition of the objectivity of inquiry is proposed that takes the notion of epistemic interest as its starting point. (shrink)

The cross-cultural differences in epistemic intuitions reported by Weinberg, Nichols and Stich (2001; hereafter: WNS) laid the ground for the negative program of experimental philosophy. However, most of WNS’s findings were not corroborated in further studies. The exception here is the study concerning purported differences between Westerners and Indians in knowledge ascriptions concerning the Zebra Case, which was never properly replicated. Our study replicates the above-mentioned experiment on a considerably larger sample of Westerners (n = 211) and Indians (n = (...) 204). The analysis found a significant difference between the ethnic groups in question in the predicted direction: Indians were more likely to attribute knowledge in the Zebra Case than Westerners. In this paper, we offer an explanation of our result that takes into account the fact that replications of WNS’s other experiments did not find any cross-cultural differences. We argue that the Zebra Case is unique among the vignettes tested by WNS since it should not be regarded as a Gettier case but rather as a scenario exhibiting skeptical pressure concerning the reliability of sense-perception. We argue that skepticism towards perception as a means of gaining knowledge is a trope that is deeply rooted in Western epistemology but is very much absent from Classical Indian philosophical inquiry. This line of reasoning is based on a thorough examination of the skeptical scenarios discussed by philosophers of the Indian Nyaya tradition and their adversaries. (shrink)

Computational reproducibility possesses its own dynamics and narratives of crisis. Alongside the difficulties of computing as an ubiquitous yet complex scientific activity, computational reproducibility suffers from a naive expectancy of total reproducibility and a moral imperative to embrace the principles of free software as a non-negotiable epistemic virtue. We argue that the epistemic issues at stake in actual practices of computational reproducibility are best unveiled by focusing on software as a pivotal concept, one that is surprisingly often overlooked in accounts (...) of reproducibility issues. Software is not only about designing and coding but also about maintaining, supporting, distributing, licensing, and governance; it is not only about developers but also about users. We focus on openness debates among computational chemists involved in molecular modeling software packages as empirical grounding for our argument. We then identify and analyse four epistemic characteristics as key to the role of software in computational reproducibility. (shrink)

Open access-introduction into moral philosophy in German language that contains chapters on the concept of morality, on the development and the main positions of normative ethics, on meta-ethics, and on the various fields of applied ethics. One of its distinctive features is that it explicitly reflects on the role of morality and ethics in modern society and that it analyses the import of alternative conceptual and normative positions for determining this role. The book can be freely downloaded from the publisher's (...) website via the URL below. (shrink)

In the last decade Open Science principles, such as Open Access, study preregistration, use of preprints, making available data and code, and open peer review, have been successfully advocated for and are being slowly adopted in many different research communities. In response to the COVID-19 pandemic many publishers and researchers have sped up their adoption of some of these Open Science practices, sometimes embracing them fully and sometimes partially or in a sub-optimal manner. In this article, we express concerns about (...) the violation of some of the Open Science principles and its potential impact on the quality of research output. We provide evidence of the misuses of these principles at different stages of the scientific process. We call for a wider adoption of Open Science practices in the hope that this work will encourage a broader endorsement of Open Science principles and serve as a reminder that science should always be a rigorous process, reliable and transparent, especially in the context of a pandemic where research findings are being translated into practice even more rapidly. (shrink)

Objectivity, as one of the key attributes of science, has become an indispensable part of its ethos and a central theme of the philosophy of science. As such, it has been a subject of philosophical reflection by a number of authors. In our project – in which both philosophers of science and scientists participate – we examine the concept of objectivity in the natural sciences with the tools of experimental philosophy. We aim to identify specific operational dimensions of objectivity, those (...) with which current scientist actually work, thus making them accessible for further theoretical analysis and research. In this text, we present results from the first, qualitative phase of our research based on in-depth interviews and focus groups with scientists working in the Czech Republic. Further, we confront this empirical data with theoretical notions of objectivity. We also present other findings from the research and formulate hypotheses for the research’s subsequent phases. (shrink)

"Why should we care about having true beliefs? And why do demonstrably false beliefs persist and spread despite consequences for the people who hold them? Philosophers of science Cailin O’Connor and James Weatherall argue that social factors, rather than individual psychology, are what’s essential to understanding the spread and persistence of false belief. It might seem that there’s an obvious reason that true beliefs matter: false beliefs will hurt you. But if that’s right, then why is it irrelevant to many (...) people whether they believe true things or not? In an age riven by "fake news," "alternative facts," and disputes over the validity of everything from climate change to the size of inauguration crowds, the authors argue that social factors, not individual psychology, are what’s essential to understanding the persistence of false belief and that we must know how those social forces work in order to fight misinformation effectively."–Publisher’s description. (shrink)

It has been argued that implicit biases are operative in philosophy and lead to significant epistemic costs in the field. Philosophers working on this issue have focussed mainly on implicit gender and race biases. They have overlooked ideological bias, which targets political orientations. Psychologists have found ideological bias in their field and have argued that it has negative epistemic effects on scientific research. I relate this debate to the field of philosophy and argue that if, as some studies suggest, the (...) same bias also exists in philosophy then it will lead to hitherto unrecognised epistemic hazards in the field. Furthermore, the bias is epistemically different from the more familiar biases in respects that are important for epistemology, ethics, and metaphilosophy. (shrink)

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project to estimate the reproducibility of experimental philosophy. Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample (...) – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward. (shrink)

Why the replication crisis might be less severe than it seems at first.

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)

Social psychologists typically explain human behavior as a result of the relationship between mental states and social situations, studying the social conditions under which thoughts, feelings, and behaviors occur, and how these variables influence social interactions.

Straightening the current ‘value-laden turn’ (VLT) in the philosophical literature on values in science, and reviving the legacy of the value-free ideal of science (VFI), this paper argues that the influence of extra-scientific values should be minimised—not excluded—in the core phase of scientific inquiry where claims are accepted or rejected. Noting that the original arguments for the VFI (ensuring the truth of scientific knowledge, respecting the autonomy of science results users, preserving public trust in science) have not been satisfactorily addressed (...) by proponents of the VLT, it proposes four prerequisites which any model for values in the acceptance/rejection phase of scientific inquiry should respect, coming from the fundamental requirement to distinguish between facts and values: (1) the truth of scientific knowledge must be ensured; (2) the uncertainties associated with scientific claims must be stated clearly; (3) claims accepted into the scientific corpus must be distinguished from claims taken as a basis for action. An additional prerequisite of (4) simplicity and systematicity is desirable, if the model is to be applicable. Methodological documents from international institutions and regulation agencies are used to illustrate the prerequisites. A model combining Betz’s conception (stating uncertainties associated with scientific claims) and Hansson’s corpus model (ensuring the truth of the scientific corpus and distinguishing it from other claims taken as a basis for action) is proposed. Additional prerequisites are finally suggested for future research, stemming from the requirement for philosophy of science to self-reflect on its own values: (5) any model for values in science must be descriptively and normatively relevant; and (6) its consequences must be thoroughly assessed. (shrink)

In light of the recent credibility crisis in psychology, this paper argues for a greater emphasis on theorizing in scientific research. Although reliable experimental evidence, preregistration, methodological rigor, and new computational frameworks for modeling are important, scientific progress also relies on properly functioning theories. However, the current understanding of the role of theorizing in psychology is lacking, which may lead to future crises. Theories should not be viewed as mere speculations or simple inductive generalizations. To address this issue, the author (...) introduces a framework called “cognitive metascience,” which studies the processes and results of evaluating scientific practice. This study should proceed both qualitatively, as in traditional science and technology studies and cognitive science, and quantitatively, by analyzing scientific discourse using language technology. By analyzing theories as cognitive artifacts that support cognitive tasks, this paper aims to shed more light on their nature. This perspective reveals that multiple distinct theories serve entirely different roles, and studying these roles, along with their epistemic vices and virtues, can provide insight into how theorizing should proceed. The author urges a change in research culture to appreciate the variety of distinct theories and to systematically advance scientific progress. . (shrink)

It is relatively easy to state that information retrieval is a scientific discipline but it is rather difficult to understand why it is science because what is science is still under debate in the philosophy of science. To be able to convince others that IR is science, our ability to explain why is crucial. To explain why IR is a scientific discipline, we use a theory and a model of scientific study, which were proposed recently. The explanation involves mapping the (...) knowledge structure of IR to that of well-known scientific disciplines like physics. In addition, the explanation involves identifying the common aim, principles and assumptions in IR and in well-known scientific disciplines like physics, so that they constrain the scientific investigation in IR in a similar way as in physics. Therefore, there are strong similarities in terms of the knowledge structure and the constraints of the scientific investigations between IR and scientific disciplines like physics. Based on such similarities, IR is considered a scientific discipline. (shrink)

Current fears of a “reproducibility crisis” have led researchers, sources of scientific funding, and the public to question both the efficacy and trustworthiness of science. Suggested policy changes have been focused on statistical problems, such as p-hacking, and issues of experimental design and execution. However, “reproducibility” is a broad concept that includes a number of issues. Furthermore, reproducibility failures occur even in fields such as mathematics or computer science that do not have statistical problems or issues with experimental design. Most (...) importantly, these proposed policy changes ignore a core feature of the process of scientific inquiry that occurs after reproducibility failures: the integration of conflicting observations and ideas into a coherent theory. (shrink)

In 1979 astronomer Carl Sagan popularized the aphorism “extraordinary claims require extraordinary evidence”. But Sagan never defined the term “extraordinary.” Ambiguity in what constitutes “extraordinary” has led to misuse of the aphorism. ECREE is commonly invoked to discredit research dealing with scientific anomalies, and has even been rhetorically employed in attempts to raise doubts concerning mainstream scientific hypotheses that have substantive empirical support. The origin of ECREE lies in eighteenth-century Enlightenment criticisms of miracles. The most important of these was Hume’s (...) essay On Miracles. Hume precisely defined an extraordinary claim as one that is directly contradicted by a massive amount of existing evidence. For a claim to qualify as extraordinary there must exist overwhelming empirical data of the exact antithesis. Extraordinary evidence is not a separate category or type of evidence--it is an extraordinarily large number of observations. Claims that are merely novel or those which violate human consensus are not properly characterized as extraordinary. Science does not contemplate two types of evidence. The misuse of ECREE to suppress innovation and maintain orthodoxy should be avoided as it must inevitably retard the scientific goal of establishing reliable knowledge. (shrink)

The term – “đi tắt, đón đầu,” whose translation is “to gain a head start by taking a shortcut,” has been regularly mentioned by Vietnamese policymakers in the recent years as a means to successfully adopt the Industrial Revolution 4.0. Being inspired by the term and my recent contribution to a book, I argue that Vietnamese Social Sciences is also be able “to gain a head start by taking a shortcut" by adopting open movement and promoting interdisciplinary research.

Misconduct in science is often viewed and analyzed through the lenses of normative ethics and moral philosophy. However, notions and methods in the philosophy of science could also provide rather penetrative explanatory insights into the nature and causes of scientific misconduct. A brief illustration in this regard, using as examples the widely popular Popperian falsification and the Kuhnian scientific paradigm, is provided. In multiple areas of scientific research, failure to seek falsification in a Popperian manner constitutes a questionable research practice (...) and could lead to “falsification” in the context of research misconduct. On the other hand, scientific misconduct is often facilitated by its perpetrators using the familiarity, expectations and confines of a Kuhnian paradigm to blend in fabricated data/results. A rudimentary application of these philosophical notions could be useful in our understanding of the nature and cause of research misconduct, and facilitate mitigation of the latter through educational means. (shrink)

Given the reproducibility crisis (or replication crisis), more psychologists and social-cultural scientists are getting involved with Bayesian inference. Therefore, the current article provides a brief overview of programs (or software) and steps to conduct Bayesian data analysis in social sciences.

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including a reduction (...) of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. (shrink)

Recently, many scientists have become concerned about an excessive number of failures to reproduce statistically significant effects. The situation has become dire enough that the situation has been named the ‘reproducibility crisis’. After reviewing the relevant literature to confirm the observation that scientists do indeed view replication as currently problematic, I explain in philosophical terms why the replication of empirical phenomena, such as statistically significant effects, is important for scientific progress. Following that explanation, I examine various diagnoses of the reproducibility (...) crisis, and argue that for the majority of scientists the crisis is due, at least in part, to a form of publication bias. This conclusion sets the stage for an assessment of the view that evidential relations in science are inherently value-laden, a view championed by Heather Douglas and Kevin Elliott. I argue, in response to Douglas and Elliott, and as motivated by the meta-scientific resistance scientists harbour to a publication bias, that if we advocate the value-ladenness of science the result would be a deepening of the reproducibility crisis. (shrink)

The replication or reproducibility crisis in psychological science has renewed attention to philosophical aspects of its methodology. I provide herein a new, functional account of the role of replication in a scientific discipline: to undercut the underdetermination of scientific hypotheses from data, typically by hypotheses that connect data with phenomena. These include hypotheses that concern sampling error, experimental control, and operationalization. How a scientific hypothesis could be underdetermined in one of these ways depends on a scientific discipline’s epistemic goals, theoretical (...) development, material constraints, institutional context, and their interconnections. I illustrate how these apply to the case of psychological science. I then contrast this “bottom-up” account with “top-down” accounts, which assume that the role of replication in a particular science, such as psychology, must follow from a uniform role that it plays in science generally. Aside from avoiding unaddressed problems with top-down accounts, my bottom-up account also better explains the variability of importance of replication of various types across different scientific disciplines. (shrink)

To improve the quality and efficiency of research, groups within the scientific community seek to exploit the value of data sharing. Funders, institutions, and specialist organizations are developing and implementing strategies to encourage or mandate data sharing within and across disciplines, with varying degrees of success. Academic journals in ecology and evolution have adopted several types of public data archiving policies requiring authors to make data underlying scholarly manuscripts freely available. The effort to increase data sharing in the sciences is (...) one part of a broader “data revolution” that has prompted discussion about a paradigm shift in scientific research. Yet anecdotes from the community and studies evaluating data availability suggest that these policies have not obtained the desired effects, both in terms of quantity and quality of available datasets. We conducted a qualitative, interview-based study with journal editorial staff and other stakeholders in the academic publishing process to examine how journals enforce data archiving policies. We specifically sought to establish who editors and other stakeholders perceive as responsible for ensuring data completeness and quality in the peer review process. Our analysis revealed little consensus with regard to how data archiving policies should be enforced and who should hold authors accountable for dataset submissions. Themes in interviewee responses included hopefulness that reviewers would take the initiative to review datasets and trust in authors to ensure the completeness and quality of their datasets. We highlight problematic aspects of these thematic responses and offer potential starting points for improvement of the public data archiving process. (shrink)

Appendix 1 was incomplete in the initial online publication. The original article has been corrected.

The life sciences are said to be in the midst of a replication crisis because a majority of published results are irreproducible, and scientists rarely replicate existing data. Here I argue that point 2 of this assessment is flawed because there is a hitherto unidentified form of replication in the experimental life sciences, which I call ‘microreplications’. Using a case study from biochemistry, I illustrate how MRs depend on a key element of experimentation, namely, experimental controls. I end by reflecting (...) on what MRs mean for the broader debate about the replication crisis. (shrink)

Although construct measurement is critical to explanatory research and intervention efforts, rigorous measure development remains a notable challenge. For example, though the primary theoretical model for understanding health disparities among sexual minority (e.g., lesbian, gay, bisexual) adolescents is minority stress theory, nearly all published studies of this population rely on minority stress measures with poor psychometric properties and development procedures. In response, we developed the Sexual Minority Adolescent Stress Inventory (SMASI) with N = 346 diverse adolescents ages 14–17, using a (...) comprehensive approach to de novo measure development designed to produce a measure with desirable psychometric properties. After exploratory factor analysis on 102 candidate items informed by a modified Delphi process, we applied item response theory techniques to the remaining 72 items. Discrimination and difficulty parameters and item characteristic curves were estimated overall, within each of 12 initially derived factors, and across demographic subgroups. Two items were removed for excessive discrimination and three were removed following reliability analysis. The measure demonstrated configural and scalar invariance for gender and age; a three-item factor was excluded for demonstrating substantial differences by sexual identity and race/ethnicity. The final 64-item measure comprised 11 subscales and demonstrated excellent overall (α = 0.98), subscale (α range 0.75–0.96), and test–retest (scale r > 0.99; subscale r range 0.89–0.99) reliabilities. Subscales represented a mix of proximal and distal stressors, including domains of internalized homonegativity, identity management, intersectionality, and negative expectancies (proximal) and social marginalization, family rejection, homonegative climate, homonegative communication, negative disclosure experiences, religion, and work domains (distal). Thus, the SMASI development process illustrates a method to incorporate information from multiple sources, including item response theory models, to guide item selection in building a psychometrically sound measure. We posit that similar methods can be used to improve construct measurement across all areas of psychological research, particularly in areas where a strong theoretical framework exists but existing measures are limited. (shrink)

Leading animal models are powerful tools for translational research, but they also present obstacles. Poorly conducted preclinical research in animals is a common cause of translational failure, but even when such research is well-designed and carefully executed, challenges remain. In particular, dominant models may bias research directions, elide essential aspects of human disease, omit important context, or subtly shift research targets. Recognizing these stumbling blocks can help us find ways to avoid them: employing a wider range of models, incorporating more (...) realistic environmental conditions, better aligning studies between animals and patients, and focusing on human biology and therapeutic goals. Such changes are costly; but insisting it would be impractical or unrealistic to change strategies offers no way out of the current impasse. Rather, we must acknowledge the obstacles as well as the advantages presented by core models, and direct some of our investments in translational research toward getting around them. The dominance of biomedical research by a handful of animal models introduces subtle but significant obstacles to translation. Recognizing these obstacles is a critical first step toward finding ways around them; this paper describes how dominant models can create roadblocks, and suggests strategies to improve the efficiency of translation from animal models to humans. (shrink)

Publication pressure has been touted to promote questionable research practices (QRP) and scientific or research misconduct (RM). However, logically attractively as it is, there is no unequivocal evidence for this notion, and empirical studies have produced conflicting results. Other than difficulties in obtaining unbiased empirical data, a direct causal relationship between perceived publication pressure (PPP) and QRP/RM is inherently difficult to establish, because the former is a complex biopsychosocial construct that is variedly influenced by multiple personal and environmental factors. To (...) effectively address QRP/RM by tackling the sources of PPP would also be difficult because of the competitive nature of the reward and merit system of contemporary science. We might do better with efforts in enhancing knowledge in research ethics and integrity among the practitioners, as well as institutional infrastructures and mechanisms to fairly and efficiently adjudicate cases of QRP/RM. (shrink)

The independence of research is a key strategic issue of modern societies. Dealing with it appropriately poses legal, economic, political, social and cultural problems for society, which have been studied by the corresponding disciplines and are increasingly the subject of reflexive discourses of scientific communities. Unfortunately, problems of independence are usually framed in disciplinary contexts without due consideration of other perspectives’ relevance or possible contributions. To overcome these limitations, we review disciplinary perspectives and findings on the independence of research and (...) identify interdisciplinary prospects that could inform a research programme. (shrink)

Nowadays, almost everyone seems to agree that science is facing an epistemological crisis – namely the replicability crisis – and that we need to take action. But as to precisely what to do or how...

This paper aims to illustrate the advantages of critical realism for biological scientists and to offer an example, for others in philosophy and the social sciences, of applied natural science in p...

In European research and innovation policy, Responsible Research and Innovation (RRI) and Open Science (OS) encompass two co-existing sets of ambitions concerning systemic change in the practice of research and innovation. This paper is an exploratory attempt to uncover synergies and differences between RRI and OS, by interrogating what motivates their respective transformative agendas. We offer two storylines that account for the specific contexts and dynamics from which RRI and OS have emerged, which in turn offer entrance points to further (...) unpacking what ‘opening up’ to society means with respect to the transformative change agendas that are implicit in the two agendas. We compare differences regarding the ‘how’ of opening up in light of the ‘why’ to explore common areas of emphasis in both OS and RRI. We argue that while both agendas align with mission-oriented narratives around grand societal challenges, OS tends to emphasize efficiency and technical optimisation over RRI’s emphasis on normative concerns and democracy deficits, and that the two agendas thus contrast in their relative legitimate emphasis on doable outcomes versus desirable outcomes. In our conclusion, we reflect on the future outlook for RRI and OS’ co-existence and uptake, and on what their respective ambitions for transformation might mean for science-society scholars and scholarship. (shrink)

We characterize access to empirical objects in biology from a theoretical perspective. Unlike objects in current physical theories, biological objects are the result of a history and their variations continue to generate a history. This property is the starting point of our concept of measurement. We argue that biological measurement is relative to a natural history which is shared by the different objects subjected to the measurement and is more or less constrained by biologists. We call symmetrization the theoretical and (...) often concrete operation which leads to considering biological objects as equivalent in a measurement. Last, we use our notion of measurement to analyze research strategies. Some strategies aim to bring biology closer to the epistemology of physical theories, by studying objects as similar as possible, while others build on biological diversity. (shrink)

Most discussions of the reproducibility crisis focus on its epistemic aspect: the fact that the scientific community fails to follow some norms of scientific investigation, which leads to high rates of irreproducibility via a high rate of false positive findings. The purpose of this paper is to argue that there is a heretofore underappreciated and understudied dimension to the reproducibility crisis in experimental psychology and neuroscience that may prove to be at least as important as the epistemic dimension. This is (...) the communication dimension. The link between communication and reproducibility is immediate: independent investigators would not be able to recreate an experiment whose design or implementation were inadequately described. I exploit evidence of a replicability and reproducibility crisis in computational science, as well as research into quality of reporting to support the claim that a widespread failure to adhere to reporting standards, especially the norm of descriptive completeness, is an important contributing factor in the current reproducibility crisis in experimental psychology and neuroscience. (shrink)

Replicability is usually considered to be one of the cornerstones of science; however, the growing recognition of nonreplicable experiments and studies in scientific journals—a phenomenon that has been called ‘replicability crisis’—has spurred a debate on the meaning, function, and significance of replicability in science. Amid this discussion, it has become clear that replicability is not a monolithic concept; what is still controversial is exactly how the distinction between different kinds of replicability should be laid out terminologically and conceptually, and to (...) what extent it bears on the more general debate on the centrality of replicability in science. This paper’s goals are to clarify the different uses of the terms related to replicability and, more importantly, to conceptually specify the kinds of replicability and their respective epistemic functions. (shrink)

BackgroundEven though research integrity (RI) training programs have been developed in the last decades, it is argued that current training practices are not always able to increase RI-related awareness within the scientific community. Defining and understanding the capacities and lacunas of existing RI training are becoming extremely important for developing up-to-date educational practices to tackle present-day challenges. Recommendations on how to implement RI education have been primarily made by selected people with specific RI-related expertise. Those recommendations were developed mainly without (...) consulting a broader audience with no specific RI expertise. Moreover, the academic literature lacks qualitative studies on RI training practices. For these reasons, performing in-depth focus groups with non-RI expert stakeholders are of a primary necessity to understand and outline how RI education should be implemented.MethodsIn this qualitative analysis, different focus groups were conducted to examine stakeholders’ perspectives on RI training practices. Five stakeholders' groups, namely publishers and peer reviewers, researchers on RI, RI trainers, PhDs and postdoctoral researchers, and research administrators working within academia, have been identified to have a broader overview of state of the art.ResultsA total of 39 participants participated in five focus group sessions. Eight training-related themes were highlighted during the focus group discussions. The training goals, timing and frequency, customisation, format and teaching approach, mentoring, compulsoriness, certification and evaluation, and RI-related responsibilities were discussed. Although confirming what was already proposed by research integrity experts in terms of timing, frequency, duration, and target audience in organising RI education, participants proposed other possible implementations strategies concerning the teaching approach, researchers' obligations, and development an evaluation-certification system.ConclusionsThis research aims to be a starting point for a better understanding of necessary, definitive, and consistent ways of structuring RI education. The research gives an overview of what has to be considered needed in planning RI training sessions regarding objectives, organisation, and teaching approach. (shrink)