Fostering research integrity (RI) increasingly focuses on normative guidance and supportive measures within institutions. To be successful, the implementation of support should be informed by stakeholders’ experiences of RI support. This study aims to explore experiences of RI support in Dutch, Spanish and Croatian universities. In total, 59 stakeholders (Netherlands n = 25, Spain n = 17, Croatia n = 17) participated in 16 focus groups in three European countries. Global themes on RI support experiences were identified by thematic analysis. (...) Themes identified were: ‘RI governance and institutional implementation’, ‘RI roles and structures’, ‘RI education and supervision’, and ‘Infrastructure, technology and tools supporting daily practice’. Experiences of support differed between countries in relation to: the efforts to translate norms into practice; the extent to which RI oversight was a responsibility of RE structures, or separate RI structures; and the availability of support close to research practice, such as training, responsible supervision, and adequate tools and infrastructure. The study reinforces the importance of a whole institutional approach to RI, embedded within local jurisdictions, rules, and practices. A whole institutional approach puts the emphasis of responsibility on institutions rather than individual researchers. When such an approach is lacking, some stakeholders look for intervention by authorities, such as funders, outside of the university. (shrink)

This essay presents a unified account of safety, sensitivity, and severe testing. S’s belief is safe iff, roughly, S could not easily have falsely believed p, and S’s belief is sensitive iff were p false S would not believe p. These two conditions are typically viewed as rivals but, we argue, they instead play symbiotic roles. Safety and sensitivity are both valuable epistemic conditions, and the relevant alternatives framework provides the scaffolding for their mutually supportive roles. The relevant alternatives condition (...) holds that a belief is warranted only if the evidence rules out relevant error possibilities. The safety condition helps categorise relevant from irrelevant possibilities. The sensitivity condition captures ‘ruling out’. Safety, sensitivity, and the relevant alternatives condition are typically presented as conditions on warranted belief or knowledge. But these properties, once generalised, help characterise other epistemic phenomena, including warranted inference, legal verdicts, scientific claims, reaching conclusions, addressing questions, warranted assertion, and the epistemic force of corroborating evidence. We introduce and explain Mayo’s severe testing account of statistical inference. A hypothesis is severely tested to the extent it passes tests that probably would have found errors, were they present. We argue Mayo’s account is fruitfully understood using the resulting relevant alternatives framework. Recasting Mayo’s condition using the conceptual framework of contemporary epistemology helps forge fruitful connections between two research areas—philosophy of statistics and the analysis of knowledge—not currently in sufficient dialogue. The resulting union benefits both research areas. (shrink)

While the common procedure of statistical significance testing and its accompanying concept of p-values have long been surrounded by controversy, renewed concern has been triggered by the replication crisis in science. Many blame statistical significance tests themselves, and some regard them as sufficiently damaging to scientific practice as to warrant being abandoned. We take a contrary position, arguing that the central criticisms arise from misunderstanding and misusing the statistical tools, and that in fact the purported remedies themselves risk damaging science. (...) We argue that banning the use of p-value thresholds in interpreting data does not diminish but rather exacerbates data-dredging and biasing selection effects. If an account cannot specify outcomes that will not be allowed to count as evidence for a claim—if all thresholds are abandoned—then there is no test of that claim. The contributions of this paper are: To explain the rival statistical philosophies underlying the ongoing controversy; To elucidate and reinterpret statistical significance tests, and explain how this reinterpretation ameliorates common misuses and misinterpretations; To argue why recent recommendations to replace, abandon, or retire statistical significance undermine a central function of statistics in science: to test whether observed patterns in the data are genuine or due to background variability. (shrink)

In my thesis, I develop two distinct themes. The first part of my thesis is devoted to indicative conditionals and approaching them from an empirically informed perspective. In the second part, I am developing classical topics of philosophy of science, specifically, scientific objectivity and the role of values in science, in connection to recent methodological developments, revolving around the Replication Crisis.

The results of forensic science are believed to be reliable, and are widely used in support of verdicts around the world. However, due to the lack of suitable empirical studies, we actually know very little about the reliability of such results. In this paper, I argue that phenomena analogous to the main culprits for the replication crisis in psychology are also present in forensic science. Therefore forensic results are significantly less reliable than is commonly believed. I conclude that in order (...) to obtain reliable estimates for the reliability of forensic results, we need to conduct studies analogous to the large-scale replication projects in psychology. Additionally, I point to some ways for improving the reliability of forensic science, inspired by the reforms proposed in response to the replicability crisis. (shrink)

Contemporary debates about scientific institutions and practice feature many proposed reforms. Most of these require increased efforts from scientists. But how do scientists’ incentives for effort interact? How can scientific institutions encourage scientists to invest effort in research? We explore these questions using a game-theoretic model of publication markets. We employ a base game between authors and reviewers, before assessing some of its tendencies by means of analysis and simulations. We compare how the effort expenditures of these groups interact in (...) our model under a variety of settings, such as double-blind and open review systems. We make a number of findings, including that open review can increase the effort of authors in a range of circumstances and that these effects can manifest in a policy-relevant period of time. However, we find that open review’s impact on authors’ efforts is sensitive to the strength of several other influences. (shrink)

This summary of the original paradigm of the universal science of complexity starts with the discovered exact origin of the stagnating "end" of conventional, unitary science paradigm and development traditionally presented by its own estimates as the only and the best possible kind of scientific knowledge. Using a transparent generalisation of the exact mathematical formalism of arbitrary interaction process, we show that unitary science approach and description, including its imitations of complexity and chaoticity, correspond to artificial and ultimately strong reduction (...) of the natural plurality of unreduced interaction results called realisations to a single, "average" or "exact", realisation. This severe reduction of the natural world dynamics in unitary science underlies all its unsolvable "mysteries" and "paradoxes", persisting "difficult problems", and finally the modern "end" of the progress of just that, actually very special kind of knowledge, whose irreducible limits lead to the modern deep crisis of the global civilisation development. We show then how the rigorously substantiated restoration of the full richness of real-world dynamics within the intrinsically unified knowledge of the universal science of complexity provides not only the causally complete solution to the old and new problems of unitary science but opens practically unlimited possibilities for the new progress of science and civilisation as a result of this crucial extension, which we call complexity revolution. The unreduced analysis of the universal complexity science shows that at the current critical bifurcation point of development, we have only two incompatible possibilities and emerging tendencies, either the dangerously growing degradation within the dominating unitary science and thinking limits (irrespective of purely empirical technology power becoming even dangerous here) or the new golden age of scientific discoveries and civilisation progress with the qualitatively extended approach and results of unreduced complexity science and the new thinking it implies. (shrink)

The origins of testing scientific models with statistical techniques go back to 18th century mathematics. However, the modern theory of statistical testing was primarily developed through the work of Sir R.A. Fisher, Jerzy Neyman, and Egon Pearson in the inter-war period. Some of Fisher's papers on testing were published in economics journals (Fisher, 1923, 1935) and exerted a notable influence on the discipline. The development of econometrics and the rise of quantitative economic models in the mid-20th century made statistical significance (...) testing a commonplace, albeit controversial tool within economics. -/- In the debate about significance testing, methodological controversies intertwine with epistemological issues and sociological developments. Our aim in this chapter is to expound these connections and to show how the use of, and the debate about, significance testing in economics differs from other social sciences, such as psychology. (shrink)

Nowadays, almost everyone seems to agree that science is facing an epistemological crisis – namely the replicability crisis – and that we need to take action. But as to precisely what to do or how...

We argue that the main results of scientific papers may appropriately be published even if they are false, unjustified, and not believed to be true or justified by their author. To defend this claim we draw upon the literature studying the norms of assertion, and consider how they would apply if one attempted to hold claims made in scientific papers to their strictures, as assertions and discovery claims in scientific papers seem naturally analogous. We first use a case study of (...) William H. Bragg’s early 20th century work in physics to demonstrate that successful science has in fact violated these norms. We then argue that features of the social epistemic arrangement of science which are necessary for its long run success require that we do not hold claims of scientific results to their standards. We end by making a suggestion about the norms that it would be appropriate to hold scientific claims to, along with an explanation of why the social epistemology of science—considered as an instance of collective inquiry—would require such apparently lax norms for claims to be put forward. (shrink)

This special issue on what some regard as a crisis of replicability in cognitive science (i.e. the observation that a worryingly large proportion of experimental results across a number of areas cannot be reliably replicated) is informed by three recent developments. -/- First, philosophers of mind and cognitive science rely increasingly on empirical research, mainly in the psychological sciences, to back up their claims. This trend has been noticeable since the 1960s (see Knobe, 2015). This development has allowed philosophers to (...) draw on a wider range of relevant resources, but it also makes them vulnerable to relying on claims that may not survive further scrutiny. If we have reasons to believe that a large proportion of findings in the psychological sciences cannot be reliably replicated, this would be a problem for philosophers who use such findings in their work. Second, philosophers are increasingly designing and carrying out their own experiments to back up claims, or to test claims earlier made from the armchair, for example, on the perceived permissibility of diverting trolleys or on the nature of free will. This growing field of experimental philosophy has diversified the intellectual field in philosophy, but may also be vulnerable to issues of replicability that philosophers did not face before. -/- Third, the recent evidence of apparently widespread non-replicability in the social sciences (and other fields) has forced philosophers of science to grapple with long standing questions from their field from a new perspective. To what extent does replicability matter for theory construction? How do the notions of replicability and scientific progress interact? How can normative insights from philosophy of science be used in order to improve scientific practice? -/- It is with these three developments in mind—the increasing importance of empirically-informed philosophy, of experimental philosophy, and of philosophy of science around replicability—that this special issue has been conceived. (shrink)

It has been argued that supervenience generates unavoidable confounding problems for interventionist accounts of causation, to the point that we must choose between interventionism and supervenience. According to one solution, the dilemma can be defused by excluding non-causal determinants of an outcome as potential confounders. I argue that this solution undermines the methodological validity of causal tests. Moreover, we don’t have to choose between interventionism and supervenience in the first place. Some confounding problems are effectively circumvented by experimental designs routinely (...) employed in science. The remaining confounding issues concern the physical interpretation of variables and cannot be solved by choosing between interventionism and supervenience. (shrink)

The scientificity of the research should be evaluated according to the methodology used in the study. However, these are usually the research areas or the institutions that are classified as scientific or non-scientific. Because of various reasons, it may turn out that the scientific institutions are not producing science, while the “non-scientists” are doing real science. In the extreme case, the official science system is entirely corrupt, consisting of fraudsters, while the real scientists have been expelled from academic institutions. Since (...) 2016-2017, there has been much talk about the “post-truth era” and the politicians who are “denying science”. However, simultaneously, many complaints about the corruption of science appeared. The outsider cannot tell who is telling the truth as it may be the case that the science fraudsters are defending themselves and these politicians are aware of the corruption. It is also untrue that the censoring or suppression of science started from 2016-2017. Suppression of science because of political and ideological reasons was present already long ago, and during the last few years, it has been increasing. The picture is highly complicated as there are many pretenders, false accusations, etc. For example, because of political reasons, someone may be set up as a pseudoscientist, the real scientist may be expelled using political accusations, justified criticism may be labelled as political pressure, etc. There is something like an inner information war ongoing in and around science. The classical philosophy of science seems unable to handle it because every formal rule can be misapplied. Science, as a whole, may be unable to persist. (shrink)

Research integrity is usually discussed in terms of responsibilities that individual researchers bear towards the scientific work they conduct, as well as responsibilities that institutions have to enable those individual researchers to do so. In addition to these two bearers of responsibility, a third category often surfaces, which is variably referred to as culture and practice. These notions merit further development beyond a residual category that is to contain everything that is not covered by attributions to individuals and institutions. This (...) paper discusses how thinking in RI can take benefit from more specific ideas on practice and culture. We start by articulating elements of practice and culture, and explore how values central to RI are related to these elements. These insights help identify additional points of intervention for fostering responsible conduct. This helps to build “cultures and practices of research integrity”, as it makes clear that specific times and places are connected to specific practices and cultures and should have a place in the debate on Research Integrity. With this conceptual framework, practitioners as well as theorists can avoid using the notions as residual categories that de facto amount to vague, additional burdens of responsibility for the individual. (shrink)

Several scholars, including Martin Hengel, R. Alan Culpepper, and Richard Bauckham, have argued that Papias had knowledge of the Gospel of John on the grounds that Papias’s prologue lists six of Jesus’s disciples in the same order that they are named in the Gospel of John: Andrew, Peter, Philip, Thomas, James, and John. In “A Note on Papias’s Knowledge of the Fourth Gospel” (JBL 129 [2010]: 793–794), Jake H. O’Connell presents a statistical analysis of this argument, according to which the (...) probability of this correspondence occurring by chance is lower than 1%. O’Connell concludes that it is more than 99% probable that this correspondence is the result of Papias copying John, rather than chance. I show that O’Connell’s analysis contains multiple mistakes, both substantive and mathematical: it ignores relevant evidence, overstates the correspondence between John and Papias, wrongly assumes that if Papias did not know John he ordered the disciples randomly, and conflates the probability of A given B with the probability of B given A. In discussing these errors, I aim to inform both Johannine scholarship and the use of probabilistic methods in historical reasoning. (shrink)

Moral, social, political, and other “nonepistemic” values can lead to bias in science, from prioritizing certain topics over others to the rationalization of questionable research practices. Such values might seem particularly common or powerful in the social sciences, given their subject matter. However, I argue first that the well-documented phenomenon of motivated reasoning provides a useful framework for understanding when values guide scientific inquiry (in pernicious or productive ways). Second, this analysis reveals a parity thesis: values influence the social and (...) natural sciences about equally, particularly because both are so prominently affected by desires for social credit and status, including recognition and career advancement. Ultimately, bias in natural and social science is both natural and social— that is, a part of human nature and considerably motivated by a concern for social status (and its maintenance). Whether the pervasive influence of values is inimical to the sciences is a separate question. (shrink)

We provide a novel articulation of the epistemic peril of p-hacking using three resources from philosophy: predictivism, Bayesian confirmation theory, and model selection theory. We defend a nuanced position on p-hacking: p-hacking is sometimes, but not always, epistemically pernicious. Our argument requires a novel understanding of Bayesianism, since a standard criticism of Bayesian confirmation theory is that it cannot represent the influence of biased methods. We then turn to pre-analysis plans, a methodological device used to mitigate p-hacking. Some say that (...) pre-analysis plans are epistemically meritorious while others deny this, and in practice pre-analysis plans are often violated. We resolve this debate with a modest defence of pre-analysis plans. Further, we argue that pre-analysis plans can be epistemically relevant even if the plan is not strictly followed—and suggest that allowing for flexible pre-analysis plans may be the best available policy option. (shrink)

The epistemic attitudes of scientists, such as epistemic tolerance and authoritarianism, play important roles in the discourse about rivaling theories. Epistemic tolerance stands for the mental attitude of an epistemic agent, e.g., a scientist, who is open to opposing views, while epistemic authoritarianism represents the tendency to uncritically accept views of authorities. Another relevant epistemic factor when it comes to the epistemic decisions of scientists is the skepticism towards the scientific method. However, the question is whether these epistemic attitudes are (...) influenced by their sociopolitical counterparts, such as the researcher’s degree of conservatism. To empirically investigate the interplay between epistemic and sociopolitical attitudes of scientists, we conducted a survey with researchers (N = 655) across different disciplines. We propose scales for measuring epistemic tolerance and epistemic authoritarianism, as well as a scale for detecting the participants' readiness to question the scientific method. Furthermore, we investigate the relationship between epistemic tolerance and epistemic authoritarianism on the one hand, and career stage and sociopolitical views on the other hand. Interestingly, our study found only small correlations between the participants' degree of conservatism and their epistemic attitudes. This suggests that political views, against common argumentation, actually do not play an important role in one’s scientific decisions. Moreover, social scientists scored higher on the epistemic tolerance and lower on the epistemic authoritarianism scale than natural scientists. Finally, the results indicate that natural scientists question the scientific method less than social scientists. (shrink)

Research misconduct remains an important problem in health research despite decades of local, national, regional, and international efforts to eliminate it. The ultimate goal of every health research project, irrespective of setting, is to produce trustworthy findings to address local as well as global health issues. To be able to lead or participate meaningfully in international research collaborations, individual and institutional capacities for research integrity are paramount. Accordingly, this paper concerns itself not only with individuals’ research skills but also with (...) institutional and national policies and governance. Such policies and governance provide an ethical scaffold for the production of knowledge and structure incentives. This paper’s operational definition of research therefore draws from Institute of Medicine’s articulation of health research as an inquiry that aims to produce knowledge about the structure, processes, or effects of personal health services; and from an existing health systems framework. The paper reviews the research regulatory environment and the ethics apparatus in Ghana, and describes a project jointly undertaken by Ghanaian researchers in collaboration with New York University to assess the perceived adequacy of current institutional practices, opportunities, and incentives for promoting RI. (shrink)

Research misconduct is an alarming concern worldwide, and especially in Italy, where there is no formal training of young researchers in responsible research practices. The main aim of this study was to map the perceptions and attitudes about RM in a sample of young researchers attending a one-week intensive course on methodology, ethics and integrity in biomedical research, held at the University of Insubria. To this end, we administered the Scientific Misconduct Questionnaire to all attendees at the beginning of the (...) course. Thereafter, SMQ-R was re-administered at the end, to assess the impact of the course on the responsiveness of study participants, which is intended as the frequency of responses other than “don’t know”. Results show that respondents rate as high their own understanding about rules and procedures related to scientific misconduct, as well as the effectiveness of their institution’s measures for reducing it. Most of them perceive as low the chances of getting caught for RM. Some respondents believe that cases of misconduct occur in their workplace and that the integrity of a research is not solely the responsibility of the principal investigator. Among the main factors contributing to research misconduct, the need for publications, unclear definition of what constitutes misconduct and pressure for external funding do stand out. Respondents are concerned about the amount of misconduct and express a pressing need for training on research ethics. Remarkably, the responsiveness of participants tends to increase with course attendance. This finding may be useful to support education programmes devoted to research methodology, ethics and integrity among young researchers. (shrink)

Objectivity, as one of the key attributes of science, has become an indispensable part of its ethos and a central theme of the philosophy of science. As such, it has been a subject of philosophical reflection by a number of authors. In our project – in which both philosophers of science and scientists participate – we examine the concept of objectivity in the natural sciences with the tools of experimental philosophy. We aim to identify specific operational dimensions of objectivity, those (...) with which current scientist actually work, thus making them accessible for further theoretical analysis and research. In this text, we present results from the first, qualitative phase of our research based on in-depth interviews and focus groups with scientists working in the Czech Republic. Further, we confront this empirical data with theoretical notions of objectivity. We also present other findings from the research and formulate hypotheses for the research’s subsequent phases. (shrink)

The replicability of findings in experimental psychology can be improved by distinguishing sharply between hypothesis-generating research and hypothesis-testing research. This distinction can be achieved by preregistration, a method that has recently attracted widespread attention. Although preregistration is fair in the sense that it inoculates researchers against hindsight bias and confirmation bias, preregistration does not allow researchers to analyze the data flexibly without the analysis being demoted to exploratory. To alleviate this concern we discuss how researchers may conduct blinded analyses. As (...) with preregistration, blinded analyses break the feedback loop between the analysis plan and analysis outcome, thereby preventing cherry-picking and significance seeking. However, blinded analyses retain the flexibility to account for unexpected peculiarities in the data. We discuss different methods of blinding, offer recommendations for blinding of popular experimental designs, and introduce the design for an online blinding protocol. (shrink)

Principalele probleme cu care se confruntă oamenii de știință în lucrul cu seturile mari de date (Big Data), evidențiind principale aspecte etice, luând în considerare inclusiv legislația din Uniunea Europeană. După o scurtă Introducere despre Big Data, secțiunea Tehnologia prezintă aplicațiile specifice în cercetare. Urmează o abordare a principalelor probleme filosofice specifice în Aspecte filosofice, și Aspecte legale cu evidențierea problemelor etice specifice din Regulamentul UE privind protecția datelor 2016/679 (General Data Protection Regulation, "GDPR"). Secțiunea Probleme etice detaliază aspectele specifice (...) generate de Big Data. După o scurtă secțiune Cercetarea Big Data, finalizez lucrarea cu prezentarea Concluziilor pentru etica cercetării în lucrul cu Big CUPRINS: Abstract 1. Introducere - 1.1 Definiții - 1.2 Dimensiunile Big Data 2. Tehnologia - 2.1 Aplicații - - 2.1.1 În cercetare 3. Aspecte filosofice 4 Aspecte legale - 4.1 GDPR - - Etapele procesării datelor personale - - Principiile procesării datelor - - Politica de confidențialitate și transparența - - Scopurile procesării datelor - - Confidențialitate prin design și implicită - - Paradoxul (legal) al Big Data 5. Probleme etice - Etica în cercetare - Conștientizarea - Consimțământul - Controlul - Transparența - Încrederea - Proprietatea - Supravegherea și securitatea - Identitatea digitală - Realitatea ajustată - De-anonimizarea - Inegalitatea digitală - Confidențialitatea 6. Cercetarea Big Data Concluzii Bibliografie DOI: 10.13140/RG.2.2.27629.33761 . (shrink)

Citation-based metrics are increasingly used as a proxy to define representative, considerable, or significant papers. We challenge this belief by taking into account factors that may play a role in providing citations to a manuscript and whether/how those highly cited studies could shape a scientific field. A different approach to summarisation of relevant core publications within a topic is proposed.

In July 2014, the roboticist Ronald Arkin suggested that child sex robots could be used to treat those with paedophilic predilections in the same way that methadone is used to treat heroin addicts. Taking this onboard, it would seem that there is reason to experiment with the regulation of this technology. But most people seem to disagree with this idea, with legal authorities in both the UK and US taking steps to outlaw such devices. In this paper, I subject these (...) different regulatory attitudes to critical scrutiny. In doing so, I make three main contributions to the debate. First, I present a framework for thinking about the regulatory options that we confront when dealing with child sex robots. Second, I argue that there is a prima facie case for restrictive regulation, but that this is contingent on whether Arkin’s hypothesis has a reasonable prospect of being successfully tested. Third, I argue that Arkin’s hypothesis probably does not have a reasonable prospect of being successfully tested. Consequently, we should proceed with utmost caution when it comes to this technology. (shrink)

Experimental design is one aspect of a scientific method. A well-designed, properly conducted experiment aims to control variables in order to isolate and manipulate causal effects and thereby maximize internal validity, support causal inferences, and guarantee reliable results. Traditionally employed in the natural sciences, experimental design has become an important part of research in the social and behavioral sciences. Experimental methods are also endorsed as the most reliable guides to policy effectiveness. Through a discussion of some of the central concepts (...) associated with experimental design, including controlled variation and randomization, this chapter will provide a summary of key ethical issues that tend to arise in experimental contexts. In addition, by exploring assumptions about the nature of causation and by analyzing features of causal relationships, systems, and inferences in social contexts, this chapter will summarize the ways in which experimental design can undermine the integrity of not only social and behavioral research but policies implemented on the basis of such research. (shrink)

Proponents of moral enhancement believe that we should pursue and apply biotechnological means to morally enhance human beings, as failing to do so is likely to lead to humanity's demise. Unsurprisingly, these proposals have generated a substantial amount of debate about the moral permissibility of using such interventions. Here I put aside concerns about the permissibility of moral enhancement and focus on the conceptual and evidentiary grounds for the moral enhancement project. I argue that such grounds are quite precarious.

This article describes contrasting ideas for a set of topics in epidemiological thinking. The premise underlying this contribution to the special edition is that researchers develop their epidemiological thinking over time through interactions with other researchers who have a variety of in-practice commitments, such as to kinds of cases and methods of analysis, and not simply to a philosophical framework for explanation. I encourage discussants from philosophy and epidemiology to draw purposefully from across a range of topics and contrasting positions, (...) and thereby pursue critical thinking in the sense of understanding ideas and practices better when we examine them in relation to alternatives. After an initial topic concerning practices for developing epidemiological literacy, a number of conceptual steps follow—the characterization of the very phenomena we might be concerned with, the scope and challenges of the field of epidemiology, the formulation of categories—before linking associations, predictions, causes and interventions and examining the confounding of purported links. Building on that conceptual basis, the remaining topics consist of issues or angles of analysis related to the complexities of inequalities within and between populations, context, and changes over the life course. The organization of topics derives from a graduate course that I teach that aims for epidemiological literacy, not technical ability in statistical formulas and data analysis, and shares the underlying premise and critical thinking goals of this article. During the topic-by-topic description, some assertions about explanation and intervention emerge, notably, that epidemiological–philosophical discussion about causality often leaves unclear or unexamined whether a modifiable factor shown to have been associated with a difference in the data from past observations should be thought of as factor that, when modified, would generate that difference going forward. The article concludes with a “Limitations of this Study” section that teases out different kinds of description–prescription relationship that are implied in undertaking philosophy of epidemiology and identifies some other considerations that are implied but not emphasized by this article. (shrink)

Prepublication peer review should be abolished. We consider the effects that such a change will have on the social structure of science, paying particular attention to the changed incentive structure and the likely effects on the behaviour of individual scientists. We evaluate these changes from the perspective of epistemic consequentialism. We find that where the effects of abolishing prepublication peer review can be evaluated with a reasonable level of confidence based on presently available evidence, they are either positive or neutral. (...) We conclude that on present evidence abolishing peer review weakly dominates the status quo. (shrink)

In the human sciences, experimental research is used to establish causal relationships. However, the extrapolation of these results to the target population can be problematic. To facilitate extrapolation, we propose to use the statistical technique Latent Class Regression Analysis in combination with the analogical reasoning theory for extrapolation. This statistical technique can identify latent classes that differ in the effect of X on Y. In order to extrapolate by means of analogical reasoning, one can characterize the latent classes by a (...) combination of features, and then compare these features to features of the target. (shrink)

The deep crisis in modern fundamental science development is ever more evident and openly recognised now even by mainstream, official science professionals and leaders. By no coincidence, it occurs in parallel to the world civilisation crisis and related global change processes, where the true power of unreduced scientific knowledge is just badly missing as the indispensable and unique tool for the emerging greater problem solution and further progress at a superior level of complex world dynamics. Here we reveal the mathematically (...) exact reason for the crisis in conventional science, containing also the natural and unified problem solution in the form of well-specified extension of usual, artificially restricted paradigm. We show how that extended, now causally complete science content provides various "unsolvable" problem solutions and opens new development possibilities for both science and society, where the former plays the role of the main, direct driver for the latter. We outline the related qualitative changes in science organisation, practice and purposes, giving rise to the sustainability transition in the entire civilisation dynamics towards the well-specified superior level of its unreduced, now well understood and universally defined complexity. (shrink)

As it became clear that Donald Trump had a real base of political support, even as analysts consistently underestimated his electoral prospects, they grew increasingly fascinated with the question of who was supporting him (and why). However, researchers also tend to hold strong negative opinions about Trump. Consequently, they have approached this research with uncharitable priors about the kind of person who would support him and what they would be motivated by. Research design and data analysis often seem to be (...) oriented towards reinforcing those assumptions. This essay highlights the epistemological consequences of these tendencies through a series of case studies featuring prominent and influential works that purport to explain the role of race and racism in the 2016 U.S. presidential election. It demonstrates that quality control systems, which should catch major errors, seem to be failing in systematic ways as a result of shared priors and commitments between authors, reviewers and editors – which are also held in common with the journalists and scholars citing and amplifying this work – leading to misinformation cascades. Of course, motivated reasoning, confirmation bias, prejudicial study design, and failure to address confounds are not limited to questions about Trump – however they seem to be particularly pronounced in this case due to the relative homogeneity and intensity of scholars’ views about this topic as compared to other social phenomena. “Trump studies,” therefore, provides fertile ground for exploring how social research can go awry – and the consequences of these failures -- particularly with respect to work on contentious and politically-charged topics. (shrink)

This chapter describes the potential far‐reaching consequences of contemplative higher education for the fields of science and medicine.

Philosophy of science is expanding via the introduction of new digital data and tools for their analysis. The data comprise digitized published books and journal articles, as well as heretofore unpublished material such as images, archival text, notebooks, meeting notes, and programs. The growth in available data is matched by the extensive development of automated analysis tools. The variety of data sources and tools can be overwhelming. In this article, we survey the state of digital work in the philosophy of (...) science, showing what kinds of questions can be answered and how one can go about answering them. (shrink)

While some form of evaluation has always been employed in science (e.g. peer review, hiring), formal systems of evaluation of research and researchers have recently come to play a more prominent role in many countries because of the adoption of new models of governance. According to such models, the quality of the output of both researchers and their institutions is measured, and issues such as eligibility for tenure or the allocation of public funding to research institutions crucially depends on the (...) outcomes of such measures. However, concerns have been raised over the risk that such evaluation may be threatening epistemic pluralism by penalizing the existent heterodox schools of thought and discouraging the pursuit of new ones. It has been proposed that this may happen because of epistemic bias favouring mainstream research programmes. In this paper, I claim that (1) epistemic pluralism is desirable and should be preserved; (2) formal evaluation exercises may threaten epistemic pluralism because they may be affected by some form of epistemic bias; therefore, (3) to preserve epistemic pluralism, we need some strategy to actively dampen epistemic bias. (shrink)

Subjective Bayesianism is a major school of uncertain reasoning and statistical inference. It is often criticized for a lack of objectivity: it opens the door to the influence of values and biases, evidence judgments can vary substantially between scientists, it is not suited for informing policy decisions. My paper rebuts these concerns by connecting the debates on scientific objectivity and statistical method. First, I show that the above concerns arise equally for standard frequentist inference with null hypothesis significance tests. Second, (...) the criticisms are based on specific senses of objectivity with unclear epistemic value. Third, I show that Subjective Bayesianism promotes other, epistemically relevant senses of scientific objectivity—most notably by increasing the transparency of scientific reasoning. (shrink)

In a recent editorial published in Nature, the journal's editors comment on a new automated software that has been used to check findings in psychology publications. The editors express concern with the way in which the anonymous fact-checkers have proceeded, but at the same time, they underscore the crucial role of peer criticism for scientific progress and insist: "self-correction is at the heart of science." Brief as it is, the editorial showcases that peer criticism and the application of norms of (...) good research practice are very thorny issues indeed.It is essential for the functioning of science that empirical findings, arguments, as well as methodological approaches are scrutinized... (shrink)

Internal mechanisms that uphold the reliability of published scientific results have failed across many sciences, including some that are major sources of science news. Traditional methods for reporting science in the mass media do not effectively compensate for this unreliability. I argue for a new conceptual framework in which science journalists and scientists form a complex knowledge community, with science news as the interdisciplinary product. This approach motivates forms of collaboration and training that can improve the epistemic reliability of science (...) news. (shrink)

[ES] Este trabajo, realiza una sumarísima revisión histórica, a través de algunas conjeturas epistemológicas, sobre las reflexiones filosóficas acerca del mundo del arte, su estatuto, desarrollo y «funcionamiento» con el propósito de allanar el camino para una ulterior descripción de la problemática acerca de la noción del mundo del arte. [EN] This writing makes a brief historical review, through some epistemological assumptions, on the philosophical reflections on the art world, its status, development and «functioning» in order to pave the way (...) for a further description of the problems about the notion of the art world. (shrink)

Conflicting results undermine making inferences from the empirical literature. So far, the replication crisis is mainly seen as resulting from honest errors and questionable research practices such as p-hacking or the base-rate fallacy. I discuss the malleability (researcher degrees of freedom) of quantitative research and argue that conflicting results can emerge from two studies using different but plausible designs (e.g., eligibility criteria, operationalization of concepts, outcome measures) and statistical methods. I also explore how the choices regarding study design and statistical (...) techniques bias results in a way that makes them more or less relevant for a given policy or clinical question. (shrink)

In information societies, operations, decisions and choices previously left to humans are increasingly delegated to algorithms, which may advise, if not decide, about how data should be interpreted and what actions should be taken as a result. More and more often, algorithms mediate social processes, business transactions, governmental decisions, and how we perceive, understand, and interact among ourselves and with the environment. Gaps between the design and operation of algorithms and our understanding of their ethical implications can have severe consequences (...) affecting individuals as well as groups and whole societies. This paper makes three contributions to clarify the ethical importance of algorithmic mediation. It provides a prescriptive map to organise the debate. It reviews the current discussion of ethical aspects of algorithms. And it assesses the available literature in order to identify areas requiring further work to develop the ethics of algorithms. (shrink)

No scientific conclusion follows automatically from a statistically non-significant result, yet people routinely use non-significant results to guide conclusions about the status of theories (or the effectiveness of practices). To know whether a non-significant result counts against a theory, or if it just indicates data insensitivity, researchers must use one of: power, intervals (such as confidence or credibility intervals), or else an indicator of the relative evidence for one theory over another, such as a Bayes factor. I argue Bayes factors (...) allow theory to be linked to data in a way that overcomes the weaknesses of the other approaches. Specifically, Bayes factors use the data themselves to determine their sensitivity in distinguishing theories (unlike power), and they make use of those aspects of a theory’s predictions that are often easiest to specify (unlike power and intervals, which require specifying the minimal interesting value in order to address theory). Bayes factors provide a coherent approach to determining whether non-significant results support a null hypothesis over a theory, or whether the data are just insensitive. They allow accepting and rejecting the null hypothesis to be put on an equal footing. Concrete examples are provided to indicate the range of application of a simple online Bayes calculator, which reveal both the strengths and weaknesses of Bayes factors. (shrink)

Siegel and Byrne debate whether perceptual experiences present rich properties or exclusively thin properties.

Kyle Stanford claims we have historical evidence that there likely are plausible unconceived alternatives in fundamental domains of science, and thus evidence that our best theories in these domains are probably false. Accordingly, we should adopt a form of instrumentalism. Elsewhere, I have argued that in fact we do not have historical evidence for the existence of plausible unconceived alternatives in particular domains of science, and that the main challenge to scientific realism is rather to provide evidence that there are (...) likely not plausible unconceived alternatives. In the present paper, I contend that we may come to have such evidence in the long run of science. I then investigate the epistemic consequences of the claim that we presently do not have evidence for or against the existence of plausible unconceived alternatives, but that in the future we may come to have evidence against the existence of plausible unconceived alternatives. I argue there are prima facie reasons to endorse a form of voluntarism in this situation according to which scientists and others may rationally be more optimistic or more pessimistic about the truth of our best theories, on the grounds that the widespread acceptance of an obligation to be an instrumentalist threatens to disrupt the proper functioning of science, in part because the domain of application of the problem of unconceived alternatives is unclear. (shrink)