Scientists often respond to failures to replicate by citing differences between the experimental components of an original study and those of its attempted replication. In this paper, we investigate these purported mismatch explanations. We assess a body of failures to replicate in neuroscience studies on spinal cord injury. We argue that a defensible mismatch explanation is one where a mismatch of components is a difference maker for a mismatch of outcomes, and the components are relevantly different in the follow-up study, (...) given the scope of the original study. With this account, we argue that not all differences between studies are meaningful, even if they are difference makers. As our examples show, focusing only on these differences results in disregarding the representativeness of the original experiment’s components and the scope of its outcomes, undercutting other epistemic aims, such as translation, in the process. (shrink)

We conducted two eye-tracking experiments investigating the processing of the Mandarin reflexive ziji in order to tease apart structurally constrained accounts from standard cue-based accounts of memory retrieval. In both experiments, we tested whether structurally inaccessible distractors that fulfill the animacy requirement of ziji influence processing times at the reflexive. In Experiment 1, we manipulated animacy of the antecedent and a structurally inaccessible distractor intervening between the antecedent and the reflexive. In conditions where the accessible antecedent mismatched the animacy cue, (...) we found inhibitory interference whereas in antecedent-match conditions, no effect of the distractor was observed. In Experiment 2, we tested only antecedent-match configurations and manipulated locality of the reflexive-antecedent binding (Mandarin allows non-local binding). Participants were asked to hold three distractors (animate vs. inanimate nouns) in memory while reading the target sentence. We found slower reading times when animate distractors were held in memory (inhibitory interference). Moreover, we replicated the locality effect reported in previous studies. These results are incompatible with structure-based accounts. However, the cue-based ACT-R model of Lewis and Vasishth ( 2005 ) cannot explain the observed pattern either. We therefore extend the original ACT-R model and show how this model not only explains the data presented in this article, but is also able to account for previously unexplained patterns in the literature on reflexive processing. (shrink)

Linear mixed-effects models (LMMs) are increasingly being used for data analysis in cognitive neuroscience and experimental psychology, where within-participant designs are common. The current article provides an introductory review of the use of LMMs for within-participant data analysis and describes a free, simple, graphical user interface (LMMgui). LMMgui uses the package lme4 (Bates et al., 2014a, b ) in the statistical environment R (R Core Team).

The cross-cultural differences in epistemic intuitions reported by Weinberg, Nichols and Stich (2001; hereafter: WNS) laid the ground for the negative program of experimental philosophy. However, most of WNS’s findings were not corroborated in further studies. The exception here is the study concerning purported differences between Westerners and Indians in knowledge ascriptions concerning the Zebra Case, which was never properly replicated. Our study replicates the above-mentioned experiment on a considerably larger sample of Westerners (n = 211) and Indians (n = (...) 204). The analysis found a significant difference between the ethnic groups in question in the predicted direction: Indians were more likely to attribute knowledge in the Zebra Case than Westerners. In this paper, we offer an explanation of our result that takes into account the fact that replications of WNS’s other experiments did not find any cross-cultural differences. We argue that the Zebra Case is unique among the vignettes tested by WNS since it should not be regarded as a Gettier case but rather as a scenario exhibiting skeptical pressure concerning the reliability of sense-perception. We argue that skepticism towards perception as a means of gaining knowledge is a trope that is deeply rooted in Western epistemology but is very much absent from Classical Indian philosophical inquiry. This line of reasoning is based on a thorough examination of the skeptical scenarios discussed by philosophers of the Indian Nyaya tradition and their adversaries. (shrink)

In myrecent book I have sought to define a notion of stability and to argue that it is a useful notion for biomedical and especially epidemiological research (Broadbent 2013, 56–80). In this paper I seek to defend the notion of stability against two possible objections: that it fails to be epistemically significant, and that it amounts to nothing more than empirical adequacy. I argue that stability is epistemically significant because to know that a hypothesis is stable is to know something (...) about the world, even if not the truth of the hypothesis. I argue that knowledge of stability of a hypothesis is distinct from knowledge of its approximate truth. And I argue that asserting the stability of a hypothesis is distinct from asserting its empirical adequacy, because it allows that the hypothesis may still be implicated in empirically inadequate claims, entailing only that if the hypothesis is so implicated, it will not be revised soon. (shrink)

These preprints were automatically compiled into a PDF from the collection of papers deposited in PhilSci-Archive in conjunction with the PSA 2018.

Most theories and hypotheses in psychology are verbal in nature, yet their evaluation overwhelmingly relies on inferential statistical procedures. The validity of the move from qualitative to quantitative analysis depends on the verbal and statistical expressions of a hypothesis being closely aligned – that is, that the two must refer to roughly the same set of hypothetical observations. Here, I argue that many applications of statistical inference in psychology fail to meet this basic condition. Focusing on the most widely used (...) class of model in psychology – the linear mixed model – I explore the consequences of failing to statistically operationalize verbal hypotheses in a way that respects researchers' actual generalization intentions. I demonstrate that although the “random effect” formalism is used pervasively in psychology to model intersubject variability, few researchers accord the same treatment to other variables they clearly intend to generalize over. The under-specification of random effects imposes far stronger constraints on the generalizability of results than most researchers appreciate. Ignoring these constraints can dramatically inflate false-positive rates, and often leads researchers to draw sweeping verbal generalizations that lack a meaningful connection to the statistical quantities they are putatively based on. I argue that failure to take the alignment between verbal and statistical expressions seriously lies at the heart of many of psychology's ongoing problems, and conclude with a discussion of several potential avenues for improvement. (shrink)

There is substantial published evidence showing that countless people enroll each year in ethically deficient clinical trials. Many of the trials are problematic because the quality of the science used to justify their launch may not be sufficiently vetted while many other trials may lack requisite social value. This poses the question: why do people volunteer for them? The answer resides in large part in the fact that informed consent practices have historically masked, rather than disclosed, the information that would (...) alert research candidates to the ethically problematic nature of the trials. The “reasonable person” and “key information” provisions in the revised US Common Rule create the opportunity to correct this historical shortcoming. Two sources are employed to shed light on what the “key information” is that should be disclosed to a “reasonable person”: the original disclosure aims of the Nuremberg Code, as well as an extensive body of meta-research evidence. Those sources jointly support a range of new disclosures in the informed consent process that would unmask the heretofore undisclosed information. The resulting proposed new disclosures pertain to the overall success prospects of clinical trials, the quality of the prior research that both forms the basis of clinical trials and informs assessment of their risks and benefits, the potential social value of clinical trials, and the commercial purposes of clinical trials. (shrink)

Research Ethics Committees (RECs) play a critical gatekeeping role in clinical trials. This role is meant to ensure that only those trials that meet certain ethical thresholds proceed through their gate. Two of these thresholds are that the potential benefits of trials are reasonable in relation to risks and that trials are capable of producing a requisite amount of social value. While one ought not expect perfect execution by RECs of their gatekeeping role, one should expect routine success in it. (...) This article reviews a range of evidence showing that substantial numbers of ethically tainted trials are receiving REC approvals. Many of the trials are early phase trials that evidence shows have benefits that may not be reasonable compared with their risks and many others are later trials that evidence shows may lack sufficient social value. The evidence pertains to such matters as methodologically inadequate preclinical studies incapable of supporting the inferences that REC members must make about the prospects for potential benefit needed to offset the risks in early phase trials and sponsorship bias that can cause improperly designed, conducted, analysed and reported later phase trials. The analysis of the evidence makes clear that REC practices need to be strengthened if they are to adequately fulfil their gatekeeping role. The article also explores options that RECs could use in order to improve their gatekeeping function. (shrink)

The diversified methodology and expertise of interdisciplinary research teams provide the opportunity to overcome the limited perspectives of individual disciplines. This is particularly true at the interface of Robotics, Neuroscience, and Psychology as the three fields have quite different perspectives and approaches to offer. Nonetheless, aligning backgrounds and interdisciplinary expectations can present challenges due to varied research cultures and practices. Overcoming these challenges stands at the beginning of each productive collaboration and thus is a mandatory step in cognitive neurorobotics. In (...) this article, we share eight lessons that we learned from our ongoing interdisciplinary project on human-robot and robot-robot interaction in social settings. These lessons provide practical advice for scientists initiating interdisciplinary research endeavors. Our advice can help to avoid early problems and deal with differences between research fields, prepare for and anticipate challenges, align project expectations, and speed up research progress, thus promoting effective interdisciplinary research across Robotics, Neuroscience, and Psychology. (shrink)

Wood, Kressel, Joshi, and Louie’s meta-analysis of menstrual cycle influences on mate preferences identified three artifacts that influenced study findings: imprecise estimates of the fertile phase, decline over time, and publication effects. These artifacts also were evident in another recent meta-analysis by Gildersleeve, Haselton, and Fales. This consistent evidence of artifacts is not challenged by Gildersleeve et al.’s failure to find another artifact–chasing significance levels. In addition, Wood et al. correctly coded the findings of Gangestad and colleagues’ research, given the (...) variation in their reporting formats and inclusion criteria, which in some studies included only 54% of the sample. The controversy over menstrual cycle effects could be beneficial in increasing interest in publishing null results as well as in identifying evolutionary models that build on women’s capacity to regulate reproduction according to societal roles. (shrink)

Ioannidis [Why most published research findings are false. PLoS Med 2: e124 ] identifies six factors that contribute to explaining why most of the current published research findings are more likely to be false than true, and argues that for many current scientific fields, claimed research findings may often be simply accurate measures of the prevailing bias. In this article, we argue that three “hot” areas in current biological research, viz., agent-based modeling, evolutionary developmental biology , and systems biology, are (...) especially prone to the flaws. (shrink)

In their recent book, Oreskes and Conway describe the ‘tobacco strategy’, which was used by the tobacco industry to influence policymakers regarding the health risks of tobacco products. The strategy involved two parts, consisting of promoting and sharing independent research supporting the industry’s preferred position and funding additional research, but selectively publishing the results. We introduce a model of the tobacco strategy, and use it to argue that both prongs of the strategy can be extremely effective—even when policymakers rationally update (...) on all evidence available to them. As we elaborate, this model helps illustrate the conditions under which the tobacco strategy is particularly successful. In addition, we show how journalists engaged in ‘fair’ reporting can inadvertently mimic the effects of industry on public belief. 1Introduction2Epistemic Network Models3Selective Sharing4Biased Production5Journalists as Unwitting Propagandists6ConclusionAppendix. (shrink)

As machine learning has gradually entered into ever more sectors of public and private life, there has been a growing demand for algorithmic explainability. How can we make the predictions of complex statistical models more intelligible to end users? A subdiscipline of computer science known as interpretable machine learning (IML) has emerged to address this urgent question. Numerous influential methods have been proposed, from local linear approximations to rule lists and counterfactuals. In this article, I highlight three conceptual challenges that (...) are largely overlooked by authors in this area. I argue that the vast majority of IML algorithms are plagued by (1) ambiguity with respect to their true target; (2) a disregard for error rates and severe testing; and (3) an emphasis on product over process. Each point is developed at length, drawing on relevant debates in epistemology and philosophy of science. Examples and counterexamples from IML are considered, demonstrating how failure to acknowledge these problems can result in counterintuitive and potentially misleading explanations. Without greater care for the conceptual foundations of IML, future work in this area is doomed to repeat the same mistakes. (shrink)

Medicine is increasingly subject to various forms of criticism. This paper focuses on dominant forms of criticism and offers a better account of their normative character. It is argued that together, these forms of criticism are comprehensive, raising questions about both medical science and medical practice. Furthermore, it is shown that these forms of criticism mainly rely on standards of evaluation that are assumed to be internal to medicine and converge on a broader question about the aim of medicine. Further (...) work making medicine’s internal norms explicit and determining the aim of medicine would not only help to clarify to what extent the criticism is justified, but also assist an informed deliberation about the future of medicine. To illustrate some of the general difficulties associated with such a task, the paper concludes by critically engaging Edmund Pellegrino’s account of the aim of medicine as well as the Hastings Center’s consensus report. (shrink)

This articles suggests that the root of the current crisis in modern scientific innovation is mainly due to the method that science applies towards the real world. The scientific method reduces its possibilities by not considering the comprehensiveness of the human person, i.e. science is impersonal. Philosophers of science in the 20th century have identified this anthropological reductionism and further detected the limits of the scientific method. The lack of alternative solutions leads science into a cul-de-sac. The notion of crisis, (...) recently pointed out by Leonardo Polo’s Transcendental Anthropology, allows us to detect the limit, to abandon that limit and to open knowledge to further dimensions of unrestricted novelty such as freedom or love. Here we highlight the following distinctions: firstly, the state of crisis and the critical conscience, secondly, the ‘desperate vs. puzzle-solver’ critical conscience, thirdly, the limit of science and its abandonment. (shrink)

The primary aim of this study was to investigate the relation between self-perceived executive functions and the school achievement of young adolescents, while controlling for parental education and sex. We specifically focused on executive aspects of daily life behavior and the higher-order EFs, as measured with self-report, rather than on the more basic EFs which have been the primary focus of prior investigations. In two independent samples of sixth graders, students evaluated their EFs on a self-report questionnaire, the Amsterdam Executive (...) Functioning Inventory. School achievement in the domains of mathematics and reading comprehension were evaluated with nationally used, norm-based achievement tests. Results revealed that the self-perceived EFs of young adolescents were significantly correlated with their school achievement in both study samples. School achievement was also correlated with the level of parental education, but the factor sex did not have such influence. In study 1, self-perceived EFs explained additional variance in school achievement, while controlling for parental education and sex. In study 2, this was only the case for the most robust measure of school achievement, i.e., the end-of-primary-school final achievement test. Furthermore, besides the relation with achievement tests, we also found a relation between self-perceived EFs and teacher ratings behavioral problems in the classroom. Together, our findings imply that young students can properly reflect on the effectiveness and appropriateness of their EFs in a way that is relevant to their academic achievement and classroom behavior. The findings underscore the importance of considering the development of EFs and parental education in the evaluation of academic achievements in early adolescence. (shrink)

Theoretical arguments and empirical investigations indicate that a high proportion of published findings do not replicate and are likely false. The current position paper provides a broad perspective on scientific error, which may lead to replication failures. This broad perspective focuses on reform history and on opportunities for future reform. We organize our perspective along four main themes: institutional reform, methodological reform, statistical reform and publishing reform. For each theme, we illustrate potential errors by narrating the story of a fictional (...) researcher during the research cycle. We discuss future opportunities for reform. The resulting agenda provides a resource to usher in an era that is marked by a research culture that is less error-prone and a scientific publication landscape with fewer spurious findings. (shrink)

In the last decade, many problematic cases of scientific conduct have been diagnosed; some of which involve outright fraud others are more subtle. These and similar problems can be interpreted as caused by lack of scientific objectivity. The current philosophical theories of objectivity do not provide scientists with conceptualizations that can be effectively put into practice in remedying these issues. We propose a novel way of thinking about objectivity for individual scientists; a negative and dynamic approach.We provide a philosophical conceptualization (...) of objectivity that is informed by empirical research. In particular, it is our intention to take the first steps in providing an empirically and methodologically informed inventory of factors that impair the scientific practice. The inventory will be compiled into a negative conceptualization, which could in principle be used by individual scientists to assess objectivity of scientific practice. We propose a preliminary outline of a usable and testable instrument for indicating the objectivity of scientific practice. (shrink)

In the human sciences, experimental research is used to establish causal relationships. However, the extrapolation of these results to the target population can be problematic. To facilitate extrapolation, we propose to use the statistical technique Latent Class Regression Analysis in combination with the analogical reasoning theory for extrapolation. This statistical technique can identify latent classes that differ in the effect of X on Y. In order to extrapolate by means of analogical reasoning, one can characterize the latent classes by a (...) combination of features, and then compare these features to features of the target. (shrink)

Research integrity is usually discussed in terms of responsibilities that individual researchers bear towards the scientific work they conduct, as well as responsibilities that institutions have to enable those individual researchers to do so. In addition to these two bearers of responsibility, a third category often surfaces, which is variably referred to as culture and practice. These notions merit further development beyond a residual category that is to contain everything that is not covered by attributions to individuals and institutions. This (...) paper discusses how thinking in RI can take benefit from more specific ideas on practice and culture. We start by articulating elements of practice and culture, and explore how values central to RI are related to these elements. These insights help identify additional points of intervention for fostering responsible conduct. This helps to build “cultures and practices of research integrity”, as it makes clear that specific times and places are connected to specific practices and cultures and should have a place in the debate on Research Integrity. With this conceptual framework, practitioners as well as theorists can avoid using the notions as residual categories that de facto amount to vague, additional burdens of responsibility for the individual. (shrink)

It has been argued that supervenience generates unavoidable confounding problems for interventionist accounts of causation, to the point that we must choose between interventionism and supervenience. According to one solution, the dilemma can be defused by excluding non-causal determinants of an outcome as potential confounders. I argue that this solution undermines the methodological validity of causal tests. Moreover, we don’t have to choose between interventionism and supervenience in the first place. Some confounding problems are effectively circumvented by experimental designs routinely (...) employed in science. The remaining confounding issues concern the physical interpretation of variables and cannot be solved by choosing between interventionism and supervenience. (shrink)

ABSTRACTPossibly, the replication crisis constitutes the most important problem in psychology. It calls into question whether psychology is a science. Existing conceptualizations of replicability depend on effect sizes; the larger the population effect size, the greater the probability of replication. This is problematic and contributes to the replication crisis. A different conceptualization, not dependent on population effect sizes, is desirable. The proposed solution features the closeness of sample means to their corresponding population means, in both the original and replication experiments. (...) If the researcher has specified the sampling precision desired, it is possible to calculate the probability of replication, prior to data collection, and without dependence on the population effect size or expected population effect size. In addition, it is not necessary to know population means or standard deviations, nor sample means or standard deviations, to employ the proposed a priori way of thinking about... (shrink)

While the importance of mechanisms in determining causality in medicine is currently the subject of active debate, the role of mechanistic reasoning in clinical practice has received far less attention. In this paper we look at this question in the context of the treatment of a particular individual, and argue that evidence of mechanisms is indeed key to various aspects of clinical practice, including assessing population-level research reports, diagnostic as well as therapeutic decision making, and the assessment of treatment effects. (...) We use the pulmonary condition bronchiectasis as a source of examples of the importance of mechanistic reasoning to clinical practice. (shrink)

The experience of the use of applied containerized biomedical software tools in cloud environment is summarized. The reproducibility of scientific computing in relation with modern technologies of scientific calculations is discussed. The main approaches to biomedical data preprocessing and integration in the framework of the intelligent analytical system are described. At the conditions of pandemic, the success of health care system depends significantly on the regular implementation of effective research tools and population monitoring. The earlier the risks of disease can (...) be identified, the more effective process of preventive measures or treatments can be. This publication is about the creation of a prototype for such a tool within the project «Development of methods, algorithms and intelligent analytical system for processing and analysis of heterogeneous clinical and biomedical data to improve the diagnosis of complex diseases», implementted by the V.M. Glushkov Institute of Cybernetics, National Academy of Sciences of Ukraine, together with the United Institute of Informatics Problems, National Academy of Sciences of Belarus. The insurers, entering the market, can insure mostly low risks by facilitating more frequent changes of insurers by consumers and mixing the overall health insurance market. Socio-demographic variables can be risk adjusters. Since age and gender have a relatively small explanatory power, other socio-demographic variables were studied – marital status, retirement status, disability status, educational level, income level. Because insurers have an interest in beneficial diagnoses for their policyholders, they are also interested in the ability to interpret relevant information – upcoding: insurers can encourage their policyholders to consult with doctors more often to select as many diagnoses as possible. Many countries and health care systems use diagnostic information to determine the reimbursement to a service provider, revealing the necessary data. For processing and analysis of these data, software implementations of construction for classifiers, allocation of informative features, processing of heterogeneous medical and biological variables for carrying out scientific research in the field of clinical medicine are developed. The experience of the use of applied containerized biomedical software tools in cloud environment is summarized. The reproducibility of scientific computing in relation with modern technologies of scientific calculations is discussed. Particularly, attention is paid to containerization of biomedical applications, this permits to get reproducibility of the conditions in which the calculations took place, technologies of software pipelining of calculations, that allows to organize flow calculations, and technologies for parameterization of software environment, that allows to reproduce, if necessary, an identical computing environment. The main approaches to biomedical data preprocessing and integration in the framework of the intelligent analytical system are described. The experience of using the developed linear classifier, gained during its testing on artificial and real data, allows us to conclude about several advantages provided by the containerized form of the created application: it permits to provide access to real data located in cloud environment; it is possible to perform calculations to solve research problems on cloud resources both with the help of developed tools and with the help of cloud services; such a form of research organization makes numerical experiments reproducible, i.e. any other researcher can compare the results of their developments on specific data that have already been studied by others, in order to verify the conclusions and technical feasibility of new results; there exists a universal opportunity to use the developed tools on technical devices of various classes from a personal computer to powerful cluster. (shrink)

In this article, the authors use the context of childbirth to consider the power that is endemic in certain forms of evidence within maternity care research. First, there is consideration of how the current evidence hierarchy and experimental‐based studies are the gold standard to determine and direct women's maternity experiences, although this can be at the detriment of care and irrespective of women's needs. This is followed by a critique of how the predominant means to assess women's experiences via satisfaction (...) surveys is of limited utility, offering impartial and restricted insights to assess the quality of care provision. A counter position of hermeneutic phenomenology as research method is then described. This approach offers an alternative perspective by penetrating the taken‐for‐granted ordinariness of an event (such as childbirth) to elicit rich emic meanings. Whilst all approaches to understanding maternity care have a place, depending on the question(s) being asked, the contribution of phenomenology is how it can uncover a depth of contextual understanding into what matters to women and to inform and transform care delivery. (shrink)

Retractions of COVID-19 literature in both preprints and the peer-reviewed literature serve as a reminder that there are still challenging issues underlying the integrity of the biomedical literature. The risks to academia become larger when such retractions take place in high-ranking biomedical journals. In some cases, retractions result from unreliable or nonexistent data, an issue that could easily be avoided by having open data policies, but there have also been retractions due to oversight in peer review and editorial verification. As (...) COVID-19 continues to affect academics and societies around the world, failures in peer review might also constitute a public health risk. The effectiveness by which COVID-19 literature is corrected, including through retractions, depends on the stringency of measures in place to detect errors and to correct erroneous literature. It also relies on the stringent implementation of open data policies. (shrink)

PurposeThe issue of “predatory” publishing and the scholarly value of journals that claim to operate within an academic framework, namely, by using peer review and editorial quality control, but do not, while attempting to extract open access or other publication-related fees, is an extremely important topic that affects academics around the globe. Until 2017, global academia relied on two now-defunct Jeffrey Beall “predatory” OA publishing blacklists to select their choice of publishing venue. This paper aims to explore how media has (...) played a role in spinning public impressions about this issue.Design/methodology/approachThe authors focus on a 2017New York Timesarticle by Gina Kolata, on a selected number of peer reviewed published papers on the topic of “predatory” publications and on an editorial by the Editor-in-Chief ofREM, a SciELO- and Scopus-indexed OA journal.FindingsThe Kolata article offers biased, inaccurate and potentially misleading information about the state of “predatory” publishing: it relies heavily on the assumption that the now-defunct Beall blacklists were accurate when in fact they are not; it relies on a paper published in a non-predatory non-OA journal that claimed incorrectly the existence of financial rewards by faculty members of a Canadian business school from “predatory” publications; it praised a sting operation that used methods of deception and falsification to achieve its conclusions. The authors show how misleading information by theNew York Timeswas transposed downstream via theREMeditorial.Originality/valueEducation of academics. (shrink)

Academic publishing is undergoing a highly transformative process, and many established rules and value systems that are in place, such as traditional peer review (TPR) and preprints, are facing unprecedented challenges, including as a result of post-publication peer review. The integrity and validity of the academic literature continue to rely naively on blind trust, while TPR and preprints continue to fail to effectively screen out errors, fraud, and misconduct. Imperfect TPR invariably results in imperfect papers that have passed through varying (...) levels of rigor of screening and validation. If errors or misconduct were not detected during TPR’s editorial screening, but are detected at the post-publication stage, an opportunity is created to correct the academic record. Currently, the most common forms of correcting the academic literature are errata, corrigenda, expressions of concern, and retractions or withdrawals. Some additional measures to correct the literature have emerged, including manuscript versioning, amendments, partial retractions and retract and replace. Preprints can also be corrected if their version is updated. This paper discusses the risks, benefits and limitations of these forms of correcting the academic literature. (shrink)

This article describes contrasting ideas for a set of topics in epidemiological thinking. The premise underlying this contribution to the special edition is that researchers develop their epidemiological thinking over time through interactions with other researchers who have a variety of in-practice commitments, such as to kinds of cases and methods of analysis, and not simply to a philosophical framework for explanation. I encourage discussants from philosophy and epidemiology to draw purposefully from across a range of topics and contrasting positions, (...) and thereby pursue critical thinking in the sense of understanding ideas and practices better when we examine them in relation to alternatives. After an initial topic concerning practices for developing epidemiological literacy, a number of conceptual steps follow—the characterization of the very phenomena we might be concerned with, the scope and challenges of the field of epidemiology, the formulation of categories—before linking associations, predictions, causes and interventions and examining the confounding of purported links. Building on that conceptual basis, the remaining topics consist of issues or angles of analysis related to the complexities of inequalities within and between populations, context, and changes over the life course. The organization of topics derives from a graduate course that I teach that aims for epidemiological literacy, not technical ability in statistical formulas and data analysis, and shares the underlying premise and critical thinking goals of this article. During the topic-by-topic description, some assertions about explanation and intervention emerge, notably, that epidemiological–philosophical discussion about causality often leaves unclear or unexamined whether a modifiable factor shown to have been associated with a difference in the data from past observations should be thought of as factor that, when modified, would generate that difference going forward. The article concludes with a “Limitations of this Study” section that teases out different kinds of description–prescription relationship that are implied in undertaking philosophy of epidemiology and identifies some other considerations that are implied but not emphasized by this article. (shrink)

Mutually supporting methodologies are necessary for building a convincing case establishing a particular effect. Strengths and weaknesses of four empirical methods are discussed. Econometric methods quantify the relative importance of different factors and may assess the time frame over which constitutions matter, but have difficulties in dealing with nonlinear interactions among constitutional and cultural details. Cluster analysis can be a pre-requisite to other methods, and an analytic method in itself, useful for identifying the details that really matter and discovering surprising (...) patterns in the data. I discuss the application of cluster analysis on the Comparative Constitutions Project database. Qualitative comparative analysis can reveal the hidden structure of interactions among different variables, but robustness checks are difficult to perform. Case studies are useful for distinguishing between rules-in-use and rules-in-form and for discovering important informal aspects. They can deal with com.. (shrink)

Research misconduct is an alarming concern worldwide, and especially in Italy, where there is no formal training of young researchers in responsible research practices. The main aim of this study was to map the perceptions and attitudes about RM in a sample of young researchers attending a one-week intensive course on methodology, ethics and integrity in biomedical research, held at the University of Insubria. To this end, we administered the Scientific Misconduct Questionnaire to all attendees at the beginning of the (...) course. Thereafter, SMQ-R was re-administered at the end, to assess the impact of the course on the responsiveness of study participants, which is intended as the frequency of responses other than “don’t know”. Results show that respondents rate as high their own understanding about rules and procedures related to scientific misconduct, as well as the effectiveness of their institution’s measures for reducing it. Most of them perceive as low the chances of getting caught for RM. Some respondents believe that cases of misconduct occur in their workplace and that the integrity of a research is not solely the responsibility of the principal investigator. Among the main factors contributing to research misconduct, the need for publications, unclear definition of what constitutes misconduct and pressure for external funding do stand out. Respondents are concerned about the amount of misconduct and express a pressing need for training on research ethics. Remarkably, the responsiveness of participants tends to increase with course attendance. This finding may be useful to support education programmes devoted to research methodology, ethics and integrity among young researchers. (shrink)