Abstract

Technology firms are now purchasing access to research papers from academic publishers to train their artificial intelligence (AI) models. Using scientific content to train AI can come with multiple benefits, which help improve AI's capability to generate trustworthy outcomes, understand and process issues across a wide range of topics, as well as analyze information, make logical deductions, and draw conclusions. Journal articles are generally considered reliable because of the rigorous peer review system. However, the evaluation process is constrained by several limitations, so a number of unreliable and invalid studies have been published. Retraction is often viewed as a crucial self-correction mechanism within science, allowing the academic community to identify and flag seriously flawed research that has been published. If retracted articles are used to train AI, it could lead to the spread of misinformation. Given the power of AI, this misinformation could be disseminated on a large scale and in a very short time, which might misinform and significantly increase the entropy (uncertainty) within society. Retracted notices can serve as a signal for AI developers to exclude seriously flawed articles from the training process. However, if the scientific content used to train AI is later discovered to be seriously distorted and retracted, it cannot be removed from the model’s knowledge base after the training is complete. As AI is increasingly applied in critical areas such as education and decision-making, training AI on seriously flawed scientific findings could lead to significant systematic consequences. Therefore, collaboration between the scientific community and AI developers to address these issues is crucial.