We argue that the later Wittgenstein’s philosophy of language and mathematics, substantially focused on rule-following, is relevant to understand and improve on the Artificial Intelligence (AI) alignment problem: his discussions on the categories that influence alignment between humans can inform about the categories that should be controlled to improve on the alignment problem when creating large data sets to be used by supervised and unsupervised learning algorithms, as well as when introducing hard coded guardrails for AI models. We cast these (...) considerations in a model of human–human and human–machine alignment and sketch basic alignment strategies based on these categories and further reflections on rule-following like the notion of meaning as use. To sustain the validity of these considerations, we also show that successful techniques employed by AI safety researchers to better align new AI systems with our human goals are congruent with the stipulations that we derive from the later Wittgenstein’s philosophy. However, their application may benefit from the added specificities and stipulations of our framework: it extends on the current efforts and provides further, specific AI alignment techniques. Thus, we argue that the categories of the model and the core alignment strategies presented in this work can inform further AI alignment techniques. (shrink)

The conditions involved in the applicability of mathematics in science are the subject of ongoing debates. One of the best‐received approaches is the inferential account, which involves structural mappings and pragmatic considerations in a three‐step model. According to the inferential account, these pragmatic considerations happen in the immersion and interpretation stages, but not during derivation (symbol‐pushing in a mathematical formalism). In this work, I draw inspiration from the later Wittgenstein and make the case that the applicability of mathematics also rests (...) on pragmatic considerations at the mathematical derivation level. I make the further case that pragmatic considerations at the mathematical derivation level may substitute pragmatic considerations in the other two stages, thus showing how they are holistically interrelated. I illustrate these two points with the solution of a simple geometrical problem. (shrink)