Natural Language Processing

Rapid advancement of urbanization has necessitated the creation of "smart cities," where information and communication technologies (ICT) are used to improve the quality of urban life. Central to the smart city paradigm is data integration—connecting disparate data sources from various urban systems, such as transportation, healthcare, utilities, and public safety. This paper explores the role of Artificial Intelligence (AI) in facilitating data integration within smart cities, focusing on how AI technologies can enable effective urban governance. By examining the current landscape (...) of data integration and AI in smart cities, we highlight key challenges, solutions, and future trends. We conclude that AI-driven data integration is essential for optimizing city operations, fostering sustainability, and enhancing decision-making for urban governance. (shrink)

Language is expressed in a consecutive way that is called linearity; it is acceptable to think that language understanding also occurs in a linear way. In this paper, it will be argued that although sentences are expressed in a linear way, they are not understood in the same way, because we develop an understanding of the entwined phrases forming a sentence beyond the single words. Therefore, it is argued that linearity cannot adequately explain sentence understanding. In addition, by introducing the (...) concept of mental work that is based on “the law of less work” or our natural tendency toward less mental effort, we will try to explain sentence understanding based on the ladder model instead of the linear model. (shrink)

The ability to communicate in a specific language like Chinese typically indicates that the speaker understands the language. A counterexample to this belief is John Searle’s Chinese room experiment. It has been shown in this experiment that in certain circumstances we can communicate with a Chinese speaker without intuitively acknowledging that the Chinese language is understood in the conversation. In the present paper, we aim to present another counterexample showing that, in certain circumstances, we can communicate using a specific language (...) by converting its words to those of our natural language, and understand what is expressed using the language without understanding it. Using a specific conversion process introduced in the present paper, symbols and even sounds of a language like the Chinese language lose their original function and act as a tool to express one’s natural language. To better understand this, imagine the English language has another writing or phonological system in addition to its current writing system. (shrink)

Sideloading is the creation of a digital model of a person during their life via iterative improvements of this model based on the person's feedback. The progress of LLMs with large prompts allows the creation of very large, book-size prompts which describe a personality. We will call mind-models created via sideloading "sideloads"; they often look like chatbots, but they are more than that as they have other output channels, like internal thought streams and descriptions of actions. -/- By arranging the (...) predictive power of the facts about a person, we can write down the most important facts first. This allows us to get a high level of fidelity in a person's model by writing down a finite number of facts and running it as an LLM prompt with instructions to create a person's chatbot. This instruction also includes an extensive general sideload prompt (we will call it a prompt-loader), which explains how the person's sideload should work, but it is universal and works as an operating system for different persons. -/- I created my personal sideload to test all this and it started working surprisingly quickly. We found that there are three main levels of facts about a person: core facts, long-term memory, and historical facts. Core facts should go to the main prompt of the LLM, long-term memory belongs to RAG, and historical facts – which a person often does not remember – should be only used to extract new relevant data. The most important thing in preparing data for sideloading is to get a full list of the core facts, and not to mix it with long-term memory and historical facts. The LLM-sideload project is inherently future-oriented. New state-of-the-art LLMs with large prompt capabilities emerge quarterly. This allows for the preparation of prompts that exceed current LLM capabilities, anticipating smooth execution in the following year. Below we present the key findings of this work in the form of an executive summary: Quality of sideloads is evaluated using three metrics: • Facts: Accuracy of the answers about the person's life • Vibe: How well the sideload captures the person's style and personality, as judged by the person themselves and their acquaintances • Brilliant insights: Ability to contribute unique, valuable ideas beyond the training data, while maintaining the author's style • Coarseness: Levels of details as percent of the total of recordable textual information from memory estimated to be 10000 pages. Similar to the jpeg level of compression. Estimated performance of Alexey Turchin's sideload: • Facts: 70% correct • Vibe: 20% accurate • Brilliant insights: near zero • Coarseness: 10% The project achieved these results in about one month of work. Vibe is harder to evaluate and regulate than facts. This approach focuses on informational personal identity, setting aside issues of observer identity and internal qualia. (shrink)

The proliferation of Internet of Things (IoT) devices has introduced a range of opportunities for enhanced connectivity, automation, and efficiency. However, the vast array of interconnected devices has also raised concerns regarding cybersecurity, particularly due to the limited resources and diverse nature of IoT devices. Intrusion detection systems (IDS) have emerged as critical tools for identifying and mitigating security threats. This paper proposes a Multi-Layer Intrusion Detection Framework for IoT systems, leveraging Ensemble Machine Learning (EML) techniques to improve the accuracy (...) and effectiveness of detecting intrusions. The proposed framework integrates multiple layers of defense, including data preprocessing, feature extraction, classification, and post-processing, to provide a robust solution to IoT security challenges. This research explores the application of EML methods such as Random Forests, AdaBoost, and Gradient Boosting, combining them into a unified model to detect and mitigate various types of attacks in IoT environments. Experimental results demonstrate the superiority of the proposed framework in terms of detection accuracy, false positive rate, and computational efficiency. (shrink)

In contemporary healthcare, medical image categorization is essential for illness prediction, diagnosis, and therapy planning. The emergence of digital imaging technology has led to a significant increase in research into the use of machine learning (ML) techniques for the categorization of images in medical data. We provide a thorough summary of recent developments in this area in this review, using knowledge from the most recent research and cutting-edge methods.We begin by discussing the unique challenges and opportunities associated with medical image (...) classification, including the complexity of anatomical structures, variability in imaging modalities, and the need for interpretability and reliability in clinical settings. Subsequently, we survey a wide range of ML algorithms and techniques employed for medical image classification, including traditional methods such as support vector machines and k-nearest neighbors, as well as deep learning approaches like convolutional neural networks (CNNs) and recurrent neural networks (RNNs). Furthermore, we examine key considerations in dataset preparation, feature extraction, and model evaluation specific to medical image classification tasks. We highlight the importance of large, annotated datasets, transfer learning, and data augmentation techniques in enhancing model performance and generalization. (shrink)

Description Logics (DLs) are a family of well-known terminological knowledge representation formalisms in modern semantics-based systems. This research focuses on analysing how our developed Occurrence Logic (OccL) can conceptually and logically support the development of a description logic. OccL is integrated into the alternative theory of natural language syntax in `Deviational Syntactic Structures' under the label `EFA(X)3' (or the third version of Epi-Formal Analysis in Syntax, EFA(X), which is a radical linguistic theory). From the logical point of view, OccL is (...) a formal logic that mainly deals with the occurrences of symbols as well as with their priorities within linguistic descriptions, i.e. natural language syntax, semantics and phonology. In this article---based on our OccL-based definitions of the concepts of `strong implication' and `occurrence value' as well as of the logical concept `identical occurrence constructor (IDOC)' that is the most fundamental logical concept in our formalism---we will model Occurrence Description Logic ($\mathcal{ODL}$). Accordingly, we will formally-logically analyse `occurrence(s) of symbol(s)' within descriptions of the world in $\mathcal{ODL}$. In addition, we will analyse and assess the logical concepts of `occurrence' and `occurrence priority' in $\mathcal{ODL}$. This research can make a strong logical background for our future research in the development of a Modal Occurrence Description Logic. (shrink)

Scalability, efficiency, and security had been a persistent problem over the years in data mining, several techniques had been proposed and implemented but none had been able to solve the problem of scalability, efficiency and security from cloud computing. In this research, we solve the problem scalability, efficiency and security in data mining over cloud computing by using a restful web services and combination of different technologies and tools, our model was trained by using different machine learning algorithm, and finally (...) using different validation and cross-validation methods to compare and validate our results. We build, train, test and deploy our model by restful API services which can be called through an endpoint, and with very high accuracy and huge success. (shrink)

The problem considered in this chapter emerges from the tension we find when looking at the design and architecture of chatbots on the one hand and their conversational aptitude on the other. In the way that LLM chatbots are designed and built, we have good reason to suppose they don't possess second-order capacities such as intention, belief or knowledge. Yet theories of conversation make great use of second-order capacities of speakers and their audiences to explain how aspects of interaction succeed. (...) As we can all bear witness to now though, at the point of use chatbots appear capable of performing language tasks at a level close to that of humans. This creates a tension when we consider something like, for example, the classic Gricean theory of implicature. On a broad summary of this type of account, to utter p and implicate q requires the reflexive occurrence of an audience supposing a speaker believes that q, and the speaker believing that their audience can determine they believe it when they utter p. So taken at face value, if a chatbot doesn’t have the capacity for belief, then either in their role as speaker or audience, they would not seem capable of either generating or comprehending implicatures. Yet on the surface it does seem that chatbots are capable of dealing with (some) implicatures, and as such it raises questions about how we should then correlate this with what we think occurs in cases of implicature with chatbots. (shrink)

The present paper looks at one of the most thorough articles on the intelligence of GPT, research conducted by engineers at Microsoft. Although there is a great deal of value in their work, I will argue that, for familiar philosophical reasons, their methodology, ‘Black-box Interpretability’ is wrongheaded. But there is a better way. There is an exciting and emerging discipline of ‘Inner Interpretability’ (also sometimes called ‘White-box Interpretability’) that aims to uncover the internal activations and weights of models in order (...) to understand what they represent and the algorithms they implement. In my view, a crucial mistake in Black-box Interpretability is the failure to appreciate that how processes are carried out matters when it comes to intelligence and understanding. I can’t pretend to have a full story that provides both necessary and sufficient conditions for being intelligent, but I do think that Inner Interpretability dovetails nicely with plausible philosophical views of what intelligence requires. So the conclusion is modest, but the important point in my view is seeing how to get the research on the right track. Towards the end of the paper, I will show how some of the philosophical concepts can be used to further refine how Inner Interpretability is approached, so the paper helps draw out a profitable, future two-way exchange between Philosophers and Computer Scientists. (shrink)

Although personal relevance is key to sustaining an audience’s interest in any given narrative, it has received little systematic attention in scholarship to date. Across centuries and media, adaptations have been used extensively to bring temporally or geographically distant narratives “closer” to the recipient under the assumption that their impact will increase. In this review article, we review experimental and other empirical evidence on narrative processing in order to unravel which types of personal relevance are more likely to be impactful (...) than others, which types of impact (e.g. aesthetic, therapeutic, persuasive) they have been found to generate, and where their power may become excessive or outright detrimental to reader experience. (shrink)

This paper explores two important ways in which the practice of close reading differs from the technique of natural language processing, the use of computer programming to decode, process, and replicate messages within a human language. It does so in order to highlight distinctive features of close reading that are not replicated by natural language processing. The first point of distinction concerns the nature of the meaning generated in each case. While natural language processing proceeds on the principle that a (...) text’s meaning can be deciphered by applying the rules governing the language in which the text is written, close reading is premised on the idea that this meaning lies in the interplay that the text prompts within readers. While the semantic theory of meaning upon which natural language processing programs are based is often taken for granted today, I draw from phenomenological and hermeneutic theories, particularly Wolfgang Iser and Hans-Georg Gadamer, to explain why a different theory of meaning is necessary for understanding the meaning generated by close reading. Second, while natural language processing programs are considered successful when they generate what epistemologists call true beliefs about a text, I argue that close reading aims first and foremost at the development, not of true belief, but of understanding. To develop this distinction, I draw from recent scholarship on the epistemology of education, including work by Duncan Pritchard, to explain how understanding differs from true belief and why attainment of the latter is less educationally significant than the former. (shrink)

Esta entrevista se realizó el 10 de agosto de 2021. El objetivo fue indagar acerca de los estudios lingüísticos de Chile; en especial, de sus hablantes natales y su producción literaria. Es insoslayable rememorar que en ese país hay dos referentes fundamentales: Gabriela Mistral y Pablo Neruda, quienes han sido influyentes en la forma de expresarse de muchos ciudadanos en el siglo XX. Asimismo, esta conversación permite conocer las causas por las que existen variantes lingüísticas en Latinoamérica, motivo por el (...) cual esta propuesta es de utilidad para emprender nuevas investigaciones en torno al uso del lenguaje desde el ámbito académico. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then make (...) and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

A key assumption fuelling optimism about the progress of large language models (LLMs) in accurately and comprehensively modelling the world is that the truth is systematic: true statements about the world form a whole that is not just consistent, in that it contains no contradictions, but coherent, in that the truths are inferentially interlinked. This holds out the prospect that LLMs might in principle rely on that systematicity to fill in gaps and correct inaccuracies in the training data: consistency and (...) coherence promise to facilitate progress towards comprehensiveness in an LLM’s representation of the world. However, philosophers have identified compelling reasons to doubt that the truth is systematic across all domains of thought, arguing that in normative domains, in particular, the truth is largely asystematic. I argue that insofar as the truth in normative domains is asystematic, this renders it correspondingly harder for LLMs to make progress, because they cannot then leverage the systematicity of truth. And the less LLMs can rely on the systematicity of truth, the less we can rely on them to do our practical deliberation for us, because the very asystematicity of normative domains requires human agency to play a greater role in practical thought. (shrink)

No natural language has contrafactive attitude verbs. Because factives are universal across natural languages, this means that there is a major asymmetry between contrafactives and factives. We previously hypothesised that this asymmetry arises partly because the meaning of contrafactives is significantly harder to learn than that of factives. Here we test this hypothesis by using a production-oriented computational experiment that overcomes two limitations of our previous experiments. We find that our results do not support our previous hypothesis.

One of the central questions in the epistemology of conversational AIs is how to classify the beliefs acquired from them. Two promising candidates are instrument-based and testimony-based beliefs. However, the category of instrument-based beliefs faces an intrinsic problem, and a challenge arises in its application. On the other hand, relying solely on the category of testimony-based beliefs does not encompass the totality of our practice of using conversational AIs. To address these limitations, I propose a novel classification of beliefs that (...) shifts the focus from the properties of the conversational AIs themselves to how recipients perceive AI output, specifically whether they take the output at face value. The proposed categories are beliefs by regarding as instruments and beliefs by regarding as testifiers. By using these complementary categories, a more comprehensive understanding of beliefs acquired from conversational AIs can be achieved while avoiding the problems associated with the traditional classification. (shrink)

One of the central questions in the epistemology of conversational AIs is how to classify the beliefs acquired from them. Two promising candidates are instrument-based and testimony-based beliefs. However, the category of instrument-based beliefs faces an intrinsic problem, and a challenge arises in its application. On the other hand, relying solely on the category of testimony-based beliefs does not encompass the totality of our practice of using conversational AIs. To address these limitations, I propose a novel classification of beliefs that (...) shifts the focus from the properties of the conversational AIs themselves to how recipients perceive AI output, specifically whether they take the output at face value. The proposed categories are beliefs by regarding as instruments and beliefs by regarding as testifiers. By using these complementary categories, a more comprehensive understanding of beliefs acquired from conversational AIs can be achieved while avoiding the problems associated with the traditional classification. (shrink)

Are LLMs cultural technologies like photocopiers or printing presses, which transmit information but cannot create new content? A challenge for this idea, which we call bibliotechnism, is that LLMs generate novel text. We begin with a defense of bibliotechnism, showing how even novel text may inherit its meaning from original human-generated text. We then argue that bibliotechnism faces an independent challenge from examples in which LLMs generate novel reference, using new names to refer to new entities. Such examples could be (...) explained if LLMs were not cultural technologies but had beliefs, desires, and intentions. According to interpretationism in the philosophy of mind, a system has such attitudes if and only if its behavior is well explained by the hypothesis that it does. Interpretationists may hold that LLMs have attitudes, and thus have a simple solution to the novel reference problem. We emphasize, however, that interpretationism is compatible with very simple creatures having attitudes and differs sharply from views that presuppose these attitudes require onsciousness, sentience, or intelligence (topics about which we make no claims). (shrink)

Zeugmatic oddness is a linguistic intuition of oddness with respect to an instance of zeugma, i.e. a sentence containing an instance of a homonymous or polysemous word being used in different meanings or senses simultaneously. Zeugmatic oddness is important for philosophical debates as philosophers often use it to argue that a particular philosophically interesting expression is ambiguous and that the phenomenon referred to by the expression is disunified. This paper takes a closer look at zeugmatic oddness. Focusing on relevant psycholinguistic (...) literature on homonymy and polysemy processing and representation, I argue that there are two different ways in which zeugmatic oddness can arise. Philosophical upshots concerning zeugmatic oddness are then drawn. (shrink)

Empirical evidence suggests that perceptual‐motor simulations are often constitutively involved in language comprehension. Call this “the simulation view of language comprehension”. This article applies the simulation view to illuminate the much‐discussed phenomenon of copredication, where a noun permits multiple predications which seem to select different senses of the noun simultaneously. On the proposed account, the (in)felicitousness of a copredicational sentence is closely associated with the perceptual simulations that the language user deploys in comprehending the sentence.

As systems based on opaque Artificial Intelligence (AI) continue to flourish in diverse real-world applications, understanding these black box models has become paramount. In response, Explainable AI (XAI) has emerged as a field of research with practical and ethical benefits across various domains. This paper not only highlights the advancements in XAI and its application in real-world scenarios but also addresses the ongoing challenges within XAI, emphasizing the need for broader perspectives and collaborative efforts. We bring together experts from diverse (...) fields to identify open problems, striving to synchronize research agendas and accelerate XAI in practical applications. By fostering collaborative discussion and interdisciplinary cooperation, we aim to propel XAI forward, contributing to its continued success. Our goal is to put forward a comprehensive proposal for advancing XAI. To achieve this goal, we present a manifesto of 27 open problems categorized into nine categories. These challenges encapsulate the complexities and nuances of XAI and offer a road map for future research. For each problem, we provide promising research directions in the hope of harnessing the collective intelligence of interested stakeholders. (shrink)

The article argues that AI can enhance the measurement and implementation of democratic processes within political parties, known as Intra-Party Democracy (IPD). It identifies the limitations of traditional methods for measuring IPD, which often rely on formal parameters, self-reported data, and tools like surveys. Such limitations lead to partial data collection, rare updates, and significant resource demands. To address these issues, the article suggests that specific data management and Machine Learning techniques, such as natural language processing and sentiment analysis, can (...) improve the measurement and practice of IPD. (shrink)

When it comes to learning a second language, no matter what age, almost every publication talks about individual differences that lead the learners to success. It is possible to say that the age factor is the most significant of these. Various elements occur as a result of individual differences: The rate of acquisition, ultimate achievement and the processes involved in language acquisition are important ones affected by differences among learners, particularly their age. The present work deals mainly with the age (...) issue in second language acquisition, along with other factors related to individual differences, which are often treated in psychological positions. The data were obtained from a literature search. Looking at the written literature in the field, it has been found that the onset of second language acquisition and the final accomplishment are also the two titles that scholars have studied very much. The question of whether a critical period addressed language acquisition exists is a controversial one in the scientific world. However, even though there are no well-delineated age restrictions ready for attaining native or native-like proficiency in a second language, the period (age) at which one starts has been shown to correlate with ultimate proficiency. (shrink)

Several important philosophical problems (including the problems of perception, free will, and scepticism) arise from antinomies that are developed through philosophical paradoxes. The critical strand of ordinary language philosophy (OLP), as practiced by J.L. Austin, provides an approach to such ‘antinomic problems’ that proceeds from an examination of ‘ordinary language’ (how people ordinarily talk about the phenomenon of interest) and ‘common sense’ (what they commonly think about it), and deploys findings to show that the problems at issue are artefacts of (...) fallacious reasoning. The approach is capable, and in need of, empirical development. Proceeding from a case-study on Austin’s paradigmatic treatment of the problem of perception, this paper identifies the key empirical assumptions informing the approach, assesses them in the light of empirical findings about default inferences, contextualisation failures, and belief fragmentation, and explores how these findings can be deployed to address the problem of perception. This facilitates a novel resolution of the problem of perception. Proceeding from this paradigm, the paper proposes ‘experimental critical OLP’ as a new research program in experimental philosophy that avoids apparent non-sequiturs of OLP, extends and transforms experimental philosophy’s ‘sources program’, and provides a promising new strategy for deploying empirical findings about how people ordinarily talk and think about phenomena, to address longstanding philosophical problems. (shrink)

Despite its centrality in the philosophy of cognitive science, there has been little prior philosophical work engaging with the notion of representation in contemporary NLP practice. This paper attempts to fill that lacuna: drawing on ideas from cognitive science, I introduce a framework for evaluating the representational claims made about components of neural NLP models, proposing three criteria with which to evaluate whether a component of a model represents a property and operationalising these criteria using probing classifiers, a popular analysis (...) technique in NLP (and deep learning more broadly). The project of operationalising a philosophically-informed notion of representation should be of interest to both philosophers of science and NLP practitioners. It affords philosophers a novel testing-ground for claims about the nature of representation, and helps NLPers organise the large literature on probing experiments, suggesting novel avenues for empirical research. (shrink)

If Large Language Models can make real scientific contributions, then they can genuinely use language, be systematically wrong, and be held responsible for their errors. AI models which can make scientific contributions thereby meet the criteria for scientific authorship.

As testing of ChatGPT has shown, this form of artificial intelligence has the potential to develop, which requires improving its software and other hardware that allows it to learn, i.e., to acquire and use new knowledge, to contact its developers with suggestions for improvement, or to reprogram itself without their participation. Как показало тестирование ChatGPT, эта форма искусственного интеллекта имеет потенциал развития, для чего необходимо усовершенствовать её программное и прочее техническое обеспечение, позволяющее ей учиться, т.е. приобретать и использовать новые знания, (...) обращаться к её разработчикам с предложениями по усовершенствованию, или производить самопрограммирование без их участия. (shrink)

The topic of this dissertation is the nature of linguistic competence, the capacity to understand and produce sentences of natural language. I defend the empiricist account of linguistic competence embedded in the connectionist cognitive science. This strand of cognitive science has been opposed to the traditional symbolic cognitive science, coupled with transformational-generative grammar, which was committed to nativism due to the view that human cognition, including language capacity, should be construed in terms of symbolic representations and hardwired rules. Similarly, linguistic (...) competence in this framework was regarded as being innate, rule-governed, domain-specific, and fundamentally different from performance, i.e., idiosyncrasies and factors governing linguistic behavior. I analyze state-of-the-art connectionist, deep learning models of natural language processing, most notably large language models, to see what they can tell us about linguistic competence. Deep learning is a statistical technique for the classification of patterns through which artificial intelligence researchers train artificial neural networks containing multiple layers that crunch a gargantuan amount of textual and/or visual data. I argue that these models suggest that linguistic competence should be construed as stochastic, pattern-based, and stemming from domain-general mechanisms. Moreover, I distinguish syntactic from semantic competence, and I show for each the ramifications of the endorsement of a connectionist research program as opposed to the traditional symbolic cognitive science and transformational-generative grammar. I provide a unifying front, consisting of usage-based theories, a construction grammar approach, and an embodied approach to cognition to show that the more multimodal and diverse models are in terms of architectural features and training data, the stronger the case is for the connectionist linguistic competence. I also propose to discard the competence vs. performance distinction as theoretically inferior so that a novel and integrative account of linguistic competence originating in connectionism and empiricism that I propose and defend in the dissertation could be put forward in scientific and philosophical literature. (shrink)

In this paper, we examine some basic linguistic abilities in a small sample of adults with minimal receptive vocabulary, whose receptive mental verbal age ranges from 1;2 to 3;10. In particular, we examine whether the participants in our study understand noun phrases consisting of a noun modified by an adjective. We use stimuli that they can recognise by name. Except for one participant, we find that, while all of them understand the noun and adjective in isolation, none seems to understand (...) these noun phrases, which means that they seem to not do linguistic composition. In order to test whether the difficulty is linguistic or conceptual, we ran two other studies, one on concept composition, and the other on iconic symbolic composition (composition of pictograms). Results suggest that linguistic composition is particularly difficult in this population, and that vocabulary breadth may not predict compositional abilities. (shrink)

The success of deep learning in natural language processing raises intriguing questions about the nature of linguistic meaning and ways in which it can be processed by natural and artificial systems. One such question has to do with subword segmentation algorithms widely employed in language modeling, machine translation, and other tasks since 2016. These algorithms often cut words into semantically opaque pieces, such as ‘period’, ‘on’, ‘t’, and ‘ist’ in ‘period|on|t|ist’. The system then represents the resulting segments in a dense (...) vector space, which is expected to model grammatical relations among them. This representation may in turn be used to map ‘period|on|t|ist’ (English) to ‘par|od|ont|iste’ (French). Thus, instead of being modeled at the lexical level, translation is reformulated more generally as the task of learning the best bilingual mapping between the sequences of subword segments of two languages; and sometimes even between pure character sequences: ‘p|e|r|i|o|d|o|n|t|i|s|t’ → ‘p|a|r|o|d|o|n|t|i|s|t|e’. Such subword segmentations and alignments are at work in highly efficient end-to-end machine translation systems, despite their allegedly opaque nature. The computational value of such processes is unquestionable. But do they have any linguistic or philosophical plausibility? I attempt to cast light on this question by reviewing the relevant details of the subword segmentation algorithms and by relating them to important philosophical and linguistic debates, in the spirit of making artificial intelligence more transparent and explainable. (shrink)

Communicating interdisciplinary information is difficult, even when two fields are ostensibly discussing the same topic. In this work, I’ll discuss the capacity for analogical reasoning to provide a framework for developing novel judgments utilizing similarities in separate domains. I argue that analogies are best modeled after Paul Bartha’s By Parallel Reasoning, and that they can be used to create a Toulmin-style warrant that expresses a generalization. I argue that these comparisons provide insights into interdisciplinary research. In order to demonstrate this (...) concept, I will demonstrate that fruitful comparisons can be made between Buddhism and Artificial Intelligence research. (shrink)

Call it the Skynet hypothesis, Artificial General Intelligence, or the advent of the Singularity — for years, AI experts and non-experts alike have fretted (and, for a small group, celebrated) the idea that artificial intelligence may one day become smarter than humans. -/- According to the theory, advances in AI — specifically of the machine learning type that’s able to take on new information and rewrite its code accordingly — will eventually catch up with the wetware of the biological brain. (...) In this interpretation of events, every AI advance from Jeopardy-winning IBM machines to the massive AI language model GPT-3 is taking humanity one step closer to an existential threat. We’re literally building our soon-to-be-sentient successors. -/- Except that it will never happen. At least, according to the authors of the new book Why Machines Will Never Rule the World: Artificial Intelligence without Fear. (shrink)

Philosophers are often credited with particularly well-developed conceptual skills. The ‘expertise objection’ to experimental philosophy builds on this assumption to challenge inferences from findings about laypeople to conclusions about philosophers. We draw on psycholinguistics to develop and assess this objection. We examine whether philosophers are less or differently susceptible than laypersons to cognitive biases that affect how people understand verbal case descriptions and judge the cases described. We examine two possible sources of difference: Philosophers could be better at deploying concepts, (...) and this could make them less susceptible to comprehension biases (‘linguistic expertise objection’). Alternatively, exposure to different patterns of linguistic usage could render philosophers vulnerable to a fundamental comprehension bias, the linguistic salience bias, at different points (‘linguistic usage objection’). Together, these objections mount a novel ‘master argument’ against experimental philosophy. To develop and empirically assess this argument, we employ corpus analysis and distributional semantic analysis and elicit plausibility ratings from academic philosophers and psychology undergraduates. Our findings suggest philosophers are better at deploying concepts than laypeople but are susceptible to the linguistic salience bias to a similar extent and at similar points. We identify methodological consequences for experimental philosophy and for philosophical thought experiments. (shrink)

Recent research in psycholinguistics suggests that language processing frequently involves mental imagery. This paper focuses on visual imagery and discusses two issues regarding the processing of polysemous words (i.e. words with multiple related meanings or senses) – co-predication and sense-relatedness. It aims to show how mental imagery can illuminate these two issues.

In recent decades, plural logic has established itself as a well-respected member of the extensions of first-order classical logic. In the present paper, I draw attention to the fact that among the examples that are commonly given in order to motivate the need for this new logical system, there are some in which the elements of the plurality in question are internally singularized (e.g. ‘Whitehead and Russell wrote Principia Mathematica’), while in others they are not (e.g. ‘Some philosophers wrote Principia (...) Mathematica’). Then, building on previous work, I point to a subsystem of plural logic in which inferences concerning examples of the first type can be adequately dealt with. I notice that such a subsystem (here called ‘discrete plural logic’) is in reality a mere variant of first-order logic as standardly formulated, and highlight the fact that it is axiomatizable while full plural logic is not. Finally, I urge that greater attention be paid to discrete plural logic and that discrete plurals are not used in order to motivate the introduction of full-fledged plural logic—or, at least, not without remarking that they can also be adequately dealt with in a considerably simpler system. (shrink)

Two objections are raised against Oliver and Smiley’s analysis of the collective–distributive opposition in their 2016 book: They take it as a basic premise that the collective reading of ‘baked a cake’ corresponds to a predicate different from its distributive reading, and the same applies to all predicate expressions that admit both a collective and a distributive interpretation. At the same time, however, they argue that inflectional forms of the same lexeme reveal a univocity that should be preserved in a (...) formal representation of English. These two assumptions sit uneasily. In developing their analysis, Oliver and Smiley come to the conclusion that even a singular predication such as ‘Tom baked a cake’ must be regarded as ambiguous between a collective and a distributive reading. This is so artificial that it hardly makes sense, and yet there seems to be no way out of the difficulty unless we are prepared to give up the basic premise just mentioned. (shrink)

Whether it was John Searle’s Chinese Room argument (Searle, 1980) or Roger Penrose’s argument of the non-computable nature of a mathematician’s insight – an argument that was based on Gödel’s Incompleteness theorem (Penrose, 1989), we have always had skeptics that questioned the possibility of realizing strong Artificial Intelligence (AI), or what has become known by Artificial General Intelligence (AGI). But this new book by Landgrebe and Smith (henceforth, L&S) is perhaps the strongest argument ever made against strong AI. It is (...) a very extensive review of what building a mind essentially amounts to drawing on insights and results from biology, physics, linguistics, computability, philosophy, and mathematics. (shrink)

Prepositions as function words and single monomorphemic words are the most basic words of the human language, especially in the context of maintaining daily life. They are probably the first lexes/words entered to the human’s linguistic repertoire, as their requirements in the language are so essential. Prepositions shows various relationships between lexes or phrases in sentences. Among these relationships time, points, position, direction and various degrees of mental or emotional attitudes seem to be significant. The purpose of the research is (...) try to reveal what kind of challenges English prepositions have for the learners and also to confirm if they are as difficult as some linguists have stated before. Another purpose is to find out which features are more difficult among all their entity properties. The results of this study disclose that English prepositions possess very complex structures, different meanings and an associating duty of various types of part of speeches. In particular, those that construct the phrasal verbs require great effort for learning due to the loss of the meaning (sometimes partially, sometimes completely) they undergo. It has been understood that their properties such as steadily changing meaning and function make them quite difficult elements for learners of English. (shrink)

The use of language models in Web applications and other areas of computing and business have grown significantly over the last five years. One reason for this growth is the improvement in performance of language models on a number of benchmarks — but a side effect of these advances has been the adoption of a “bigger is always better” paradigm when it comes to the size of training, testing, and challenge datasets. Drawing on previous criticisms of this paradigm as applied (...) to large training datasets crawled from pre-existing text on the Web, we extend the critique to challenge datasets custom-created by crowdworkers. We present several sets of criticisms, where ethical and scientific issues in language model research reinforce each other: labour injustices in crowdwork, dataset quality and inscrutability, inequities in the research community, and centralized corporate control of the technology. We also present a new type of tool for researchers to use in examining large datasets when evaluating them for quality. (shrink)

It has been argued that ethical frameworks for data science often fail to foster ethical behavior, and they can be difficult to implement due to their vague and ambiguous nature. In order to overcome these limitations of current ethical frameworks, we propose to integrate the analysis of the connections between technical choices and sociocultural factors into the data science process, and show how these connections have consequences for what data subjects can do, accomplish, and be. Using healthcare as an example, (...) attention to sociocultural conversion factors relevant to health can help in navigating technical choices that require broader considerations of the sociotechnical system, such as metric tradeoffs in model validation, resulting in better ethical and technical choices. This approach promotes awareness of the ethical dimension of technical choices by data scientists and others, and that can foster the cultivation of 'ethical skills' as integral to data science. (shrink)

Artificial intelligence (AI) research enjoyed an initial period of enthusiasm in the 1970s and 80s. But this enthusiasm was tempered by a long interlude of frustration when genuinely useful AI applications failed to be forthcoming. Today, we are experiencing once again a period of enthusiasm, fired above all by the successes of the technology of deep neural networks or deep machine learning. In this paper we draw attention to what we take to be serious problems underlying current views of artificial (...) intelligence encouraged by these successes, especially in the domain of language processing. We then show an alternative approach to language-centric AI, in which we identify a role for philosophy. (shrink)

This excerpted chapter of the book THE IMAGE OF LANGUAGE discusses the philosophical implications of geometric visualizations of the alphabetic patterning encoded in the orthography of words (a project showing examples of the visualizations is included). Reference pages are also included.

The goal of creating Artificial General Intelligence (AGI) – or in other words of creating Turing machines (modern computers) that can behave in a way that mimics human intelligence – has occupied AI researchers ever since the idea of AI was first proposed. One common theme in these discussions is the thesis that the ability of a machine to conduct convincing dialogues with human beings can serve as at least a sufficient criterion of AGI. We argue that this very ability (...) should be accepted also as a necessary condition of AGI, and we provide a description of the nature of human dialogue in particular and of human language in general against this background. We then argue that it is for mathematical reasons impossible to program a machine in such a way that it could master human dialogue behaviour in its full generality. This is (1) because there are no traditional explicitly designed mathematical models that could be used as a starting point for creating such programs; and (2) because even the sorts of automated models generated by using machine learning, which have been used successfully in areas such as machine translation, cannot be extended to cope with human dialogue. If this is so, then we can conclude that a Turing machine also cannot possess AGI, because it fails to fulfil a necessary condition thereof. At the same time, however, we acknowledge the potential of Turing machines to master dialogue behaviour in highly restricted contexts, where what is called “narrow” AI can still be of considerable utility. (shrink)

La description en langue naturelle est l’artefact permettant de débuter un processus d’automatisation. La tâche principale de l’ingénieur du logiciel, c’est de combler le clivage entre langue naturelle et langue de la machine. Après avoir présenté quelques ontologies définies pour les processus d’automatisation, quelques pour et quelques contre l’emploi d’ontologies dans le génie logiciel sont présentées. Des indications pour dépasser cette simple opposition sont ensuite décrites. Des évaluations sur le réductionnisme dans les ontologies en ce qui concerne les possibles interactions (...) entre humains, machines et réalité muette terminent la présentation. (shrink)

Частным аспектом предлагаемой реформы интернета является метаномические правила референцирования и адресации виртуальных объектов с целью приближения их к естественным языкам, и создания их логической системы. Однако реформа интернета и преобразование его в средство общения и служения обществу требует также других мер. К этим мерам относится передача определённых имён в неотчуждаемое владение, чтобы их собственники безусловно и беспрепятственно могли осуществлять их право публикации, т.е. публичного высказывания и выражения их мыслей, что также важно для документографии. Другой мерой должно стать упразднение всей сложившейся (...) системы управления интернетом, т.е. бюрократии, после чего техническим службам будут делегированы обязанности по обеспечению его функционирования с учётом высказанной критики. (shrink)

Появление человека, говорящего о себе Ἐγώ εἰμι, люди воспринимают в той же логике абсурда, к которой они привыкли. То, что кто-то может не играть и не носить маску, а реально быть, жить настоящей, а не выдуманной жизнью, для них немыслимо, невозможно, невыносимо и недопустимо. Но такой человек был, есть, и будет, и именно он преображает всё остальное человечество своим Ἐγώ εἰμι.

Paul Pietroski has developed a powerful minimalist and internalist alternative to standard compositional semantics, where meanings are identified with instructions to fetch or assemble human concepts in specific ways. In particular, there appears to be no need for Fregean Function Application, as natural language composition only involves processes of combining monadic or dyadic concepts, and Pietroski’s theory can then, allegedly, avoid both singular reference and truth conditions. He also has a negative agenda, purporting to show, roughly, that the vocabulary of (...) standard truth conditional semantics is far too powerful to plausibly describe the linguistic competence of mere human minds. In this paper, I explain some of the basics of Pietroski’s compositional semantics and argue that his major objection to standard compositionality is inconclusive, because a similar argument can be mounted against his own minimalist theory. I argue that we need a clear distinction between the language of the theorist---theoretical notation---and the language whose nature we are trying to explain. The theoretical notation should in fact be as expressively powerful as possible. It does not follow that the notation cannot be used to explain mere human linguistic competence, even if human minds are limited in various ways. (shrink)

This article is devoted to describing results of conceptualization of the idea of mind at the stage of maturity. Delineated the acquisition by the energy system (mind) of stable morphological characteristics, which associated with such a pivotal formation as the discourse. A qualitative structural and ontological sign of the system transition to this stage is the transformation of the verbal morphology of the mind into a discursive one. The analysis of the poststructuralist understanding of discourse in the context of the (...) dispersion of meanings (Foucault) made it possible to formulate a notion of it as a meaning that is constituted by the relation between the discursive practice and the worldview, regarded as a meta-discourse or a global discursive formation. In consequence of this relationship, a discrete and simultaneous scattering of meanings arises, the procedural side of which is a concrete discourse, and its productive aspect is linked with the creation of a local discursive formation. Based on this view it is proposed a logical formula of discourse, which takes into account the entropy of the language and the entropy of the worldview, as a particular manifestation of the mind entropy. Using this formula and considering the reactive nature of discourse, it was developed a classification, which included such types of discourses as reactive, suggestive, synthetic and creative. In turn, the proposed types of discourses are correlated with the specific characteristics of certain activities, as a psychological category. Also, it was considered the translation of the structure of discourse dissipation from the cognitive plan into the affective sphere because of which it is formed a hierarchy of significances, which performs the sense-forming function. It was analyzed the inverse influence of the hierarchy of significances on the structure of meanings dispersion and for respective account it was introduced a conditional coefficient of the value deviation of the significance of the meanings. This parameter reflects the sense correction of the meaning that occurs in the process of the emergence of discourse from discursive practice. Thus, the discourse is presented as a complex dynamic formation of the mind arising at the maturity stage of the system as a result of the combined effect of entropic dispersion of meanings and the value deviation of their significances. (shrink)

We describe a prototype ontology-driven information system (ODIS) that exploits what we call Portion of Reality (POR) representations. The system takes both sensor data and natural language text as inputs and composes on this basis logically structured POR assertions. The goal of our prototype is to represent both natural language and sensor data within a single framework that is able to support both axiomatic reasoning and computation. In addition, the framework should be capable of discovering and representing new kinds of (...) situations and thematic roles, (e.g., roles such as agent, patient and instrument), based on new compositions of existing representations. We applied our prototype in an intelligence analysis use case to test the hypothesis that a framework of this sort can produce usefully structured information from combined natural language and sensor data inputs. We further tested our hypothesis by adding an enhanced US Air Force ontology framework to our ODIS in order to (1) process a collection of sensor data, intel reports, and mission plans; (2) build composite POR representations from these data; and (3) machine analyze the fused results to infer mission threats. (shrink)