A common reaction to functional diversity is to group entities into clusters that are functionally similar. I argue here that people are diverse with respect to reasoning-related processes, and that these processes satisfy the basic requirements for evolving entities: they are heritable, mutable, and subject to selective pressures. I propose a metric to quantify functional difference and show how this can be used to place psychological processes into a structure akin to a phylogenetic or evolutionary tree. Three species concepts are (...) repurposed from biology and used to understand relationships in that tree. (shrink)

This paper introduces a special issue of Cognitive Science initiated on the 25th anniversary of the publication of Parallel Distributed Processing (PDP), a two-volume work that introduced the use of neural network models as vehicles for understanding cognition. The collection surveys the core commitments of the PDP framework, the key issues the framework has addressed, and the debates the framework has spawned, and presents viewpoints on the current status of these issues. The articles focus on both historical roots and contemporary (...) developments in learning, optimality theory, perception, memory, language, conceptual knowledge, cognitive control, and consciousness. Here we consider the approach more generally, reviewing the original motivations, the resulting framework, and the central tenets of the underlying theory. We then evaluate the impact of PDP both on the field at large and within specific subdomains of cognitive science and consider the current role of PDP models within the broader landscape of contemporary theoretical frameworks in cognitive science. Looking to the future, we consider the implications for cognitive science of the recent success of machine learning systems called “deep networks”—systems that build on key ideas presented in the PDP volumes. (shrink)

We suggest that the cerebellum generates sensory or estimates based on outgoing motor commands and sensory feedback. Thus, it is not a motor pattern generator (HOUK et al.) but a predictive system which is intimately involved in motor behavior. This theory may explain the sensitivity of the climbing fibers to both unexpected external events and motor errors (SIMPSON et al.), and we speculate that unusual biophysical properties of the inferior olive might allow the cerebellum to develop multiple asynchronous sensory estimates, (...) [HOUK et al.; SIMPSON et al.; THACH]. (shrink)

The views of Houk et al., Smith, and Thach on the role of cerebellum in movement control differ substantially, but all three are flawed by the false reasoning that because information passes from the cerebellum to movements the cerebellum must be a movement controller, or a part of one. The divergent and less than compelling ideas expressed by these leading cerebellar theorists epitomize the fruitlessness of this paradigm, and signal the need for a change. [HOUK et al.; SMITH; THACH].

Computational modeling has long been one of the traditional pillars of cognitive science. Unfortunately, the computer models of cognition being developed today have not kept up with the enormous changes that have taken place in computer technology and, especially, in human-computer interfaces. For all intents and purposes, modeling is still done today as it was 25, or even 35, years ago. Everyone still programs in his or her own favorite programming language, source code is rarely made available, accessibility of models (...) to non-programming researchers is essentially non-existent, and even for other modelers, the profusion of source code in a multitude of programming languages, written without programming guidelines, makes it almost impossible to access, check, explore, re-use, or continue to develop. It is high time to change this situation, especially since the tools are now readily available to do so. We propose that the modeling community adopt three simple guidelines that would ensure that computational models would be accessible to the broad range of researchers in cognitive science. We further emphasize the pivotal role that journal editors must play in making computational models accessible to readers of their journals. (shrink)

This chapter offers a brief characterization of creativity, followed by a review of some of the reasons people have been skeptical about the possibility of explaining creativity. It surveys some of the recent work on creativity that is naturalistic in the sense that it presumes creativity is natural, as opposed to magical, occult, or supernatural, and is therefore amenable to scientific inquiry. The chapter divides into two categories. The broader category is empirical philosophy, which draws on empirical research while addressing (...) questions that have traditionally been regarded as philosophical. The second category is experimental philosophy, a special branch of empirical philosophy in which experiments are designed by philosophers with the explicit purpose of addressing philosophical questions. This categorization is admittedly somewhat artificial, but it is a familiar one in the prevailing division of intellectual labor, and it will be a useful organizational tool for the chapter. (shrink)

Prosthetic devices that replace a lost limb have become increasingly performant in recent years. Recent advances in both software and hardware allow for the decoding of electroencephalogram signals to improve the control of active prostheses with brain-computer interfaces. Most BCI research is focused on the upper body. Although BCI research for the lower extremities has increased in recent years, there are still gaps in our knowledge of the neural patterns associated with lower limb movement. Therefore, the main objective of this (...) study is to show the feasibility of decoding lower limb movements from EEG data recordings. The second aim is to investigate whether well-known neuroplastic adaptations in individuals with an amputation have an influence on decoding performance. To address this, we collected data from multiple individuals with lower limb amputation and a matched able-bodied control group. Using these data, we trained and evaluated common BCI methods that have already been proven effective for upper limb BCI. With an average test decoding accuracy of 84% for both groups, our results show that it is possible to discriminate different lower extremity movements using EEG data with good accuracy. There are no significant differences in the decoding performance of these movements between healthy subjects and subjects with lower extremity amputation. These results show the feasibility of using BCI for lower limb prosthesis control and indicate that decoding performance is not influenced by neuroplasticity-induced differences between the two groups. (shrink)

Prosthetic devices that replace a lost limb have become increasingly performant in recent years. Recent advances in both software and hardware allow for the decoding of electroencephalogram signals to improve the control of active prostheses with brain-computer interfaces. Most BCI research is focused on the upper body. Although BCI research for the lower extremities has increased in recent years, there are still gaps in our knowledge of the neural patterns associated with lower limb movement. Therefore, the main objective of this (...) study is to show the feasibility of decoding lower limb movements from EEG data recordings. The second aim is to investigate whether well-known neuroplastic adaptations in individuals with an amputation have an influence on decoding performance. To address this, we collected data from multiple individuals with lower limb amputation and a matched able-bodied control group. Using these data, we trained and evaluated common BCI methods that have already been proven effective for upper limb BCI. With an average test decoding accuracy of 84% for both groups, our results show that it is possible to discriminate different lower extremity movements using EEG data with good accuracy. There are no significant differences in the decoding performance of these movements between healthy subjects and subjects with lower extremity amputation. These results show the feasibility of using BCI for lower limb prosthesis control and indicate that decoding performance is not influenced by neuroplasticity-induced differences between the two groups. (shrink)

The present commentary considers the question of what must be learned in different types of motor skills, thereby limiting the question of what should be adjusted in the APG model in order to explain successful learning. It is concluded that an open loop model like the APG might well be able to describe the learning pattern of motor skills in a stable, predictable environment. Recent research on saccadic plasticity, however, illustrates that motor skills performed in an unpredictable environment depend heavily (...) on sensory (mostly visual) feedback, [HOUK et al.]. (shrink)

Several themes can be identified in the commentaries. The first is that the climbing fibers may have more than one function; the second is that the climbing fibers provide sensory rather than motor signals. We accept the possibility that climbing fibers may have more than one function consequence(s)’ in the title. Until we know more about the function of the inhibitory input to the inferior olive from the cerebellar nuclei, which are motor structures, we have to keep open the possibility (...) that the climbing fiber signals can be a combination of sensory and motor signals. (shrink)

The involvement of nitric oxide in cerebellar long-term depression is supported by the observation that nitric oxide is released by climbing fiber stimulation and by pharmacological tool usage. Two forms of long-term depression should be distinguished by their physiological relevance. [CRÉPEL et al.; LINDEN; VINCENT].

This article deals with the links between the enaction paradigm and artificial intelligence. Enaction is considered a metaphor for artificial intelligence, as a number of the notions which it deals with are deemed incompatible with the phenomenal field of the virtual. After explaining this stance, we shall review previous works regarding this issue in terms of artificial life and robotics. We shall focus on the lack of recognition of co-evolution at the heart of these approaches. We propose to explicitly integrate (...) the evolution of the environment into our approach in order to refine the ontogenesis of the artificial system, and to compare it with the enaction paradigm. The growing complexity of the ontogenetic mechanisms to be activated can therefore be compensated by an interactive guidance system emanating from the environment. This proposition does not however, resolve that of the relevance of the meaning created by the machine (sense-making). Such reflections lead us to integrate human interaction into this environment in order to construct relevant meaning in terms of participative artificial intelligence. This raises a number of questions with regards to setting up an enactive interaction. The article concludes by exploring a number of issues, thereby enabling us to associate current approaches with the principles of morphogenesis, guidance, the phenomenology of interactions and the use of minimal enactive interfaces in setting up experiments which will deal with the problem of artificial intelligence in a variety of enaction-based ways. (shrink)

What is Computational Intelligence (CI) and what are its relations with Artificial Intelligence (AI)? A brief survey of the scope of CI journals and books with ``computational intelligence'' in their title shows that at present it is an umbrella for three core technologies (neural, fuzzy and evolutionary), their applications, and selected fashionable pattern recognition methods. At present CI has no comprehensive foundations and is more a bag of tricks than a solid branch of science. The change of focus from methods (...) to challenging problems is advocated, with CI defined as a part of computer and engineering sciences devoted to solution of non-algoritmizable problems. In this view AI is a part of CI focused on problems related to higher cognitive functions, while the rest of the CI community works on problems related to perception and control, or lower cognitive functions. Grand challenges on both sides of this spectrum are addressed. (shrink)

The purpose of this article is to show why consciousness and thought are not manifested in digital computers. Analyzing the rationale for claiming that the formal manipulation of physical symbols in Turing machines would emulate human thought, the article attempts to show why this proved false. This is because the reinterpretation of designation and meaning to accommodate physical symbol manipulation eliminated their crucial functions in human discourse. Words have denotations and intensional meanings because the brain transforms the physical stimuli received (...) from the microworld into a qualitative, macroscopic representation for consciousness. Lacking this capacity as programmed machines, computers have no representations for their symbols to designate and mean. Unlike human beings in which consciousness and thought, with their inherent content, have emerged because of their organic natures, serial processing computers or parallel distributed processing systems, as programmed electrical machines, lack these causal capacities. (shrink)

In this paper we address the problem of short-term electric energy prediction using a time series forecasting approach applied to data generated by a Paraguayan electricity distribution provider. The dataset used in this work contains data collected over a three-year period. This is the first time that these data have been used; therefore, a preprocessing phase of the data was also performed. In particular, we propose a comparative study of various machine learning and statistical strategies with the objective of predicting (...) the electric energy consumption for a given prediction horizon, in our case seven days, using historical data. In this paper we have tested the effectiveness of the techniques with different historical window sizes. Specifically, we considered two ensemble strategies, a neural network, a deep learning technique and linear regression. Moreover, in this study, we tested whether the inclusion of meteorological data can help achieve better predictions. In particular, we considered data regarding temperature, humidity, wind speed and atmospheric pressure registered during the three-year period of data collection. The results show that, in general, the deep learning approach obtains the best results and that such results are obtained when meteorological data are also considered. Moreover, when meteorological data is used, a smaller historical window size is required to obtain precise predictions. (shrink)

The first issue of Artificial Intelligence and Law journal was published in 1992. This paper offers some commentaries on papers drawn from the Journal’s third decade. They indicate a major shift within Artificial Intelligence, both generally and in AI and Law: away from symbolic techniques to those based on Machine Learning approaches, especially those based on Natural Language texts rather than feature sets. Eight papers are discussed: two concern the management and use of documents available on the World Wide Web, (...) and six apply machine learning techniques to a variety of legal applications. (shrink)

The safety of the transmission lines maintains the stable and efficient operation of the smart grid. Therefore, it is very important and highly desirable to diagnose the health status of transmission lines by developing an efficient prediction model in the grid sensor network. However, the traditional methods have limitations caused by the characteristics of high dimensions, multimodality, nonlinearity, and heterogeneity of the data collected by sensors. In this paper, a novel model called LPR-MLP is proposed to predict the health status (...) of the power grid sensor network. The LPR-MLP model consists of two parts: local binary pattern, principal component analysis, and ReliefF are used to process image data and meteorological and mechanical data and the multilayer perceptron method is then applied to build the prediction model. The results obtained from extensive experiments on the real-world data collected from the online system of China Southern Power Grid demonstrate that this new LPR-MLP model can achieve higher prediction accuracy and precision of 86.31% and 85.3%, compared with four traditional methods. (shrink)

Current fears of a “reproducibility crisis” have led researchers, sources of scientific funding, and the public to question both the efficacy and trustworthiness of science. Suggested policy changes have been focused on statistical problems, such as p-hacking, and issues of experimental design and execution. However, “reproducibility” is a broad concept that includes a number of issues. Furthermore, reproducibility failures occur even in fields such as mathematics or computer science that do not have statistical problems or issues with experimental design. Most (...) importantly, these proposed policy changes ignore a core feature of the process of scientific inquiry that occurs after reproducibility failures: the integration of conflicting observations and ideas into a coherent theory. (shrink)

Cognitive control has long been one of the most active areas of computational modeling work in cognitive science. The focus on computational models as a medium for specifying and developing theory predates the PDP books, and cognitive control was not one of the areas on which they focused. However, the framework they provided has injected work on cognitive control with new energy and new ideas. On the occasion of the books' anniversary, we review computational modeling in the study of cognitive (...) control, with a focus on the influence that the PDP approach has brought to bear in this area. Rather than providing a comprehensive review, we offer a framework for thinking about past and future modeling efforts in this domain. We define control in terms of the optimal parameterization of task processing. From this vantage point, the development of control systems in the brain can be seen as responding to the structure of naturalistic tasks, through the filter of the brain systems with which control directly interfaces. This perspective lays open a set of fascinating but difficult research questions, which together define an important frontier for future computational research. (shrink)

The cerebral cortex is a rich and diverse structure that is the basis of intelligent behavior. One of the deepest mysteries of the function of cortex is that neural processing times are only about one hundred times as fast as the fastest response times for complex behavior. At the very least, this would seem to indicate that the cortex does massive amounts of parallel computation.This paper explores the hypothesis that an important part of the cortex can be modeled as a (...) connectionist computer that is especially suited for parallel problem solving. The connectionist computer uses a special representation, termed value unit encoding, that represents small subsets of parameters in a way that allows parallel access to many different parameter values. This computer can be thought of as computing hierarchies of sensorimotor invariants. The neural substrate can be interpreted as a commitment to data structures and algorithms that compute invariants fast enough to explain the behavioral response times. A detailed consideration of this model has several implications for the underlying anatomy and physiology. (shrink)

The primary assumption made in this series of target articles is that the cerebellum is directly involved in motor control. However, in my opinion, there is ample and growing experimental evidence to question this classical view, whether or not learning is involved. I propose, instead, that the cerebellum is involved in the control of data acquisition for many different sensory systems, [CRÉPEL et al., HOUK et al., SMITH, THACH].

For reasons I have never understood, some students of the cerebellum have been unwilling to accept the now overwhelming evidence that the cerebellum exhibits lasting synaptic plasticity and plays an essential role in some forms of learning and memory. With a few exceptions (e.g., target article by SIMPSON et al.) this is no longer the case, as is clear in the excellent target articles on cerebellar LTD and the excellent target review by HOUK et al. [CRÉPEL et al.; HOUR et (...) al.; KANO; LINDEN; SIMPSON et al.; SMITH; VINCENT]. (shrink)

It is not widely realised that Turing was probably the first person to consider building computing machines out of simple, neuron-like elements connected together into networks in a largely random manner. Turing called his networks 'unorganised machines'. By the application of what he described as 'appropriate interference, mimicking education' an unorganised machine can be trained to perform any task that a Turing machine can carry out, provided the number of 'neurons' is sufficient. Turing proposed simulating both the behaviour of the (...) network and the training process by means of a computer program. We outline Turing's connectionist project of 1948. (shrink)

Many activities in Cognitive Science involve complex computer models and simulations of both theoretical and real entities. Artificial Intelligence and the study of artificial neural nets in particular, are seen as major contributors in the quest for understanding the human mind. Computational models serve as objects of experimentation, and results from these virtual experiments are tacitly included in the framework of empirical science. Simulations of cognitive functions, like learning to speak, or discovering syntactical structures in language, are the basis for (...) many claims about human capacities in language acquisition. This raises the question whether results obtained from experiments that are essentially performed on data structures are equivalent to results from "real" experiments. This paper examines some design methodologies for models of cognitive functions using artificial neural nets. The process of conducting the cognitive simulations is largely a projection of theories, or even unsubstantiated conjectures, onto simulated neural structures and an interpretation of the experimental results in terms of the human brain. The problem with this process is that results from virtual experiments are taken to refer unambiguously to the human brain; and the more the language of human cognitive function is deployed in both theory construction and (virtual) experimental interpretation, the more convincing the impression. Additionally, the complexity of the methodologies, principles, and visualization techniques, in the implementation of the computational model, masks the lack of actual similarities between model and real world phenomena. Some computational models involving artificial neural nets have had some success, even commercially, but there are indications that the results from virtual experiments have little value in explaining cognitive functions. The problem seems to be in relating computational, or mathematical, entities to real world objects, like neurons and brains. I argue that the role of Artificial Intelligence as a contributor to the knowledge base of Cognitive Science is diminished as a consequence. (shrink)

It is not widely realised that Turing was probably the first person to consider building computing machines out of simple, neuron-like elements connected together into networks in a largely random manner. Turing called his networks unorganised machines. By the application of what he described as appropriate interference, mimicking education an unorganised machine can be trained to perform any task that a Turing machine can carry out, provided the number of neurons is sufficient. Turing proposed simulating both the behaviour of the (...) network and the training process by means of a computer program. We outline Turing's connectionist project of 1948. (shrink)

The movement of Artificial Intelligence (AI) research from universities to big corporations has had a significant impact on the development of the field. In the past, AI research was primarily conducted in academic institutions, which foster a culture of peer reviewing and collaboration to enhance quality improvements. The growing interest in AI among corporations, especially regarding Machine Learning (ML) technology, has shifted the focus of research from quality to quantity. Corporations have the resources to invest in large-scale ML projects and (...) they are often more interested in fast results than in ensuring that AI algorithms are reliable and safe. This paper proposes that the description of a Darwinian process made by the mathematician and physicist Freeman Dyson can be used to understand the implications of ML research scenario. The context of the Darwinian process—or lack thereof—can be used to draw a parallel between historical and current implications of technology expansion strongly driven by economic interests, making clear the consequences of shifting AI research from academia to industry. Finally, this paper indicates future directions for AI research to create a healthier environment for the evolution of ML technology. (shrink)

Bioimage analysis plays a critical role in extracting information from biological images, enabling deeper insights into cellular structures and processes. The integration of machine learning and deep learning techniques has revolutionized the field, enabling the automated, reproducible, and accurate analysis of biological images. Here, we provide an overview of the history and principles of machine learning and deep learning in the context of bioimage analysis. We discuss the essential steps of the bioimage analysis workflow, emphasizing how machine learning and deep (...) learning have improved preprocessing, segmentation, feature extraction, object tracking, and classification. We provide examples that showcase the application of machine learning and deep learning in bioimage analysis. We examine user‐friendly software and tools that enable biologists to leverage these techniques without extensive computational expertise. This review is a resource for researchers seeking to incorporate machine learning and deep learning in their bioimage analysis workflows and enhance their research in this rapidly evolving field. (shrink)

-/- The aim of this paper is to grasp the relevant distinctions between various ways in which models and simulations in Artificial Intelligence (AI) relate to cognitive phenomena. In order to get a systematic picture, a taxonomy is developed that is based on the coordinates of formal versus material analogies and theory-guided versus pre-theoretic models in science. These distinctions have parallels in the computational versus mimetic aspects and in analytic versus exploratory types of computer simulation. The proposed taxonomy cuts across (...) the traditional dichotomies between symbolic and embodied AI, general intelligence and symbol and intelligence and cognitive simulation and human/non-human-like AI. -/- According to the taxonomy proposed here, one can distinguish between four distinct general approaches that figured prominently in early and classical AI, and that have partly developed into distinct research programs: first, phenomenal simulations (e.g., Turing’s “imitation game”); second, simulations that explore general-level formal isomorphisms in pursuit of a general theory of intelligence (e.g., logic-based AI); third, simulations as exploratory material models that serve to develop theoretical accounts of cognitive processes (e.g., Marr’s stages of visual processing and classical connectionism); and fourth, simulations as strictly formal models of a theory of computation that postulates cognitive processes to be isomorphic with computational processes (strong symbolic AI). -/- In continuation of pragmatic views of the modes of modeling and simulating world affairs, this taxonomy of approaches to modeling in AI helps to elucidate how available computational concepts and simulational resources contribute to the modes of representation and theory development in AI research—and what made that research program uniquely dependent on them. (shrink)

Complex organisms thwart the simple rectilinear causality paradigm of “necessary and sufficient,” with its experimental strategy of “knock down and overexpress.” This Essay organizes the eccentricities of biology into four categories that call for new mathematical approaches; recaps for the biologist the philosopher's recent refinements to the causation concept and the mathematician's computational tools that handle some but not all of the biological eccentricities; and describes overlooked insights that make causal properties of physical hierarchies such as emergence and downward causation (...) straightforward. Reviewing and extrapolating from similar situations in physics, it is suggested that new mathematical tools for causation analysis incorporating feedback, signal cancellation, nonlinear dependencies, physical hierarchies, and fixed constraints rather than instigative changes will reveal unconventional biological behaviors. These include “eigenisms,” organisms that are limited to quantized states; trajectories that steer a system such as an evolving species toward optimal states; and medical control via distributed “sheets” rather than single control points. (shrink)