Sensory feedback, which can be presented in different modalities - single and combined, aids task performance in human-robot interaction (HRI). However, combining feedback modalities does not always lead to optimal performance. Indeed, it is not known how feedback modalities affect operator performance under stress. Furthermore, there is limited information on how feedback affects neural processes differently for males and females and under stress. This is a critical gap in the literature, particularly in the domain of surgical robotics, where surgeons are (...) under challenging socio-technical environments that burden them physiologically. In the present study, we posited operator performance as the summation of task performance and neurophysiological cost of maintaining that performance. In a within-subject design, we used functional near-infrared spectroscopy (fNIRS) to assess cerebral activations of 12 participants who underwent a 3D manipulation task within a virtual environment with concurrent feedback (visual and visual + haptic) in the presence and absence of a cognitive stressor. Cognitive stress was induced with the serial-7 subtraction test. We found that while task performance was higher with visual than visual + haptic feedback, it degraded under stress. The two feedback modalities were found to be associated with varying neural activities and neural efficiencies, and these were stress- and gender-dependent. Our findings engender further investigation into effectiveness of feedback modalities on males and females under stressful conditions in HRI. (shrink)

Neuroadaptive technology (NAT) is a closed-loop neurotechnology designed to enhance human–computer interaction. NAT works by collecting neurophysiological data, which are analysed via autonomous algorithms to create actions and adaptations at the user interface. This paper concerns how interaction with NAT can mediate self-related processing (SRP), such as self-awareness, self-knowledge, and agency. We begin with a postphenomenological analysis of the NAT closed loop to highlight the built-in selectivities of machine hermeneutics, i.e., autonomous chains of algorithms that convert data into an assessment (...) of psychological states/intentions. We argue that these algorithms produce an assessment of lived experience that is quantitative, reductive, and highly simplistic. This reductive assessment of lived experience is presented to the user via feedback at the NAT interface and subsequently mediates SRP. It is argued that congruence between system feedback and SRP determines the precise character of the alterity relation between human user and system. If feedback confirms SRP, the technology is regarded as a quasi-self. If there is a disagreement between SRP and feedback from the system, NAT is perceived to be a quasi-other. We argue that the design of the user interface shapes the precise ways in which NAT can mediate SRP. (shrink)

Recent advances in neuroscience have paved the way to innovative applications that cognitively augment and enhance humans in a variety of contexts. This paper aims at providing a snapshot of the current state of the art and a motivated forecast of the most likely developments in the next two decades. Firstly, we survey the main neuroscience technologies for both observing and influencing brain activity, which are necessary ingredients for human cognitive augmentation. We also compare and contrast such technologies, as their (...) individual characteristics (e.g., spatio-temporal resolution, invasiveness, portability, energy requirements and cost) influence their current and future role in human cognitive augmentation. Secondly, we chart the state of the art on neurotechnologies for human cognitive augmentation, keeping an eye both on the applications that already exist and those that are emerging or are likely to emerge in the next two decades. Particularly, we consider applications in the areas of communication, cognitive enhancement, memory, attention monitoring/enhancement, situation awareness and complex problem solving, and we look at what fraction of the population might benefit from such technologies and at the demands they impose in terms of user training. Thirdly, we briefly review the ethical issues associated with current neuroscience technologies. These are important because they may differentially influence both present and future research on (and adoption of) neurotechnologies for human cognitive augmentation: an inferior technology with no significant ethical issues may thrive while a superior technology causing widespread ethical concerns may end up being outlawed. Finally, based on the lessons learned in our analysis, using past trends and considering other related forecasts, we attempt to forecast the most likely future developments of neuroscience technology for human cognitive augmentation and provide informed recommendations for promising future research and exploitation avenues. (shrink)