We examine the role of category representations for decision-making in real-life tasks. To this end, we empirically examine how people categorize kitchen objects and make use of categories when storing objects in a kitchen. We then compare two computational models and their ability to represent the participants’ mental models. We discuss the advantages and disadvantages of the models and point the way to further research.

It is uncontroversial that something goes wrong with the blaming practices of hypocrites. However, it is more difficult to pinpoint exactly what is objectionable about their blaming practices. I contend that, just as epistemologists have recently done with blame, we can constructively treat hypocrisy as admitting of an epistemic species. This paper has two objectives: first, to identify the epistemic fault in epistemically hypocritical blame, and second, to explain why epistemically hypocritical blamers lose their standing to epistemically blame. I tackle (...) the first problem by appealing to an epistemic norm of consistency. I address the second by arguing that the epistemically hypocritical blamer commits to an opting-out of the set of shared epistemic standards that importantly underlies our standing to epistemically blame. I argue further that being epistemically hypocritical undermines a blamer’s standing even to judge epistemically blameworthy. (shrink)

In the course of daily life we solve problems often enough that there is a special term to characterize the activity and the right to expect a scientific theory to explain its dynamics. The classical view in psychology is that to solve a problem a subject must frame it by creating an internal representation of the problem’s structure, usually called a problem space. This space is an internally generable representation that is mathematically identical to a graph structure with nodes and (...) links. The nodes can be annotated with useful information, and the whole representation can be distributed over internal and external structures such as symbolic notations on paper or diagrams. If the representation is distributed across internal and external structures the subject must be able to keep track of activity in the distributed structure. Problem solving proceeds as the subject works from an initial state in mentally supported space, actively constructing possible solution paths, evaluating them and heuristically choosing the best. Control of this exploratory process is not well understood, as it is not always systematic, but various heuristic search algorithms have been proposed and some experimental support has been provided for them. (shrink)

Computation is a process of making explicit, information that was implicit. In computing 5 as the solution to ∛125, for example, we move from a description that is not explicitly about 5 to one that is. We are drawing out numerical consequences to the description ∛125. We are extracting information implicit in the problem statement. Can we precisely state the difference between information thati s implicit in a state, structure or process and information that is explicit?

The aim of this paper is to propose a systematic classification of emotions which can also characterize their nature. The first challenge we address is the submission of clear criteria for a theory of emotions that determine which mental phenomena are emotions and which are not. We suggest that emotions as a subclass of mental states are determined by their functional roles. The second and main challenge is the presentation of a classification and theory of emotions that can account for (...) all existing varieties. We argue that we must classify emotions according to four developmental stages: 1. pre-emotions as unfocussed expressive emotion states, 2. basic emotions, 3. primary cognitive emotions, and 4. secondary cognitive emotions. We suggest four types of basic emotions (fear, anger, joy and sadness) which are systematically differentiated into a diversity of more complex emotions during emotional development. The classification distinguishes between basic and non-basic emotions and our multi-factorial account considers cognitive, experiential, physiological and behavioral parameters as relevant for constituting an emotion. However, each emotion type is constituted by a typical pattern according to which some features may be more significant than others. Emotions differ strongly where these patterns of features are concerned, while their essential functional roles are the same. We argue that emotions form a unified ontological category that is coherent and can be well defined by their characteristic functional roles. Our account of emotions is supported by data from developmental psychology, neurobiology, evolutionary biology and sociology. (shrink)

When people make sense of situations, illustrations, instructions and problems they do more than just think with their heads. They gesture, talk, point, annotate, make notes and so on. What extra do they get from interacting with their environment in this way? To study this fundamental problem, I looked at how people project structure onto geometric drawings, visual proofs, and games like tic tac toe. Two experiments were run to learn more about projection. Projection is a special capacity, similar to (...) perception, but less tied to what is in the environment. Projection, unlike pure imagery, requires external structure to anchor it, but it adds ‘mental’ structure to the external scene much like an augmented reality system adds structure to an outside scene. A person projects when they look at a chessboard and can see where a knight may be moved. Because of the cognitive costs of sustaining and extending projection, humans make some of their projections real. They create structure externally. They move the piece, they talk, point, notate, represent. Much of our interactivity during sense making and problem solving involves a cycle of projecting then creating structure. (shrink)

We present data and argument to show that in Tetris - a real-time interactive video game - certain cognitive and perceptual problems are more quickly, easily, and reliably solved by performing actions in the world rather than by performing computational actions in the head alone. We have found that some translations and rotations are best understood as using the world to improve cognition. These actions are not used to implement a plan, or to implement a reaction; they are used to (...) change the world in order to simplify the problem-solving task. Thus, we distinguish pragmatic actions ñ actions performed to bring one physically closer to a goal - from epistemic actions - actions performed to uncover information that is hidden or hard to compute mentally. To illustrate the need for epistemic actions, we first develop a standard information-processing model of Tetris-cognition, and show that it cannot explain performance data from human players of the game - even when we relax the assumption of fully sequential processing. Standard models disregard many actions taken by players because they appear unmotivated or superfluous. However, we describe many such actions that are actually taken by players that are far from superfluous, and that play valuable roles in improving human performance. We argue that traditional accounts are limited because they regard action as having a single function: to change the world. By recognizing a second function of action - an epistemic function - we can explain many of the actions that a traditional model cannot. Although, our argument is supported by numerous examples specifically from Tetris, we outline how the one category of epistemic action can be incorporated into theories of action more generally. (shrink)

A complementary strategy can be defined as any organizing activity which recruits external elements to reduce cognitive loads. Typical organizing activities include pointing, arranging the position and orientation of nearby objects, writing things down, manipulating counters, rulers or other artifacts that can encode the state of a process or simplify perception. To illustrate the idea of a complementary strategy, a simple experiment was performed in which subjects were asked to determine the dollar value of collections of coins. In the no-hands (...) condition, subjects were not allowed to touch the coin images or to move their hands in any way. In the hands condition, they were allowed to use their hands and fingers however they liked. Significant improvements in time and number of errors were observed when S's used their hands over when they did not. To explain these facts, a brief account of some commonly observed complementary strategies is presented, and an account of their potential benefits to perception, memory and attention. (shrink)

We are quickly passing through the historical moment when people work in front of a single computer, dominated by a small CRT and focused on tasks involving only local information. Networked computers are becoming ubiquitous and are playing increasingly significant roles in our lives and in the basic infrastructure of science, business, and social interaction. For human-computer interaction o advance in the new millennium we need to better understand the emerging dynamic of interaction in which the focus task is no (...) longer confined to the desktop but reaches into a complex networked world of information and computer-mediated interactions. We think the theory of distributed cognition has a special role to play in understanding interactions between people and technologies, for its focus has always been on whole environments: what we really do in them and how we coordinate our activity in them. Distributed cognition provides a radical reorientation of how to think about designing and supporting human-computer interaction. As a theory it is specifically tailored to understanding interactions among people and technologies. In this article we propose distributed cognition as a new foundation for human-computer interaction, sketch an integrated research framework, and use selections from our earlier work to suggest how this framework can provide new opportunities in the design of digital work materials. (shrink)

This paper offers a defense of ‘publishing without belief’ (PWB) – the view that authors are not required to believe what they publish. I address objections to the view ranging from outright denial and advocacy of a belief norm for publication, to a modified version that allows for some cases of PWB but not others. I reject these modifications. In doing so, I offer both an alternative story about the motivations for PWB and a diagnosis of the disagreement over its (...) permissibility. The original defense focused on consequentialist reasons for allowing PWB, offering mostly defensive arguments against potential criticisms. But I argue that once we shift our focus to the reasons why authors might be prone to PWB, we see a difference in two types of motivation: whereas I imagine PWB as arising from underconfident agents, critics point to cagey or nefarious authorial practices, or authors’ failure to clarify their own degrees of belief. Underlying the debate over norms of philosophical publishing, we find two different conceptions of philosophy itself. (shrink)

The objective of this essay is to provide the beginning of a principled classification of some of the ways space is intelligently used. Studies of planning have typically focused on the temporal ordering of action, leaving as unaddressed questions of where to lay down instruments, ingredients, work-in-progress, and the like. But, in having a body, we are spatially located creatures: we must always be facing some direction, have only certain objects in view, be within reach of certain others. How we (...) manage the spatial arrangement of items around us is not an afterthought: it is an integral part of the way we think, plan, and behave. The proposed classification has three main categories: spatial arrangements that simplify choice; spatial arrangements that simplify perception; and spatial dynamics that simplify internal computation. The data for such a classification is drawn from videos of cooking, assembly and packing, everyday observations in supermarkets, workshops and playrooms, and experimental studies of subjects playing Tetris, the computer game. This study, therefore, focuses on interactive processes in the medium and short term: on how agents set up their workplace for particular tasks, and how they continuously manage that workplace. (shrink)

An experiment was performed to test the hypothesis that people sometimes take physical actions to make themselves more effective problem solvers. The task was to generate all possible words that could be formed from seven Scrabble letters. In one condition, participants could use their hands to manipulate the letters, and in another condition, they could not. Results show that more words were generated with physical manipulation than without. However, an interaction was obtained between the physical manipulation conditions and the specific (...) letter sets chosen, indicating that physical manipulation helps more for generating words in some circumstances than in others. Overall, our findings can be explained in terms of an interactive search process in which external, physical activity effectively complements internal, cognitive activity. Within this framework, the interaction can be explained in terms of the relative difficulty of generating words from the letters given in the different sets. (shrink)

We present data and argument to show that in Tetris—a real-time interactive video game—certain cognitive and perceptual problems are more quickly, easily, and reliably solved by performing actions in the world rather than by performing computational actions in the head alone. We have found that some translations and rotations are best understood as being used to implement a plan, or to implement a reaction. To substantiate our position we have implemented a computational laboratory that lets us record keystrokes and game (...) situations, as well as allows us to dynamically create situations. Using the data of over 30 subjects playing 6 games, tachistoscopic tests of some of these subjects, and results from our own successful efforts at building expert systems to play Tetris, we show why knowing how to use one’s environment to enhance speed and robustness are important components in skilled play. (shrink)

Contemporary choreography offers a window onto creative processes that rely on harnessing the power of sensory sys- tems. Dancers use their body as a thing to think with and their sensory systems as engines to simulate ideas non- propositionally. We report here on an initial analysis of data collected in a lengthy ethnographic study of the making of a dance by a major choreographer and show how translating between different sensory modalities can help dancers and choreographer to be more creative.

Why do people create extra representations to help them make sense of situations, diagrams, illustrations, instructions and problems? The obvious explanation— external representations save internal memory and com- putation—is only part of the story. I discuss seven ways external representations enhance cognitive power: they change the cost structure of the inferential landscape; they provide a structure that can serve as a shareable object of thought; they create persistent referents; they facilitate re- representation; they are often a more natural representation of (...) structure than mental representations; they facilitate the computation of more explicit encoding of information; they enable the construction of arbitrarily complex structure; and they lower the cost of controlling thought—they help coordinate thought. Jointly, these functions allow people to think more powerfully with external representations than without. They allow us to think the previously unthinkable. (shrink)

The degree to which information is encoded explicitly in a representation is related to the computational cost of recovering or using the information. Knowledge that is implicit in a system need not be represented at all, even implicitly, if the cost of recurring it is prohibitive.

Metacognition is associated with planning, monitoring, evaluating and repairing performance Designers of elearning systems can improve the quality of their environments by explicitly structuring the visual and interactive display of learning contexts to facilitate metacognition. Typically page layout, navigational appearance, visual and interactivity design are not viewed as major factors in metacognition. This is because metacognition tends to be interpreted as a process in the head, rather than an interactive one. It is argued here, that cognition and metacognition are part (...) of a continuum and that both are highly interactive. The tenets of this view are explained by reviewing some of the core assumptions of the situated and distribute approach to cognition and then further elaborated by exploring the notions of active vision, visual complexity, affordance landscape and cue structure. The way visual cues are structured and the way interaction is designed can make an important difference in the ease and effectiveness of cognition and metacognition. Documents that make effective use of markers such as headings, callouts, italics can improve students’ ability to comprehend documents and ‘plan’ the way they review and process content. Interaction can be designed to improve ‘the proximal zone of planning’ – the look ahead and apprehension of what is nearby in activity space that facilitates decisions. This final concept is elaborated in a discussion of how e-newspapers combine effective visual and interactive design to enhance user control over their reading experience. (shrink)

Emotion recognition systems (ERS) offer the ability to identify the emotions of others, based on an analysis of their facial expressions and regardless of culture, ethnicity, context, gender or social class. By claiming universalism in the expression as well as in the recognition of emotions, we believe that ERS present significant risks of causing great harm to some individuals, in addition to targeting, in some contexts, specific social groups. Drawing on a wide range of multidisciplinary knowledge - including philosophy, psychology, (...) computer science and anthropology - this research project aims to identify the current limitations of ERS and the main risks that their use brings, with the goal of providing a clear and robust analysis of the use of ERS and their contribution to greater social justice. Pointing to technical limitations, we refute, on the one hand, the idea that ERS are able to prove the causal link between specific emotions and specific facial expressions. We support our argument with evidence of the inability of ERS to distinguish facial expressions of emotions from facial expressions as communication signals. On the other hand, due to the contextual and cultural limitations of current ERS, we refute the idea that ERS are able to recognise, with equal performance, the emotions of individuals, regardless of their culture, ethnicity, gender and social class. Our ethical analysis shows that the risks are considerably more numerous and important than the benefits that could be derived from using ERS. However, we have separated out a specific type of ERS, whose use is limited to the field of care, and which shows a remarkable potential to actively participate in social justice, not only by complying with the minimum requirements, but also by meeting the criterion of beneficence. While ERS currently pose significant risks, it is possible to consider the potential for specific types to participate in social justice and provide emotional and psychological support and assistance to certain members of society. (shrink)

The question of how to conceive and represent the context of work is explored from the theoretical perspective of distributed cognition. It is argued that to understand the office work context we need to go beyond tracking superficial physical attributes such as who or what is where and when and consider the state of digital resources, people’s concepts, task state, social relations, and the local work culture, to name a few. In analyzing an office more deeply, three concepts are especially (...) helpful: entry points, action landscapes, and coordinating mechanisms. An entry point is a structure or cue that represents an invitation to enter an information space or office task. An activity landscape is part mental construct and part physical; it is the space users interactively construct out of the resources they find when trying to accomplish a task. A coordinating mechanism is an artifact, such as a schedule or clock, or an environmental structure such as the layout of papers to be signed, which helps a user manage the complexity of his task. Using these three concepts we can abstract away from many of the surface attributes of work context and define the deep structure of a setting—the invariant structure that many office settings share. A long-term challenge for context-aware computing is to operationalize these analytic concepts. (shrink)

A standard view in philosophy is that knowledge entails justification. Yet recent research suggests otherwise. We argue that this admirable and striking research suffers from an important limitation: participants were asked about knowledge but not justification. Thus it is possible that people attributed knowledge partly because they thought the belief was justified. Perhaps though, if given the opportunity, people would deny justification while still attributing knowledge. It is also possible that earlier findings were due to perspective taking. This paper reports (...) further research that directly addresses these questions. Our findings support the hypothesis that knowledge entails justification on the ordinary view. (shrink)

The theory of embodied cognition can provide HCI practitioners and theorists with new ideas about interac-tion and new principles for better designs. I support this claim with four ideas about cognition: (1) interacting with tools changes the way we think and perceive – tools, when manipulated, are soon absorbed into the body schema, and this absorption leads to fundamental changes in the way we perceive and conceive of our environments; (2) we think with our bodies not just with our brains; (...) (3) we know more by doing than by seeing – there are times when physically performing an activity is better than watching someone else perform the activity, even though our motor resonance system fires strongly during other person observa-tion; (4) there are times when we literally think with things. These four ideas have major implications for interaction design, especially the design of tangible, physical, context aware, and telepresence systems. (shrink)

We propose and investigate an Analogy Principle in the context of Unary Inductive Logic based on a notion of support by structural similarity which is often employed to motivate scientific conjectures.

To discover how to couple reflection with reaction we have been studying how people play the computer game Tetris. Our basic intuition is that the job of the reasoned is to monitor the environment and the agent’s behavior over time to discover trends or deviations from the agent’s normative policy and tune the priorities of the Attentional system accordingly.

How does consciousness vary across the animal kingdom? Are some animals ‘more conscious’ than others? This article presents a multidimensional framework for understanding interspecies variation in states of consciousness. The framework distinguishes five key dimensions of variation: perceptual richness, evaluative richness, integration at a time, integration across time, and self-consciousness. For each dimension, existing experiments that bear on it are reviewed and future experiments are suggested. By assessing a given species against each dimension, we can construct a consciousness profile for (...) that species. On this framework, there is no single scale along which species can be ranked as more or less conscious. Rather, each species has its own distinctive consciousness profile. (shrink)

To explore the question of physical thinking – using the body as an instrument of cognition – we collected extensive video and interview data on the creative process of a noted choreographer and his company as they made a new dance. A striking case of physical thinking is found in the phenomenon of marking. Marking refers to dancing a phrase in a less than complete manner. Dancers mark to save energy. But they also mark to explore the tempo of a (...) phrase, or its movement sequence, or the intention behind it. Because of its representational nature, marking can serve as a vehicle for thought. Importantly, this vehicle is less complex than the version of the same phrase danced ‘full-out’. After providing evidence for distinguishing different types of marking, three ways of understanding marking as a form of thought are considered: marking as a gestural language for encoding aspects of a target movement, marking as a method of priming neural systems involved in the target movement, and marking as a method for improving the precision of mentally projecting aspects of the target. (shrink)

This paper examines some of the methods animals and humans have of adapting their environment. Because there are limits on how many different tasks a creature can be designed to do well in, creatures with the capacity to redesign their environments have an adaptive advantage over those who can only passively adapt to existing environmental structures. To clarify environmental redesign I rely on the formal notion of a task environment as a directed graph where the nodes are states and the (...) links are actions. One natural form of redesign is to change the topology of this graph structure so as to increase the likelihood of task success or to reduce its expected cost, measured in physical terms. This may be done by eliminating initial states hence eliminating choice points; by changing the action repertoire; by changing the consequence function; and lastly, by adding choice points. Another major method for adapting the environment is to change its cognitive congeniality. Such changes leave the state space formally intact but reduce the number and cost of mental operations needed for task success; they reliably increase the speed, accuracy or robustness of performance. The last section of the paper describes several of these epistemic or complementary actions found in human performance. (shrink)

It is sometimes argued that if PDP networks can be trained to make correct judgements of grammaticality we have an existence proof that there is enough information in the stimulus to permit learning grammar by inductive means alone. This seems inconsistent superficially with Gold's theorem and at a deeper level with the fact that networks are designed on the basis of assumptions about the domain of the function to be learned. To clarify the issue I consider what we should learn (...) from Gold's theorem, then go on to inquire into what it means to say that knowledge is domain specific. I first try sharpening the intuitive notion of domain specific knowledge by reviewing the alleged difference between processing limitations due to shortage of resources vs shortages of knowledge. After rejecting different formulations of this idea, I suggest that a model is language specific if it transparently refer to entities and facts about language as opposed to entities and facts of more general mathematical domains. This is a useful but not necessary condition. I then suggest that a theory is domain specific if it belongs to a model family which is attuned in a law-like way to domain regularities. This leads to a comparison of PDP and parameter setting models of language learning. I conclude with a novel version of the poverty of stimulus argument. (shrink)

Emotion recognition systems (ERS) offer the ability to identify the emotions of others, based on an analysis of their facial expressions and regardless of culture, ethnicity, context, gender or social class. By claiming universalism in the expression as well as in the recognition of emotions, we believe that ERS present significant risks of causing great harm to some individuals, in addition to targeting, in some contexts, specific social groups. Drawing on a wide range of multidisciplinary knowledge - including philosophy, psychology, (...) computer science and anthropology - this research project aims to identify the current limitations of ERS and the main risks that their use brings, with the goal of providing a clear and robust analysis of the use of ERS and their contribution to greater social justice. Pointing to technical limitations, we refute, on the one hand, the idea that ERS are able to prove the causal link between specific emotions and specific facial expressions. We support our argument with evidence of the inability of ERS to distinguish facial expressions of emotions from facial expressions as communication signals. On the other hand, due to the contextual and cultural limitations of current ERS, we refute the idea that ERS are able to recognise, with equal performance, the emotions of individuals, regardless of their culture, ethnicity, gender and social class. Our ethical analysis shows that the risks are considerably more numerous and important than the benefits that could be derived from using ERS. However, we have separated out a specific type of ERS, whose use is limited to the field of care, and which shows a remarkable potential to actively participate in social justice, not only by complying with the minimum requirements, but also by meeting the criterion of beneficence. While ERS currently pose significant risks, it is possible to consider the potential for specific types to participate in social justice and provide emotional and psychological support and assistance to certain members of society. (shrink)

One striking observation in the history of rational choice models is that those models have not only been used in economics but spread widely across the social and behavioral sciences. How do such model transfers proceed? By closely studying the early efforts to transfer such models by William Riker – a major protagonist in pushing the adoption of game theoretic models in political science – this article examines the transfer process as one of ‘translation’ by which abstract and mathematical rational (...) choice models were constructed and modified such that they applied to a specific target system in a new domain. In this paper, we argue that to overcome a set of challenges that hampered the straightforward transfer of game theoretic models into political science, Riker complemented theoretical and conceptual modifications of von Neumann and Morgenstern’s game schemes with the use of narratives to turn them into applicable and testable models. As such, those narratives played a crucial role in enabling their transfer and ultimately facilitated the applicability of game theoretic models in political science. (shrink)

In this essay I shall consider a certain methodological claim gaining currency in connectionist quarters: The claim that variables are costly to implement in PDP systems and hence are not likely to be as important in cognitive processing as orthodox theories of cognition assume.

Architecture is about to enter its first magical phase: a time when buildings actively co-operate with their inhabitants; when objects know what they are, where they are, what is near them; when social and physical space lose their type coupling; when wall and partitions change with mood and task. As engineers and scientists explore how to digitse the world around us, the classical constraints of design, ruled so long by the physics of space, time, and materials, are starting to crumble. (...) Documents can be laid down in one place, automatically cloned, and a copy picked up in another. Meetings scheduled for 9am to 10am can be joined by latecomers at noon, who then participate in a captured form of the event and are ‘edited into’ the past. People on the West coast of the USA can participate, in a telepresent way, with their colleagues on the East coast, and hold a meeting against a virtual backdrop, such as a production line in their Taiwanese factory. Walls seem to dematerialise, remote objects can be touched virtually, shaped, passed through one another. Technology is moving inexorably so that being in one place at a time no longer need dominate how we work and play. Material boundaries are losing their meaning, and interface and information space are catch words that architects must master. -/- In this article I will discuss some of the theoretical ideas shaping our new conception of form, function, and interactivity. My view is that of a cognitive scientist interested in how cognition is distributed throughout our environment. Since the ground rules defining the structure of environments are changing, our very idea of how we are embedded in the world is changing. Architecture is at a new frontier. (shrink)

Multimedia technology offers instructional designers an unprecedented opportunity to create richly interactive learning environments. With greater design freedom comes complexity. The standard answer to the problems of too much choice, disorientation, and complex navigation is thought to lie in the way we design interactivity in a system. Unfortunately, the theory of interactivity is at an early state of development. After critiquing the decision cycle model of interaction—the received theory in human computer interaction—I present arguments and observational data to show that (...) humans have several ways of interacting with their environments, which resist accommodation in the decision cycle model. These additional ways of interacting include: preparing the environment, maintaining the environment, and reshaping the cognitive congeniality of the environment. Understanding how these actions simplify the computational complexity of our mental processes is the first step in designing the right sort of resources and scaffolding necessary for tractable learner controlled learning environments. (shrink)

There is growing interest in the use of technology to enhance the tracking and quality of clinical information available for patients in disaster settings. This paper describes the design and evaluation of the Wireless Internet Information System for Medical Response in Disasters (WIISARD).

In the scientific study of mind a distinction is drawn between explicit knowledge— knowledge that can be elicited from a subject by suitable inquiry or prompting, can be brought to consciousness, and externally expressed in words—and implicit knowledge—knowledge that cannot be elicited, cannot be made directly conscious, and can- not be articulated. Michael Polanyi (1967) argued that we usually ‘know more than we can say’. The part we can articulate is explicitly known; the part we cannot is implicit.

Virtual environment landmarks are essential in wayfinding: they anchor routes through a region and provide memorable destinations to return to later. Current virtual environment browsers provide user interface menus that characterize available travel destinations via landmark textual descriptions or thumbnail images. Such characterizations lack the depth cues and context needed to reliably recognize 3D landmarks. This paper introduces a new user interface affordance that captures a 3D representation of a virtual environment landmark into a 3D thumbnail, called a worldlet. Each (...) worldlet is a miniature virtual world fragment that may be interactively viewed in 3D, enabling a traveler to gain first-person experience with a travel destination. In a pilot student conducted to compare textual, image, and worldlet landmark representations within a wayfinding task, worldlet use significantly reduced the overall travel time and distance traversed, virtually eliminating unnecessary backtracking. (shrink)

As algorithms have become ubiquitous in consequential domains, societal concerns about the potential for discriminatory outcomes have prompted urgent calls to address algorithmic bias. In response, a rich literature across computer science, law, and ethics is rapidly proliferating to advance approaches to designing fair algorithms. Yet computer scientists, legal scholars, and ethicists are often not speaking the same language when using the term ‘bias.’ Debates concerning whether society can or should tackle the problem of algorithmic bias are hampered by conflations (...) of various understandings of bias, ranging from neutral deviations from a standard to morally problematic instances of injustice due to prejudice, discrimination, and disparate treatment. This terminological confusion impedes efforts to address clear cases of discrimination. -/- In this paper, we examine the promises and challenges of different approaches to disambiguating bias and designing for justice. While both approaches aid in understanding and addressing clear algorithmic harms, we argue that they also risk being leveraged in ways that ultimately deflect accountability from those building and deploying these systems. Applying this analysis to recent examples of generative AI, our argument highlights unseen dangers in current methods of evaluating algorithmic bias and points to ways to redirect approaches to addressing bias in generative AI at its early stages in ways that can more robustly meet the demands of justice. (shrink)

Video data from three large captures of choreographic dance making was analyzed to determine if there is a difference between participant knowledge – the knowledge an agent acquires by being the cause of an action – and observer knowledge – the knowledge an observer acquires through close attention to someone else’s performance. The idea that there might be no difference has been challenged by recent findings about the action observation network and tacitly challenged by certain tenets in enactive perception. We (...) explored why a choreographer ‘riff’s’ when appropriating and evaluating the movements of his dancers. By recruiting his body to help him cognize he is able to understand the possibilities of movement better than observation. He acquires participant knowledge. (shrink)

The influence of imagery on perception depends on the content of the mental image. Sixty-three students responded to the location of the 2 hands of a clock while visualizing the correct or an incorrect clock. Reaction time was shorter with valid cueing. Could this have resulted from visual acquisition strategies such as planning visual saccades or shifting covert attention? No. in this study, a crucial control condition made participants look at rather than visualize the cue. Acquisition strategies should have affected (...) equally both types of cueing, but we observed that the effect of the visual cue was smaller and limited to a particular subcase in which one expects visual acquisition strategies. Thus, what matters is the similarity of the content of the mental image with the visual scene. In addition, an interaction involving the hand used for responding supports the notion that composite imagery is lateralized. (shrink)

Cognitive organisms have three rather different techniques for intelligently regulating their intake of environmental information. In order of the time needed to uncover information they are: 1. control of attention: within an image produced by a given sensor certain elements can be selected for additional processing; 2. control of gaze: the orientation and resolution (center of foveation) of the sensor can be regulated to create a new image; 3. control of activity: certain non-perceptual actions can be performed to increase the (...) probability of unearthing salient information that currently is unavailable, hard to detect, or hard to compute. (shrink)

Using the perspective of situated cognition we studied how people interact with a physical map to help them navigate through an unfamiliar environment. The study used a mixture of cognitive ethnography and traditional experimental methods. We found that the difference between high and low performing navigators showed up in the speed they completed their task and also in the way they use maps. High performers plan routes using a survey method whereas low performers use a route strategy. We suggest that (...) when people are given a task that does not match their cognitive style they try to transform the task to better suit their cognitive abilities and cognitive style. (shrink)

Mechanisms for QoS provisioning in communication networks range from flow-based resource reservation schemes, providing QoS guarantees, through QoS differentiation based on reservation aggregation techniques to adaptation of applications, compensating for incomplete reservations. Scalable, aggregation-based reservations can also be combined with adaptations for a more flexible and robust overall QoS provisioning. Adaptation is particularly important in wireless networks, where reservations schemes are more difficult to realize. It is widely accepted that usability of Cellular or Mobile IP can be largely improved if (...) adaptation is incorporated. Adaptation, in turn, depends on coding techniques involved and on user requirements. Those impose certain preferences and ordering relations on QoS hierarchies or degradation paths to be followed along when adaptation is performed. With the advent of MPEG4 coding techniques, more sophisticated adaptation schemes are more likely to be supported in the future. (shrink)

I argue that it is not possible to accurately represent our task settings as close environments with a single well defined cost structure. Natural environments are places where many things are done, often at the same time, and often by many people. To appreciate the way such invariants of everyday life affect design I present a case study, a micro-analysis of espresso making at Starbucks to show the challenges facing a cost structure approach.

The goal of three-dimensional visualization is to present information in such a way that the viewer suspends disbelief and uses the screen imagery the same way as he or she would use an identical, real 3D scene. To do this effectively, programmers employ a variety of 3D depth cues. Our own anecdotal experience says that shadows and stereopsis are two of the best for visualization. The nice thing is that both of these are possible to do in interactive programs. They (...) sacrifice a certain amount of interactive speed, but they are possible. (shrink)

A startling amount of intelligent activity can be controlled without reasoning or thought. By tuning the perceptual system to task relevant properties a creature can cope with relatively sophisticated environments without concepts. There is a limit, however, to how far a creature without concepts can go. Rod Brooks, like many ecologically oriented scientists, argues that the vast majority of intelligent behaviour is concept-free. To evaluate this position I consider what special benefits accrue to concept-using creatures. Concepts are either necessary for (...) certain types of perception, learning, and control, or they make those processes computationally simpler. Once a creature has concepts its capacities are vastly multiplied. (shrink)

This paper introduces the concept of Adaptive Rooms, which are virtual environments able to dynamically adapt to users’ needs, including ‘physical’ and cognitive workflow requirements, number of users, differing cognitive abilities and skills. Adaptive rooms are collections of virtual objects, many of them self-transforming objects, housed in an architecturally active room with information spaces and tools. An ontology of objects used in adap- tive rooms is presented. Virtual entities are classified as passive, reactive, ac- tive, and information entities, and their (...) sub-categories. Only active objects can be self-transforming. Adaptive Rooms are meant to combine the insights of ubiquitous computing -- that computerization should be everywhere, transpar- ently incorporated -- with the insights of augmented reality -- that everyday ob- jects can be digitally enhanced to carry more information about their use. To display the special potential of adaptive rooms, concrete examples are given to show how the demands of cognitive workflow can be reduced. (shrink)

Dramatic advances in 3D Web technologies have recently led to widespread development of virtual world Web browsers and 3D content. A natural question is whether 3D thumbnails can be used to find one’s way about such 3D content the way that text and 2D thumbnail images are used to navigate 2D Web content. We have conducted an empirical experiment that shows interactive 3D thumbnails, which we call worldlets, improve travelers’ landmark knowledge and expedite wayfinding in virtual environments.

Deception, like coercion, can invalidate the moral force of consent. In the sexual domain, when someone is deceived about some feature of their partner, knowledge of which would be dispositive of their decision to have sex – a dealbreaker – the moral validity of their consent is undermined. I argue that in order to determine whether someone has discharged their duties of disclosure in the sexual domain, we should ask whether, upon receiving a token of consent to sex, they have (...) a justified belief that their partner would consent to the sexual encounter given all the features that it has. I argue that whether an agent has a justified belief in this proposition is a function of the agent’s body of evidence and which alternatives uneliminated. (shrink)

This article addresses three main questions: What causes cognitive overload in the workplace? What analytical framework should be used to understand how agents interact with their work environments? How can environments be restructured to improve the cognitive workflow of agents? Four primary causes of overload are identified: too much tasking and interruption, and inadequate workplace infrastructure to help reduce the need for planning, monitoring, reminding, reclassifying information, etc… The first step in reducing the cognitive impact of these causes is to (...) enrich classical frameworks for understanding work environments, such as Newell and Simon’s notion of a task environment, by recognizing that our actual workplace is a superposition of many specific environments – activity spaces – which we slip between. Each has its own cost structure arising from the tools and resources available, including the cognitive strategies and interpretational frameworks of individual agents. These cognitive factors are significant, affecting how easy or difficult it is to perform an action, such as finding a specific paper in a “mess” desk. A few simple examples show how work environments can be redesigned and how restructuring can alter the cost structure of activity spaces. (shrink)