Maximization theory, which is borrowed from economics, provides techniques for predicing the behavior of animals - including humans. A theoretical behavioral space is constructed in which each point represents a given combination of various behavioral alternatives. With two alternatives - behavior A and behavior B - each point within the space represents a certain amount of time spent performing behavior A and a certain amount of time spent performing behavior B. A particular environmental situation can be described as a constraint (...) on available points (a circumscribed area) within the space. Maximization theory assumes that animals always choose the available point with the highest numerical value. The task of maximization theory is to assign to points in the behavioral space values that remain constant across various environmental situations; as those situations change, the point actually chosen is always the one with the highest assigned value. (shrink)

Self-control, so important in the theory and practice of psychology, has usually been understood introspectively. This target article adopts a behavioral view of the self (as an abstract class of behavioral actions) and of self-control (as an abstract behavioral pattern dominating a particular act) according to which the development of self-control is a molar/molecular conflict in the development of behavioral patterns. This subsumes the more typical view of self-control as a now/later conflict in which an act of self-control is a (...) choice of a larger but later reinforcer over a smaller but sooner reinforcer. If at some future time the smaller-sooner reinforcer will be more valuable than the larger-later reinforcer, self-control may be achieved through a commitment to the largerlater reinforcer prior to that point. According to some, there is a progressive internalization of commitment in the development of self-control. This presents theoretical and empirical problems. In two experiments temporal patterning of choices increased self-control. (shrink)

Rachlin's view of self-control is rejected on the grounds that his arguments do not establish the possibility of abstract, external, stimulus patterns and that his experiments, although they show that pigeons and human beings do sometimes choose postponed rather than immediate gratification, do not challenge the commonly held view that internal factors are involved in the former choice.

Belief storage is often modeled as having the structure of a single, unified web. This model of belief storage is attractive and widely assumed because it appears to provide an explanation of the flexibility of cognition and the complicated dynamics of belief revision. However, when one scrutinizes human cognition, one finds strong evidence against a unified web of belief and for a fragmented model of belief storage. Using the best available evidence from cognitive science, we develop this fragmented model into (...) a nascent theory of the cognitive architecture of belief storage. (shrink)

ArgumentToday's models of temporal discounting are the result of multiple interdisciplinary exchanges between psychology and economics. Although these exchanges did not result in an integrated discipline, they had important effects on all disciplines involved. The paper describes these exchanges from the 1930s onwards, focusing on two episodes in particular: an attempted synthesis by psychiatrist George Ainslie and others in the 1970s; and the attempted application of this new discounting model by a generation of economists and psychologists in the 1980s, which (...) ultimately ended in thediversity of measurements disappointment. I draw four main conclusions. First, multiple notions of temporal discounting must be conceptually distinguished. Second, behavioral economics is not an integration or unification of psychology and economics. Third, the analysis identifies some central disciplinary markers that distinguish modeling strategies in economics and psychology. Finally, it offers a case of interdisciplinary success that does not fit the currently dominant account of interdisciplinarity as integration. (shrink)

A motivational system approach to avoidance behavior is presented. According to this approach, a motivational state increases the probability of relevant response patterns and establishes the appropriate or “ideal” consummatory stimuli as positive reinforcers. In the case of feeding motivation, for example, hungry rats are likely to explore and gnaw, and to learn to persist in activities correlated with the reception of consummatory stimuli produced by ingestion of palatable substances. In the case of defense motivation, fearful rats are likely to (...) flee or freeze, and to learn to persist in activities correlated with consummatory stimuli produced by flight from a dangerous place. Defense system activation is distinct from alarm reactions. The latter prepare the animal for probable noxious events, involve relatively intense negative affect and extinguish rapidly in situations where the noxious event no longer occurs. In contrast, defense system activation potentiates innate and modified defense reactions, thus preparing the animal for possible, but not necessarily probable, noxious events; it involves little or no negative affect and extinguishes very slowly when the noxious event no longer occurs. With these assumptions and the resulting model we attempt to resolve several long-standing problems in avoidance learning, including the low correlation between negative affect and avoidance performance, differential rates of extinction for avoidance performance and conditioned emotional responses, and evidence that some avoidance responses are much more easily learned than others. In addition, the model has implications for the study of parallels between appetitive and aversive motivation, sign tracking in aversive conditioning, and orientation of flight responses. Historical antecedents and alternative approaches are discussed. (shrink)

Rachlin's hyperbolic-discounting model captures basic features of the subtlety of human impulsiveness and self-control and has received convincing experimental support. His distinction between self-control patterns and impulsive acts expands his earlier work to a greater range of self-control behaviors. Possible mechanisms that may weaken or strengthen patterns of self-control are considered.

Rachlin's view of self-control as a sequence or chain of behaviors is contrasted with traditional behavioral analyses of self-control which emphasize a simplistic interpretation of the hyperbolic function relating small-sooner (SS) and larger-later (LL) reinforcers to specific behaviors. The validity of Rachlin's teleological analysis is examined in relation to the acquisition and steady-state performance of self-control behaviors. Central to an analysis of self-control is the functional difference between behavior under the control of SS and LL reinforcers, because SS-reinforced behavior is (...) more complex due to temporal parameters. (shrink)

The primary argument against Rachlin's act-versus-pattern analysis of self-control is that it is wrong to think of a temptation as a solitary act while the alternative is conceived of as an element of a pattern. Either both are solitary acts or both are members of patterns, however different the patterns may be in their complexity and abstractness.

Teleological behaviorism, unlike Skinnerian behaviorism, recognizes that are needed to account adequately for human behavior, but it rejects the essential role in behavioral explanations of the subjective perspective of the agent. I argue that teleological behaviorism fails because of this rejection.

The costliness of disrupting a pattern may not be a useful criterion for distinguishing between acts and patterns; there are instances in which omitted components of patterns are hard to detect (e.g., typographical errors), or in which distortions are easily introduced (e.g., slurred words in a trite phrase). Are there behavioral criteria for distinguishing between acts and patterns?

Transcendence, defined as the capacity to perceive the immediate stimulus environment in relation to long-range or abstract concerns, is a key aspect of self-control, and indeed self-regulation often breaks down because attention becomes focused exclusively on the immediate stimuli (i.e., transcendence fails). Factors that restrict attention to the here and now will weaken self-control, whereas factors that promote transcendence will enhance it. Guilt may be one example of the latter.

Toward a neurobiologically grounded approach to explaining self-control we discuss the case of a patient with a bilateral lesion in frontal ventromedial cortex. Patients with such lesions display a marked deficit in social decision making. Compared with an account that examines the causal antecedents of self-control, Rachlin's behaviorist approach seems lacking in explanatory strength.

Rachlin overlooks that free will determines when and in what direction acts that appear impulsive will occur. Because behavioral patterns continuously evolve, animals are not guaranteed when they will, or how to, maximize larger-later reinforcements. An animal therefore uses self-control to emit free acts to vary behavioral patterns to optimize larger-later rewards.

The long-term persistence of neurotic symptoms, such as anxiety, poses difficult problems for any psychological theory. An attempt is made to revive the Watson-Mowrer conditioning theory and to avoid the many criticisms directed against it in the past. It is suggested that recent research has produced changes in learning theory that can be used to render this possible. In the first place, the doctrine of equipotentiality has been shown to be wrong, and some such concept as Seligman's “preparedness” is required, (...) that is the notion that certain CS are biologically prepared to be more readily connected with anxiety responses than others. In the second place, the law of extinction has to be amended, and the law of incubation or enhancement added, according to which the exposure of the CS-only may, under certain specified conditions, have the effect of increasing the strength of the CR, rather than reducing it. The major conditions favouring incubation are Pavlovian B conditioning, that is a type of conditioning in which the CR is a drive; a strong UCS, and short exposure of the CS-only. (shrink)