Teleological behaviorism, unlike Skinnerian behaviorism, recognizes that are needed to account adequately for human behavior, but it rejects the essential role in behavioral explanations of the subjective perspective of the agent. I argue that teleological behaviorism fails because of this rejection.

Rachlin's view of self-control as a sequence or chain of behaviors is contrasted with traditional behavioral analyses of self-control which emphasize a simplistic interpretation of the hyperbolic function relating small-sooner (SS) and larger-later (LL) reinforcers to specific behaviors. The validity of Rachlin's teleological analysis is examined in relation to the acquisition and steady-state performance of self-control behaviors. Central to an analysis of self-control is the functional difference between behavior under the control of SS and LL reinforcers, because SS-reinforced behavior is (...) more complex due to temporal parameters. (shrink)

The primary argument against Rachlin's act-versus-pattern analysis of self-control is that it is wrong to think of a temptation as a solitary act while the alternative is conceived of as an element of a pattern. Either both are solitary acts or both are members of patterns, however different the patterns may be in their complexity and abstractness.

Rachlin overlooks that free will determines when and in what direction acts that appear impulsive will occur. Because behavioral patterns continuously evolve, animals are not guaranteed when they will, or how to, maximize larger-later reinforcements. An animal therefore uses self-control to emit free acts to vary behavioral patterns to optimize larger-later rewards.

The willingness to trade off large but ill-defined future consequences for immediate work characterizes social problems such as environmental sustainability. This commentary argues that important applications of behavioral models of self-control are being overlooked in the experimental literature. Tying the experimental literature to longterm health, environmental, and other risks makes the experimental work more germane, and raises new research questions for experimental modeling.

Belief storage is often modeled as having the structure of a single, unified web. This model of belief storage is attractive and widely assumed because it appears to provide an explanation of the flexibility of cognition and the complicated dynamics of belief revision. However, when one scrutinizes human cognition, one finds strong evidence against a unified web of belief and for a fragmented model of belief storage. Using the best available evidence from cognitive science, we develop this fragmented model into (...) a nascent theory of the cognitive architecture of belief storage. (shrink)

ArgumentToday's models of temporal discounting are the result of multiple interdisciplinary exchanges between psychology and economics. Although these exchanges did not result in an integrated discipline, they had important effects on all disciplines involved. The paper describes these exchanges from the 1930s onwards, focusing on two episodes in particular: an attempted synthesis by psychiatrist George Ainslie and others in the 1970s; and the attempted application of this new discounting model by a generation of economists and psychologists in the 1980s, which (...) ultimately ended in thediversity of measurements disappointment. I draw four main conclusions. First, multiple notions of temporal discounting must be conceptually distinguished. Second, behavioral economics is not an integration or unification of psychology and economics. Third, the analysis identifies some central disciplinary markers that distinguish modeling strategies in economics and psychology. Finally, it offers a case of interdisciplinary success that does not fit the currently dominant account of interdisciplinarity as integration. (shrink)

The long-term persistence of neurotic symptoms, such as anxiety, poses difficult problems for any psychological theory. An attempt is made to revive the Watson-Mowrer conditioning theory and to avoid the many criticisms directed against it in the past. It is suggested that recent research has produced changes in learning theory that can be used to render this possible. In the first place, the doctrine of equipotentiality has been shown to be wrong, and some such concept as Seligman's “preparedness” is required, (...) that is the notion that certain CS are biologically prepared to be more readily connected with anxiety responses than others. In the second place, the law of extinction has to be amended, and the law of incubation or enhancement added, according to which the exposure of the CS-only may, under certain specified conditions, have the effect of increasing the strength of the CR, rather than reducing it. The major conditions favouring incubation are Pavlovian B conditioning, that is a type of conditioning in which the CR is a drive; a strong UCS, and short exposure of the CS-only. (shrink)

A motivational system approach to avoidance behavior is presented. According to this approach, a motivational state increases the probability of relevant response patterns and establishes the appropriate or “ideal” consummatory stimuli as positive reinforcers. In the case of feeding motivation, for example, hungry rats are likely to explore and gnaw, and to learn to persist in activities correlated with the reception of consummatory stimuli produced by ingestion of palatable substances. In the case of defense motivation, fearful rats are likely to (...) flee or freeze, and to learn to persist in activities correlated with consummatory stimuli produced by flight from a dangerous place. Defense system activation is distinct from alarm reactions. The latter prepare the animal for probable noxious events, involve relatively intense negative affect and extinguish rapidly in situations where the noxious event no longer occurs. In contrast, defense system activation potentiates innate and modified defense reactions, thus preparing the animal for possible, but not necessarily probable, noxious events; it involves little or no negative affect and extinguishes very slowly when the noxious event no longer occurs. With these assumptions and the resulting model we attempt to resolve several long-standing problems in avoidance learning, including the low correlation between negative affect and avoidance performance, differential rates of extinction for avoidance performance and conditioned emotional responses, and evidence that some avoidance responses are much more easily learned than others. In addition, the model has implications for the study of parallels between appetitive and aversive motivation, sign tracking in aversive conditioning, and orientation of flight responses. Historical antecedents and alternative approaches are discussed. (shrink)

Effective conditioning requires a correlation between the experimenter's definition of a response and an organism's, but an animal's perception of its behavior differs from ours. These experiments explore various definitions of the response, using the slopes of learning curves to infer which comes closest to the organism's definition. The resulting exponentially weighted moving average provides a model of memory that is used to ground a quantitative theory of reinforcement. The theory assumes that: incentives excite behavior and focus the excitement on (...) responses that are contemporaneous in memory. The correlation between the organism's memory and the behavior measured by the experimenter is given by coupling coefficients, which are derived for various schedules of reinforcement. The coupling coefficients for simple schedules may be concatenated to predict the effects of complex schedules. The coefficients are inserted into a generic model of arousal and temporal constraint to predict response rates under any scheduling arrangement. The theory posits a response-indexed decay of memory, not a time-indexed one. It requires that incentives displace memory for the responses that occur before them, and may truncate the representation of the response that brings them about. As a contiguity-weighted correlation model, it bridges opposing views of the reinforcement process. By placing the short-term memory of behavior in so central a role, it provides a behavioral account of a key cognitive process. (shrink)

In the real world, there are choices between large, delayed, punctate rewards and small, more immediate rewards as well as choices between patterns and acts. A common element in these situations is the choice between long- and short-term interests. Key issues for future research appear to be how acts are restructured into larger patterns of behavior, and whether, as Rachlin implies, pattern perception is the cause of pattern generation.

Rachlin's hyperbolic-discounting model captures basic features of the subtlety of human impulsiveness and self-control and has received convincing experimental support. His distinction between self-control patterns and impulsive acts expands his earlier work to a greater range of self-control behaviors. Possible mechanisms that may weaken or strengthen patterns of self-control are considered.

Self-control, so important in the theory and practice of psychology, has usually been understood introspectively. This target article adopts a behavioral view of the self (as an abstract class of behavioral actions) and of self-control (as an abstract behavioral pattern dominating a particular act) according to which the development of self-control is a molar/molecular conflict in the development of behavioral patterns. This subsumes the more typical view of self-control as a now/later conflict in which an act of self-control is a (...) choice of a larger but later reinforcer over a smaller but sooner reinforcer. If at some future time the smaller-sooner reinforcer will be more valuable than the larger-later reinforcer, self-control may be achieved through a commitment to the largerlater reinforcer prior to that point. According to some, there is a progressive internalization of commitment in the development of self-control. This presents theoretical and empirical problems. In two experiments temporal patterning of choices increased self-control. (shrink)

Regarding Rachlin's behavioral act/pattern theory of self-control, it is argued that some cases of self-control involve pattern/ pattern conflicts rather than merely act/pattern conflicts and that some patterns must be viewed as internal representational states of mind (plans) rather than merely as patterns of actual overt behavior.

Transcendence, defined as the capacity to perceive the immediate stimulus environment in relation to long-range or abstract concerns, is a key aspect of self-control, and indeed self-regulation often breaks down because attention becomes focused exclusively on the immediate stimuli (i.e., transcendence fails). Factors that restrict attention to the here and now will weaken self-control, whereas factors that promote transcendence will enhance it. Guilt may be one example of the latter.

Contrary to his own perspective, Rachlin introduces a ghostly inner cost to explain the persistence of behavioral patterns and agency to explain their origins. Both inconsistencies can be set straight by taking account of history and a context larger than the pattern itself. Persistence is explained by stimulus control, if one assumes that defection from a pattern has stimulus properties and is punished. The origins of patterns are understood as an outcome of selection in the larger context of cultural or (...) biological evolution. (shrink)

Rachlin's attack on the internal commitment model rests on the demonstrably false claim that self-punishment does not exist. He is correct that habits are an effective device for solving self-control problems, but his additional claim that they are the only such device makes it hard to explain how good habits develop in the first place. Someone with a self-control problem would always choose the spuriously attractive reward, which, over time, would create bad habits.