Lewis ascribes the stubborn persistence of addictions to habit, itself a normal process that does not imply lack of responsiveness to motivation. However, he suggests that more dynamic processes may be involved, for instance that “our recurrently focused brains inevitably self-organize.” Given hyperbolic delay discounting, a reward-seeking internal marketplace model describes two processes, also normal in themselves, that may give rise to the “deep attachment” to addictive activities that he describes: People learn to interpret current choices as test cases for (...) how they can expect to choose in the future, thus recruiting additional incentive against a universal tendency to temporarily prefer smaller, sooner to larger, later rewards. However, when this incentive is not enough, the same interpretation creates incentive to abandon the failed area, leading to the abstinence violation effect and a localized weak will. Normal human value does not come entirely, or even mainly, from expectation of external rewards, but is generated endogenously in imagination. Hyperbolic discounting provides an account of how we learn to cultivate the hedonic importance of occasions for endogenous reward by building appetite. In this account, expectations of the far future have to be rewarded endogenously if they are be as important as currently rewarded alternatives; and this importance is prone to collapse. Both will and hedonic importance are recursive and thus hard to study by controlled experiment, but do represent modelable, reward-based hypotheses about the dynamic nature of habit. (shrink)

Many situations in human life present choices between (a) narrowly preferred particular alternatives and (b) narrowly less preferred (or aversive) particular alternatives that nevertheless form part of highly preferred abstract behavioral patterns. Such alternatives characterize problems of self-control. For example, at any given moment, a person may accept alcoholic drinks yet also prefer being sober to being drunk over the next few days. Other situations present choices between (a) alternatives beneficial to an individual and (b) alternatives that are less beneficial (...) (or harmful) to the individual that would nevertheless be beneficial if chosen by many individuals. Such alternatives characterize problems of social cooperation; choices of the latter alternative are generally considered to be altruistic. Altruism, like self-control, is a valuable temporally-extended pattern of behavior. Like self-control, altruism may be learned and maintained over an individual's lifetime. It needs no special inherited mechanism. Individual acts of altruism, each of which may be of no benefit (or of possible harm) to the actor, may nevertheless be beneficial when repeated over time. However, because each selfish decision is individually preferred to each altruistic decision, people can benefit from altruistic behavior only when they are committed to an altruistic pattern of acts and refuse to make decisions on a case-by-case basis. (shrink)

Rachlin's thought-provoking analysis could be strengthened by greater openness to evolutionary interpretation and the use of the directed attention concept as a component of self-control. His contribution to the understanding of prosocial behavior would also benefit from abandoning the traditional (and excessively restrictive) definition of altruism.

Most authors who discuss willpower assume that everyone knows what it is, but our assumptions differ to such an extent that we talk past each other. We agree that willpower is the psychological function that resists temptations – variously known as impulses, addictions, or bad habits; that it operates simultaneously with temptations, without prior commitment; and that use of it is limited by its cost, commonly called effort, as well as by the person's skill at executive functioning. However, accounts are (...) usually not clear about how motivation functions during the application of willpower, or how motivation is related to effort. Some accounts depict willpower as the perceiving or formation of motivational contingencies that outweigh the temptation, and some depict it as a continuous use of mechanisms that interfere with re-weighing the temptation. Some others now suggest that impulse control can bypass motivation altogether, although they refer to this route as habit rather than willpower.It is argued here that willpower should be recognized as either or both of two distinct functions, which can be calledresolveandsuppression. Resolve is based on interpretation of a current choice as a test case for a broader set of future choices, which puts at stake more than the outcome of the current choice. Suppression is inhibiting valuation of (modulating) and/or keeping attention from (filtering) immediate alternatives to a current intention. Perception of current choices as test cases for broader outcomes may result in reliable preference for these outcomes, which is experienced as an effortlesshabit– a successful result of resolve, not an alternative method of self-control. Some possible brain imaging correlates are reviewed. (shrink)

Changing preferencesis a phenomenonoften invoked but rarely properlyaccounted for. Throughout the history of the social sciences, researchers have come against the possibility that their subjects’ preferenceswere affected by the phenomenato be explainedor by otherfactorsnot taken into accountin the explanation.Sporadically, attempts have been made to systematically investigate these in uences, but none of these seems to have had a lasting impact. Today we are still not much further with respect to preference change than we were at the middle of the last (...) century. This anthology hopes to provide a new impulse for research into this important subject. In particular, we have chosen two routes to amplify this impulse. First, we stress the use of modellingtechniquesfamiliar from economicsand decision theory. Instead of constructing complex, all-encompassing theories of preference change, the authors of this volume start with very simple, formal accounts of some possible and hopefully plausible mechanism of preference change. Eventually, these models may nd their way into larger, empirically adequate theories, but at this stage, we think that the most importantwork lies in building structure.Secondly,we stress the importance of interdisciplinary exchange. Only by drawing together experts from different elds can the complex empirical and theoretical issues in the modelling of preference change be adequately investigated. (shrink)

Philosophy and its descendents in the behavioral sciences have traditionally divided incentives into those that are sought and those that are avoided. Positive incentives are held to be both attractive and memorable because of the direct effects of pleasure. Negative incentives are held to be unattractive but still memorable (the problem of pain) because they force unpleasant emotions on an individual by an unmotivated process, either a hardwired response (unconditioned response) or one substituted by association (conditioned response). Negative incentives are (...) divided into those that are always avoided and those that are avoided only by higher mental processes—archetypically the passions, which are also thought of as hardwired or conditioned. Newer dichotomies within the negative have been proposed, hinging on whether a negative incentive is nevertheless sought (“wanted but not liked”) or on an incentive's being negative only because it is confining (the product of “rule worship”). The newer dichotomies have lacked motivational explanations, and there is reason to question conditioning in the motivational mechanism for the older ones.

Both experimental findings and the examination of common experience indicate that even the most aversive experiences, such as pain and panic, do not prevail in reflex fashion, but because of an urge to attend to them. The well-established hyperbolic curve in which prospective rewards are discounted implies a mechanism for such an urge, as well as for the “lower” incentives in the other dichotomies. The properties of these lower incentives are predicted by particular durations of temporary preferences on a continuum that stretches from fractions of a second to years. (shrink)

The models of internal self-control that have recently been proposed by behavioral economists do not depict motivational interaction that occurs while temptation is present. Those models that include willpower at all either envision a faculty with a motivation (“strength”) different from the motives that are weighed in the marketplace of choice, or rely on incompatible goals among diverse brain centers. Both assumptions are questionable, but these models’ biggest problem is that they do not let resolutions withstand re-examination while being challenged (...) by impulsive alternatives. The economists’ models all attempt to make a single equilibrium preference predictable from a person’s prior incentives. This was the original purpose of these models’ hyperboloid (“β–δ”) delay discount functions, which have been widely justified by the assumption that a person’s intertemporal inconsistency (impulsiveness) can be accounted for by the arousal of appetite for visceral rewards. Although arousal is clearly a factor in some cases of intertemporal inconsistency, it cannot be blamed for others, and furthermore does not necessarily imply hyperboloid discounting. The inadequacy of β–δ functions is particularly evident in models of internal self-control. I have reviewed several of these models, and have argued for a return to pure hyperbolic discount function as originally proposed, the relatively high tails of which can motivate a recursive process of self-prediction and thereby the formation of self-enforcing intertemporal contracts. Such a process does not require a separately motivated faculty of will, or incompatible goals among brain centers; but it also does not permit the prediction of unique preferences from prior incentives. (shrink)

Preston & de Waal are understandably cautious in applying their model to autism. They emphasise multiple cognitive impairments in autism, including prefrontal-executive, cerebellar-attention, and amygdala-emotion recognition deficits. Further empirical examination of imitation ability in autism may reveal deficits in the neural and cognitive basis of perception-action mapping that have a specific relation to the empathic deficit.

Ainslie challenges our interpretation of the properties of hyperbolic discount curves in an iterated prisoners’ dilemma model. In this reply, we discuss the emergence of hyperbolic discount functions in the behavioral economics literature and evaluate their properties. Furthermore, we present a summarized version of our IPD model and evaluate Ainslie’s points of contention.