Converging data from different disciplines are showing the role of classical conditioning processes in the elaboration of human and animal behavior to be larger than previously supposed. Restricted views of classically conditioned responses as merely secretory, reflexive, or emotional are giving way to a broader conception that includes problem-solving, and other rule-governed behavior thought to be the exclusive province of either operant conditiońing or cognitive psychology. These new views have been accompanied by changes in the way conditioning is conducted and (...) evaluated. Data from a number of seemingly unrelated phenomena such as relapse to drug abuse by postaddicts, the placebo effect, and the immune response appear to involve classical conditioning processes. Classical conditioning, moreover, has been found to occur in simpler and simpler organisms and recently even demonstrated in brain slices and in utero. This target article will integrate the several research areas that have used the classical conditioning process as an explanatory model; it will challenge teleological interpretations of the classically conditioned CR and offer some basic principles for testing conditioning in diverse areas. (shrink)

The target article emphasizes the relationship between a matching law-based theory of addiction and the disease model of addiction. In contrast, this response emphasizes the relationship between the matching law theory and other behavioral approaches to addiction. The basic difference, I argue, is that the matching law specifies that choice is governed by local reinforcement rates. In contrast, economics says that overall reinforcement rate controls choice, and for other approaches there are other measures or no clear prediction at all. The (...) response also differs from the target article in that there is more emphasis on the finding that stimulus conditions determine whether choice is under local or overall reinforcement rate control. (shrink)

Two issues are raised. (1) What is the nature of the drug effect Heyman thinks confers value to drugs? (2) What is the evidence that drug use decreases the value of drugs and of conventional incentives over the long-term? There is considerable evidence for the opposite; a persistent increase in the sensitivity of neural systems that mediate drug value.

Heyman's view that addiction can be viewed as a natural outcome predictable by melioration and the matching law is provocative. Remaining to be explained more fully, however, are exactly how his view is an improvement on other reinforcement-based accounts. Included in these elaborations should be an account of how different “bookkeeping schemes” are developed and controlled and what new approaches to treatment and prevention of drug addiction are indicated.

For use in applied settings, the melioration model will need to incorporate changes in the shapes of local value functions over time, treat current value as a continuous function of time since previous choices, and take into account discounting of the effects of current behavior on future value. The policy implications of the model for regulating drugs are limited.

Knowledge of specific instances of melioration does not imply knowledge of the variables controlling behavior. Drug self-administration has been successfully analyzed in terms of standard variables such as the immediacy and magnitude of the drug reinforcer. An appeal to melioration may not be necessary.

Heyman explains useful ways to bring addictive drug use under environmental control. We doubt that relapse is explained by drug features such as immediate reinforcement, clouding of judgment, and so forth. Relapse may require explanation in terms of enduring sensitization of incentive neural substrates, but even if its causal assumptions are wrong, Heyman's model makes useful predictions for behavioral control.

Research findings on addiction are contradictory. According to biographical records and widely used diagnostic manuals, addicts use drugs compulsively, meaning that drug use is out of control and independent of its aversive consequences. This account is supported by studies that show significant heritabilities for alcoholism and other addictions and by laboratory experiments in which repeated administration of addictive drugs caused changes in neural substrates associated with reward. Epidemiological and experimental data, however, show that the consequences of drug consumption can significantly (...) modify drug intake in addicts. The disease model can account for the compulsive features of addiction, but not occasions in which price and punishment reduced drug consumption in addicts. Conversely, learning models of addiction can account for the influence of price and punishment, but not compulsive drug taking. The occasion for this target article is that recent developments in behavioral choice theory resolve the apparent contradictions in the addiction literature. The basic argument includes the following four statements: First, repeated consumption of an addictive drug decreases its future value and the future value of competing activities. Second, the frequency of an activity is a function of its relative (not absolute) value. This implies that an activity that reduces the values of competing behaviors can increase in frequency even if its own value also declines. Third, a recent experiment (Heyman & Tanz 1995) shows that the effective reinforcement contingencies are relative to a frame of reference, and this frame of reference can change so as to favor optimal or suboptimal choice. Fourth, if the frame of reference is local, reinforcement contingencies will favor excessive drug use, but if the frame of reference is global, the reinforcement contingencies will favor controlled drug use. The transition from a global to a local frame of reference explains relapse and other compulsive features of addiction. (shrink)

Critics of the computational connectionism of the last decade suggest that it shares undesirable features with earlier empiricist or associationist approaches, and with behaviourist theories of learning. To assess the accuracy of this charge the works of earlier writers are examined for the presence of such features, and brief accounts of those found are given for Herbert Spencer, William James and the learning theorists Thorndike, Pavlov and Hull. The idea that cognition depends on associative connections among large networks of neurons (...) is indeed one with precedents, although the implications of this for psychological issues have been interpreted variously — not all versions of connectionism are alike. (shrink)

Heyman's model, paradoxically, predicts that whereas a maximizing approach to drug choice will prevent escalation of drug use it will never yield complete abstinence. We suggest an alternative model that overcomes this difficulty by focusing on changes in drug tolerance. A small modification allows maximization to predict either abstinence or moderation (e.g., social drinking).

Extraversion has two central characteristics: (1) interpersonalengagement, which consists of affiliation (enjoying and valuing close interpersonal bonds, being warm and affectionate) and agency (being socially dominant, enjoying leadership roles, being assertive, being exhibitionistic, and having a sense of potency in accomplishing goals) and (2) impulsivity, which emerges from the interaction of extraversion and a second, independent trait (constraint). Agency is a more general motivational disposition that includes dominance, ambition, mastery, efficacy, and achievement. Positive affect (a combination of positive feelings and (...) motivation) is closely associated with extraversion. Extraversion is accordingly based on positiveincentivemotivation. (shrink)

ABSTRACTAffective states influence how individuals process information and behave. Some theories predict emotional congruency effects. Emotional congruency should theoretically obstruct the learning of reward associations and their ability to guide behaviour under negative mood. Two studies tested the effects of the induction of a negative affective state on appetitive Pavlovian learning, in which neutral stimuli were associated with chocolate or alcohol rewards. In both experiments, participants showed enhanced approach tendencies towards predictors of reward after a negative relative to a positive (...) performance feedback manipulation. This increase was related to a reduction in positive affect in Experiment 1 only. No effects of the manipulation on conditioned reward expectancies, craving, or consumption were observed. Overall, our findings support the idea of counter-regu... (shrink)

Over the years, many theories have been proposed to account for the aberrant behavior of drug dependent individuals. Heyman posits that the existing theories of drug dependence are inadequate to explain the complex processes inherent in human drug-taking. He proposes that incongruous behaviors that comprise addiction, such as continued drug use in spite of adverse consequences, can be explained by application of the matching law approach. While the matching law theory of addiction explains certain aspects of human behavior, its application (...) to the area of addiction must be subjected to experimental verification. (shrink)

Heyman's target article makes a strong case for a behavioral approach to addiction, yet some important assumptions require justification, and promising behavioral alternatives to the author's melioration approach should be considered. In particular, the behavioral economic approach to addiction appears well developed and comprehensive. How does the melioration approach complement or improve on a behavioral economic account?

Addictive behavior has never seemed rational because it persists in spite of drastic aversive consequences. This is a particular problem for models of addiction such as operant psychology which hold that behavior is controlled by its consequences. Inspite of claims to the contrary, Heymans target article illustrates how operant psychology resolves this contradiction. By using the matching law, Heyman suggests a mechanism that explains why delayed aversive events may not control behavior, and a conceptual framework in which we can understand (...) successful therapies. (shrink)

Extreme sensations – thirst, pain – can focus attention on local consequences at the expense of the overall, perhaps for good evolutionary reasons. Maybe the same phenomenon evolves from prolonged use of addictive substances. The matching law explains mistaken choice, not how a person who has confronted personal catastrophe manages to ignore it in making a locally induced choice.

Elaborated Intrusion theory distinguishes between unconscious, associative processes as the precursors of desire, and controlled processes of cognitive elaboration that lead to conscious sensory images of the target of desire and associated affect. We argue that the latter play a key role in motivating human behaviour. Consciousness is functional in that it allows competing goals to be compared and evaluated. The role of effortful cognitive processes in desire helps to explain the different time courses of craving and physiological withdrawal.

I discuss various theoretical issues concerning maximizing, matching, and melioration. The model of addiction based on melioration has the key feature that a reduction in drag use increases both the value of drag-taking and the value of conventional activities. I found Heyman's target article stimulating. I don't feel competent to comment on drags but I do have some thoughts, both general and specific, on the theoretical issues.

Heyman's analysis of addiction suggests that drug taking is irrational. The irrationality of drug taking, however, may depend on the acceptance of mainstream society's view of what is valuable. Consideration of the addict's viewpoint and cultural aspects of drug taking may be useful in trying to fathom the “rationality” of drug taking.