Journal of the Experimental Analysis of Behavior · 1972 · 1.2K citations · 16 references
Life SciencesBehavioral SciencesPsychologyAnimal BehaviorDecision TheoryExperimental PsychologyAnimal Decision-makingBehavioral Decision-makingChoice BehaviorDecision-making ModelsOperant ConditioningReaction TimeDelayed Reward DesignImmediate Reward PreferenceResponse AllocationTask Delay
Models predict that as the waiting period T increases, pigeons shift from preferring immediate small rewards to choosing the larger delayed reward, mirroring commitment and self‑control in humans. Pigeons chose the small immediate reward in a direct choice, but when a waiting period T preceded the choice, they selected the small reward only for short T and the large delayed reward for long T.
When offered a choice (Choice Y) between a small immediate reward (2‐sec exposure to grain) and a large reward (4‐sec exposure to grain) delayed by 4 sec, pigeons invariably preferred the small, immediate reward. However, when offered a choice (Choice X) between a delay of T seconds followed by Choice Y and a delay of T seconds followed by restriction to the large delayed reward only, the pigeon's choice depended on T. When T was small, the pigeons chose the alternative leading to Choice Y (and then chose the small, immediate reward). When T was large, the pigeons chose the alternative leading to the large delayed reward only. The reversal of preference as T increases is predicted by several recent models for choice between various amounts and delays of reward. The preference for the large delayed alternative with long durations of T parallels everyday instances of advance commitment to a given course of action. Such commitment may be seen as a prototype for self‐control.
16
Ernest Kilzer, B. F. Skinner · The American Catholic Sociological Review · 1953 · 9K citations
Percival M. Symonds · Journal of Educational Psychology · 1954 · 4.9K citations
ON THE LAW OF EFFECT<sup>1</sup>
R. J. Herrnstein · Journal of the Experimental Analysis of Behavior · 1970 · 2.6K citations · Full text
Intransitivity of preferences.
Amos Tversky · Psychological Review · 1969 · 2.2K citations