Journal of Neuroscience · 2022 · 22 citations · 32 references
Life SciencesNeurosciencePsychologyAnimal BehaviorBehavioral NeuroscienceBiological PsychologyBasal GangliaBehavioral InhibitionClassical ConditioningDefensive BehaviorOperant ConditioningReward PathwaysAvoidance Behavior CircuitsBasal Ganglia CircuitryBasal Ganglia Motor CircuitsBehavioral AvoidancePrefrontal Cortex CircuitsPunishment SignalingReinforcementRisky Behavior
While conflict between incompatible goals has well-known effects on actions, in many situations the same action may produce harmful or beneficial consequences during different periods in a nonconflicting manner, e.g., crossing the street during a red or green light. To avoid harm, subjects must be cautious to inhibit the action specifically when it is punished, as in passive avoidance, but act when it is beneficial, as in active avoidance or active approach. In mice of both sexes performing a signaled action to avoid harm or obtain reward, we found that addition of a new rule that punishes the action when it occurs unsignaled delays the timing of the signaled action in an apparent sign of increased caution. Caution depended on task signaling, contingency, and reinforcement type. Interestingly, caution became persistent when the signaled action was avoidance motivated by danger but was only transient when it was approach motivated by reward. Although caution is represented by the activity of neurons in the midbrain, it developed independent of frontal cortex or basal ganglia output circuits. These results indicate that caution disrupts actions in different ways depending on the motivational state and may develop from unforeseen brain circuits.
32
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
The Behavior of Organisms: An Experimental Analysis
F. Nowell Jones, B. F. Skinner · The American Journal of Psychology · 1939 · 4.4K citations
The mouse brain in stereotaxic coordinates
Jan Pieter Konsman · Psychoneuroendocrinology · 2003 · 4.1K citations
Medicine, Neurobiology, Neuroscience +12
Species-specific defense reactions and avoidance learning.
Robert C. Bolles · Psychological Review · 1970 · 1.6K citations
Conditioning and Associative Learning
Winfred F. Hill, N. J. Mackintosh · The American Journal of Psychology · 1984 · 1.3K citations