International Joint Conference on Artificial Intelligence · 1987 · 49 citations · 4 references
ComputingBehavioral SciencesComputer ScienceArtificial IntelligenceHuman BehaviorMachine LearningClassificationPositive Reinforcement SystemsReinforcement LearningReinforcement Learning FoundationsReward ProcessingSequence LearningCredit AllocationCredit AssignmentHierarchical ClassificationHierarchical Reinforcement LearningReinforcement Learning ModelsReinforcement Learning TheoryReward LearningReward-based Learning
Learning systems which engage in sequential activity face the problem of properly allocating credit to steps or actions which make possible later steps that result in environmental payoff. In the classifier systems studied by Holland and others, credit is allocated by means of a algorithm through which, over time, environmental payoff in effect Bows back to classifiers which take early, stage-setting actions. The algorithm has advantages of simplicity and locality, but may not adequately reinforce long action sequences. We suggest an alternative form for the algorithm and the system's operating principles designed to induce behavioral hierarchies in which modularity of the hierarchy would keep all bucket-brigade chains short, thus more reinforceable and more rapidly learned, but overall action sequences could be long.
4
Classifier Systems and the Animat Problem
Stewart W. Wilson · Machine Learning · 1987 · 265 citations · Full text
Mechanisms of planning and problem solving in the brain
James S. Albus · Mathematical Biosciences · 1979 · 144 citations
Properties of the bucket brigade algorithm
John H. Holland · Medical Entomology and Zoology · 1985 · 115 citations