Psychological Review · 2006 · 833 citations · 156 references
EngineeringBehavioral SciencesComplex SystemsDynamical SystemsRobot DynamicsBehaviorBehavioral ModelingControl Of Dynamical SystemsControl TheoryMovement DynamicsMulti-body DynamicsAction-perception LoopsDynamic Systems ApproachDynamical Systems StabilityDynamicsHuman-agent InteractionPerception-action CouplingPhysical Interaction With The EnvironmentVector Field Modeling
How might one account for the organization in behavior without attributing it to an internal control structure? The present article develops a theoretical framework called behavioral dynamics that integrates an information-based approach to perception with a dynamical systems approach to action. For a given task, the agent and its environment are treated as a pair of dynamical systems that are coupled mechanically and informationally. Their interactions give rise to the behavioral dynamics, a vector field with attractors that correspond to stable task solutions, repellers that correspond to avoided states, and bifurcations that correspond to behavioral transitions. The framework is used to develop theories of several tasks in which a human agent interacts with the physical environment, including bouncing a ball on a racquet, balancing an object, braking a vehicle, and guiding locomotion. Stable, adaptive behavior emerges from the dynamics of the interaction between a structured environment and an agent with simple control laws, under physical and informational constraints.
156
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
The Ecological Approach to Visual Perception
Marc H. Bornstein, James J. Gibson · Journal of Aesthetics and Art Criticism · 1980 · 23.2K citations
Medicine, Psychology, Vision Science +17