2015 · 22 citations · 18 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceMachine LearningRobot LearningAdaptive FeedbackFeedback GenerationPolicy LearningReinforcement LearningAgent Reinforcement LearningInteractive Reinforcement LearningLearning AgentsLearning From Corrective FeedbackLearning From Human FeedbackReinforcement Learning From Human Feedback
COACH (COrrective Advice Communicated by Humans), a new interactive learning framework that allows non-expert humans to shape a policy through corrective advice, using a binary signal in the action domain of the agent, is proposed. One of the main innovative features of COACH is a mechanism for adaptively adjusting the amount of human feedback that a given action receives, taking into consideration past feedback. The performance of COACH is compared with the one of TAMER (Teaching an Agent Manually via Evaluative Reinforcement), ACTAMER (Actor-Critic TAMER), and an autonomous agent trained using SARSA(?) in two reinforcement learning problems. COACH outperforms all other learning frameworks in the reported experiments. In addition, results show that COACH is able to transfer successfully human knowledge to agents with continuous actions, being a complementary approach to TAMER, which is appropriate for teaching in discrete action domains.
18
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
A survey of robot learning from demonstration
Brenna Argall, Sonia Chernova, Manuela Veloso et al. · Robotics and Autonomous Systems · 2008 · 3.3K citations
Apprenticeship learning via inverse reinforcement learning
Pieter Abbeel, Andrew Y. Ng · 2004 · 2.9K citations
Interactively shaping agents via human reinforcement
W. Bradley Knox, Peter Stone · 2009 · 414 citations