The European Symposium on Artificial Neural Networks · 2008 · 83 citations · 5 references
EngineeringComputer ScienceSystems EngineeringArtificial IntelligenceMarkov Decision ProcessesSafety EngineeringExploration-exploitation TradeoffPolicy LearningReinforcement LearningReinforcement Learning FoundationsSafety-critical SystemsSimulation-based LearningBackupBackup PolicyExplorationExploration In Reinforcement LearningGas Turbine OperationSafe ExplorationSafe LearningSafety Constraints
In this paper we define and address the problem of safe exploration in the context of reinforcement learning. Our notion of safety is concerned with states or transitions that can lead to damage and thus must be avoided. We introduce the concepts of a safety function for determining a state’s safety degree and that of a backup policy that is able to lead the system under control from a critical state back to a safe one. Moreover, we present a level-based exploration scheme that is able to generate a comprehensive base of observations while adhering safety constraints.We evaluate our approach on a simplified simulation of a gas turbine.
5
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Risk-Sensitive Reinforcement Learning
Oliver Mihatsch, Ralph Neuneier · Machine Learning · 2002 · 262 citations · Full text
Exploration and apprenticeship learning in reinforcement learning
Pieter Abbeel, Andrew Y. Ng · 2005 · 234 citations
Reinforcement Learning with Bounded Risk
Peter Geibel · 2001 · 50 citations