IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews) · 2007 · 128 citations · 28 references
ComputingAutonomous SystemsComputer ScienceArtificial IntelligenceAutomationData MiningBuilding AutomationBuilding Automation SystemsIntelligent AgentsOccupant Behavior ModelingPolicy LearningReinforcement LearningAgent-based Occupant ModelingData Stream MiningDecision Algorithm DevelopmentIntelligent ControlOccupant Activity ModelingSensor-based Occupant Behavior Modeling
In this paper, we examine the problem of learning inhabitant behavioral models in intelligent environments. We maintain that inhabitant interactions in smart environments can be automated using a data-driven approach to generate hierarchical inhabitant models and learn decision policies. To validate this hypothesis, we have designed the ProPHeT decision-learning algorithm that learns a strategy for controlling a smart environment based on sensor observation, power line control, and the generated hierarchical model. The performance of the algorithm is evaluated using real data collected from our MavHome smart home and smart office environments.
28
Reinforcement Learning: An Introduction
Richard S. Sutton, Andy Barto · IEEE Transactions on Neural Networks · 1998 · 27.1K citations
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
An introduction to hidden Markov models
L. R. Rabiner, Biing‐Hwang Juang · IEEE ASSP Magazine · 1986 · 4.8K citations
Circular Statistics in Biology
Geoffrey S. Watson, Edward Batschelet · Technometrics · 1982 · 4.6K citations