Reinforcement Learning for Coverage Optimization Through PTZ Camera Alignment in Highly Dynamic Environments

Stefan Rudolph, Sarah Edenhofer, Sven Tomforde, Jörg Hähner

2014 · 21 citations · 11 references

Concepts

Abstract

In recent years, Smart Camera Networks are a field of intensive research, because of the versatile application areas of such systems. This work contributes to realize such applications by focusing on the problem of optimizing the coverage in a pan tilt zoom (PTZ) camera network during runtime. We propose to approach this problem with Reinforcement Learning (RL) techniques. Therefore, we first introduce our underlying model and its RL context. Then, we present the fairly new RL algorithm Distributed W-Learning, which is specialized for Multi Agent Systems. We compared the algorithm against current non-learning, state-of-the-art algorithms. The paper demonstrates the potential benefit of applying RL to coverage problems. Especially the performance of PTZ cameras in highly dynamic environments can be increased significantly.

References

11