Active vision in robotic systems: A survey of recent developments

Shengyong Chen, Youfu Li

The International Journal of Robotics Research · 2011 · 403 citations · 168 references

Concepts

TL;DR

Active vision is increasingly vital for robotic automation, as planned perception of the environment is crucial yet challenging due to sensing and environmental uncertainty. This survey reviews the last 15 years of active vision developments in robotics, focusing on sensor planning to determine optimal sensor pose and settings for vision‑based tasks that require multiple views. The authors survey sensor‑planning problems across diverse robotic applications, describing methods for selecting optimal sensor pose and settings to acquire multiple views for tasks such as recognition, reconstruction, surveillance, manipulation, and navigation. The review catalogs a range of solution methods, summarizes their evaluations and analyses, and highlights future research trends in active vision for robotics.

Abstract

In this paper we provide a broad survey of developments in active vision in robotic applications over the last 15 years. With increasing demand for robotic automation, research in this area has received much attention. Among the many factors that can be attributed to a high-performance robotic system, the planned sensing or acquisition of perceptions on the operating environment is a crucial component. The aim of sensor planning is to determine the pose and settings of vision sensors for undertaking a vision-based task that usually requires obtaining multiple views of the object to be manipulated. Planning for robot vision is a complex problem for an active system due to its sensing uncertainty and environmental uncertainty. This paper describes such problems arising from many applications, e.g. object recognition and modeling, site reconstruction and inspection, surveillance, tracking and search, as well as robotic manipulation and assembly, localization and mapping, navigation and exploration. A bundle of solutions and methods have been proposed to solve these problems in the past. They are summarized in this review while enabling readers to easily refer solution methods for practical applications. Representative contributions, their evaluations, analyses, and future research trends are also addressed in an abstract level.

References

168