Development of a Person Following Robot with Vision Based Target Detection

TLDR

Person‑following robots must detect and locate a target in complex real‑world environments with static and moving obstacles. The robot employs vision‑based target detection with stereo imaging and color/texture recognition, coupled with ultrasonic sensors for obstacle avoidance, and a robust algorithm that estimates distance, speed, and visual features to maintain stable tracking under varying lighting and self‑motion. The ApriAttendatrade robot successfully extracted a target from cluttered scenes, re‑engaged after losing sight, and demonstrated robust, smooth following performance at Aichi EXPO 2005.

Abstract

We have developed the person following robot "ApriAttendatrade". This robot can accompany a person using vision based target detection and avoid obstacles with ultrasonic sensors while following the person. The robot first identifies an individual with its image processing system by detecting a person's region and recognizing the registered color and texture of his/her clothes. Usually, the person following robot has to detect and recognize the specified person and calculate his/her position in a complicated real-life environment of fixed objects and moving people. Our newly developed algorithm allows the robot to extract a particular individual from a cluttered background, and to find and reconnect with the person if it loses visual contact. Tracking people with stereo vision was realized by systematizing visual and motion control with a robust algorithm that utilizes various characteristics of the image data. The developed algorithm uses several analyses to extract information on the distance to each feature point, speed of target, color and texture of clothes for a stable tracking in many situations including changes of view due to self motion, shifts in lighting and objects similar to the target. The person following robot ApriAttendatrade has been exhibited at Aichi EXPO 2005, and its robust functions and smooth person following capability were successfully demonstrated