2002 · 70 citations · 15 references
EngineeringMechatronics EngineeringRobotics EngineeringHuman-robot InteractionHumanoid RoboticsRoboticsHuman-robot CollaborationHuman-robot CommunicationMultimodal InteractionPerception For Humanoid RobotsSpeech RecognitionVisual TrackingCompanion RobotsDistributed Stream ProcessingFace IdentificationHuman-robot Interaction ArchitecturesMultimodal Human-robot InteractionSensorimotor InteractionSound Source LocalizationSound Source Tracking
Nakadai et al. (2001) have developed a real-time auditory and visual multiple-talker tracking technique. In this paper, this technique is applied to human-robot interaction including a receptionist robot and a companion robot at a party. The system includes face identification, speech recognition, focus-of-attention control, and sensorimotor task in tracking multiple talkers. The system is implemented on a upper-torso humanoid and the talker tracking is attained by distributed processing on three nodes connected by 100Base-TX network. The delay of tracking is 200 msec. Focus-of-attention is controlled by associating auditory and visual streams by using the sound source direction and talker position as a clue. Once an association is established, the humanoid keeps its face to the direction of the associated talker.
15
Computational auditory scene analysis
Guy J. Brown, Martin Cooke · Computer Speech & Language · 1994 · 714 citations
Kazuhiro Nakadai, Tino Lourens, Hiroshi G. Okuno et al. · 2000 · 212 citations
Engineering, Mechanical Engineering, Robotics Engineering +15
Socially embedded learning of the office-conversant mobile robot Jijo-2
Hideki Asoh, Satoru Hayamizu, Isao Hara et al. · 1997 · 83 citations