Human–Machine Interaction in Intelligent Robotic Systems: A Unifying Consideration with Implementation Examples

Abstract

The goal of this paper is to provide a general unified discussion of the human machine interaction issues as applied to robotics. First, the general structure of intelligent Human Machine Interfaces (HMIs) is presented. Then the class of natural language interfaces (NLIs) is reviewed. Next the class of graphical HMIs (GHMIs) is investigated including the combination of GHMIs with Virtual Reality (VR) system facilities. Finally, the category of force sensing/tactile-based HMIs is considered, where joysticks, force-reflecting devices, exoskeleton haptic devices and dextrous arm masters are included. The paper ends with a short presentation of five implementation examples of HMIs in various robotic systems and applications.