Biomimetics · 2023 · 10 citations · 24 references
EngineeringRobotics EngineeringAssistive TechnologyHuman-robot InteractionRoboticsAugmented RealityHuman-machine InteractionHuman-machine InterfacesHuman-robot Interaction EvaluationMixed RealityMultimodal InteractionAugmented Reality In ManufacturingAugmented Reality InterfacesFeedbackHand GesturesHuman Body CommunicationManufacturingMixed Reality InterfacesSoldering
Mixed reality technology can give humans an intuitive visual experience, and combined with the multi-source information of the human body, it can provide a comfortable human-robot interaction experience. This paper applies a mixed reality device (Hololens2) to provide interactive communication between the wearer and the wearable robotic limb (supernumerary robotic limb, SRL). Hololens2 can obtain human body information, including eye gaze, hand gestures, voice input, etc. It can also provide feedback information to the wearer through augmented reality and audio output, which is the communication bridge needed in human-robot interaction. Implementing a wearable robotic arm integrated with HoloLens2 is proposed to augment the wearer's capabilities. Taking two typical practical tasks of cable installation and electrical connector soldering in aircraft manufacturing as examples, the task models and interaction scheme are designed. Finally, human augmentation is evaluated in terms of task completion time statistics.
24
Robotic hand augmentation drives changes in neural body representation
Paulina Kieliba, Danielle Clode, Roni O. Maimon-Mor et al. · Science Robotics · 2021 · 160 citations · Full text