IISE Transactions · 2024 · 25 citations · 30 references
EngineeringComputer ScienceRobotics EngineeringAutomationHuman-robot InteractionRoboticsCollaborative Industrial RobotsHuman-robot CollaborationHuman-robot TeamingRobot TeamingRobotics AutomationCollaborative RoboticsCollaborative RobotsFlexible AutomationIntelligent Manufacturing SystemsMixed Reality EnvironmentsTask AssignmentTask PlanningVisual Reasoning
Human-Robot Collaboration (HRC) is key to flexible automation required by the mass personalization trend, especially towards human-centric intelligent manufacturing. Nevertheless, existing HRC systems suffer from poor task understanding and less ergonomic satisfaction, which impede empathetic teamwork skills in task execution. To overcome the bottleneck, a Mixed Reality (MR) and visual reasoning-based method is proposed in this research, providing mutual-cognitive task assignment for human and robotic agents’ operations. Firstly, an MR-enabled mutual-cognitive HRC architecture is proposed, with the characteristic of monitoring Digital Twins (DTs) states, reasoning co-working strategies, and providing cognitive services. Secondly, a visual reasoning approach is introduced, which learns scene interpretation from the visual perception of each agent’s actions and environmental changes to make task planning strategies satisfying human-robot operation needs. Lastly, a safe, ergonomic, and proactive robot motion planning algorithm is proposed to let a robot execute generated co-working strategies, while a human operator is supported with intuitive task operation guidance in the MR environment, achieving empathetic collaboration. Through a demonstration of a disassembly task of aging Electric Vehicle Batteries (EVBs), the experimental result facilitates cognitive intelligence in Proactive HRC for flexible automation.
30
Industry 4.0 and Industry 5.0—Inception, conception and perception
Xun Xu, Yuqian Lu, Birgit Vogel‐Heuser et al. · Journal of Manufacturing Systems · 2021 · 2.3K citations · Full text
Progress and prospects of the human–robot collaboration
Arash Ajoudani, Andrea Maria Zanchettin, Serena Ivaldi et al. · Autonomous Robots · 2017 · 777 citations · Full text
Learning to Compose Dynamic Tree Structures for Visual Contexts
Kaihua Tang, Hanwang Zhang, Baoyuan Wu et al. · 2019 · 542 citations