IEEE Transactions on Industrial Informatics · 2023 · 12 citations · 30 references
EngineeringComputer ScienceRobotics EngineeringComputer VisionHuman-robot InteractionRoboticsAssemblyFeature DescriptionHuman-robot CollaborationHuman-robot TeamingRobotic VisionScene UnderstandingGraph GenerationHuman-robot AssemblyHuman-robot Assembly CollaborationHuman-robot Collaboration In AssemblyMultimodal Feature RepresentationMultimodal Scene UnderstandingScene Graph GenerationScene Graph Representation
Human–robot collaborative assembly is required to comprehensively perceive the working scenarios for the most possible assembly collaborations. Nevertheless, existing works have paid much attention to physical entities (i.e., object detection, pose estimation), while ignores the weight of interactive relationships. This research gap makes it difficult to become aware of the cues for decision-making, especially in a complicated assembly task. Furthermore, inadequate relative position characteristics and indescribable object influence remain quite challenging for visual relationship representation. To overcome these abovementioned gaps, a multimodality scene graph generation approach is proposed to more robustly describe the abstract visual relationships. A novel heat modality is presented to better represent the relative spatial characteristic. Three strategies are developed for adapting different baselines in the multimodality feature encoder module. Experimental results show the generality and superb performance for multimodality scene graph generation tasks in human–robot collaborative assembly scenarios.
30
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Scene Graph Generation by Iterative Message Passing
Danfei Xu, Yuke Zhu, Christopher Choy et al. · 2017 · 1.2K citations
Learning to Compose Dynamic Tree Structures for Visual Contexts
Kaihua Tang, Hanwang Zhang, Baoyuan Wu et al. · 2019 · 542 citations