International Journal of Advanced Robotic Systems · 2019 · 36 citations · 18 references
EngineeringComputer ScienceRobotics EngineeringComputer VisionGraspingRoboticsDexterous ManipulationGrasp DetectionSlip DetectionTactile PerceptionTactile SensingMultimodal Slip DetectionObject Slip DetectionRobotic GraspingSlip Detection AlgorithmsTactile Data AcquisitionTactile Data AnalysisTactile Slip DetectionVision-based Slip Detection
Integration of visual and tactile data enables deeper understanding of the grasping process and analysis of grasping issues. The article introduces a visual–tactile multimodal grasp dataset to advance robotic manipulation research, outlines its construction, and indicates future work on visual and tactile data. The dataset, comprising 2,550 multimodal samples collected with Intel’s Eagle Shoal dexterous hand, was analyzed using short‑time Fourier transform and slip detection via LSTM, which was benchmarked against traditional classifiers across varied grasp directions and objects. The study demonstrates that the dataset enables effective slip detection and that LSTM models generalize well across different grasp directions and objects.
This article introduces a visual–tactile multimodal grasp data set, aiming to further the research on robotic manipulation. The data set was built by the novel designed dexterous robot hand, the Intel’s Eagle Shoal robot hand (Intel Labs China, Beijing, China). The data set contains 2550 sets data, including tactile, joint, time label, image, and RGB and depth video. With the integration of visual and tactile data, researchers could be able to better understand the grasping process and analyze the deeper grasping issues. In this article, the building process of the data set was introduced, as well as the data set composition. In order to evaluate the quality of data set, the tactile data were analyzed by short-time Fourier transform. The tactile data–based slip detection was realized by long short-term memory and contrasted with visual data. The experiments compared the long short-term memory with the traditional classifiers, and generalization ability on different grasp directions and different objects is implemented. The results have proved that the data set’s value in promoting research on robotic manipulation area showed the effective slip detection and generalization ability of long short-term memory. Further work on visual and tactile data will be devoted to in the future.
18
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Marti A. Hearst, Susan Dumais, E. Osuna et al. · IEEE Intelligent Systems and their Applications · 1998 · 6.9K citations
Data-Driven Grasp Synthesis—A Survey
IEEE Transactions on Robotics · 2014 · 851 citations · Full text