2024 · 10 citations · 21 references
ComputingComputer ScienceRobotics EngineeringComputer VisionRobot VisionRobotics3D ReconstructionPoint Cloud ProcessingRobotic VisionSurface ReconstructionTactile PerceptionTactile SensingHigh-resolution Tactile SensingObject Surface ReconstructionPhotometric StereoTactile InteractionTactile Sensing For RobotsTactile Sensor CalibrationTactile Sensor DesignTactile Sensors
Accurate perception of the surrounding environment stands as a primary objective for robots. Through tactile interaction, vision-based tactile sensors provide the capability to capture high-resolution and multi-modal surface information of objects, thereby facilitating robots in achieving more dexterous manipulations. However, the prevailing GelSight sensors entail intricate calibration procedures, posing challenges in their application on curved surfaces and requiring the maintenance of stable lighting conditions throughout experimentation. Additionally, constrained by shape and structure, current vision-based tactile sensors are predominantly applied to measurements within a limited area. In this study, we design a novel cylindrical vision-based tactile sensor that enables continuous and swift perception of large-scale object surfaces through rolling. To tackle the challenges posed by laborious calibration processes, we propose a self-supervised photometric stereo method based on deep learning, which eliminates pre-calibration requirements and enables the derivation of surface normals from a single image without relying on stable lighting conditions. Finally, we perform surface reconstruction from normal and point cloud registration on the multiple frames of images obtained by rolling the cylindrical sensor, resulting in large surface reconstruction. We compare our method with the representative lookup table method in the GelSight sensors. The results show that the proposed method enhances both reconstruction accuracy and robustness, thereby demonstrating the potential of the proposed sensor in large-scale surface reconstruction. Codes and mechanical structures are available at: https://github.com/ZhangZhiyuanZhang/GelRoller
21
Fast Point Feature Histograms (FPFH) for 3D registration
Radu Bogdan Rusu, Nico Blodow, Michael Beetz · 2009 · 3.8K citations
Object modelling by registration of multiple range images
Yang Chen, Gérard Medioni · Image and Vision Computing · 1992 · 3.1K citations