IEEE Robotics and Automation Letters · 2023 · 13 citations · 25 references
ComputingComputer ScienceRobotics EngineeringComputer VisionMachine LearningRobot PerceptionDeep LearningDepth EstimationPoint Cloud ProcessingRobotic VisionScene UnderstandingSemantic SegmentationConvolutional Neural Network SegmentationConvolutional Neural NetworksExteroceptive SensingPoint Cloud SegmentationSelf-supervised Depth EstimationSelf-supervised Learning For Point CloudsSelf-supervised PretrainingSelf-supervised Segmentation
Mobile ground robots require perceiving and understanding their surrounding support surface to move around autonomously and safely. The support surface is commonly estimated based on exteroceptive depth measurements, e.g., from LiDARs. However, the measured depth fails to align with the true support surface in the presence of high grass or other penetrable vegetation. In this work, we present the semantic pointcloud filter (SPF), a convolutional neural network (CNN) that learns to adjust LiDAR measurements to align with the underlying support surface. The SPF is trained in a semi-self-supervised manner and takes as an input a LiDAR pointcloud and RGB image. The network predicts a binary segmentation mask that identifies the specific points requiring adjustment, along with estimating their corresponding depth values. To train the segmentation task, 464 distinct images are manually labeled into rigid and non-rigid terrain. The depth estimation task is trained in a self-supervised manner by utilizing the future footholds of the robot to estimate the support surface based on a Gaussian process. Our method can correctly adjust the support surface prior to interacting with the terrain and is extensively tested on the quadruped robot ANYmal. We show the qualitative benefits of SPF in natural environments for elevation mapping and traversability estimation compared to using raw sensor measurements and existing smoothing methods. Quantitative analysis is performed in various natural environments, and an improvement by 48% RMSE is achieved within a meadow terrain.
25
Fully convolutional networks for semantic segmentation
Jonathan Long, Evan Shelhamer, Trevor Darrell · 2015 · 36.9K citations
Decoupled Weight Decay Regularization
Ilya Loshchilov, Frank Hutter · arXiv (Cornell University) · 2017 · 9.1K citations · Full text
An Easy-to-Use Airborne LiDAR Data Filtering Method Based on Cloth Simulation
Wuming Zhang, Jianbo Qi, Peng Wan et al. · Remote Sensing · 2016 · 1.5K citations · Full text
Learning robust perceptive locomotion for quadrupedal robots in the wild
Takahiro Miki, Joonho Lee, Jemin Hwangbo et al. · Science Robotics · 2022 · 733 citations · Full text