Advanced Intelligent Systems · 2021 · 19 citations · 7 references
ComputingAutonomous SystemsComputer ScienceAutonomous VehiclesComputer VisionMachine LearningOptical FlowPoint Cloud ProcessingRobotic VisionScene ReconstructionScene UnderstandingVehicle PerceptionGenerative Adversarial NetworksPoint Cloud GenerationPoint Cloud Scene UnderstandingScene FlowSelf-similar Structures
Scene flow tracks the 3D motion of each point in adjacent point clouds. It provides fundamental 3D motion perception for autonomous driving and server robot. Although red green blue depth (RGBD) camera or light detection and ranging (LiDAR) capture discrete 3D points in space, the objects and motions usually are continuous in the macroworld. That is, the objects keep themselves consistent as they flow from the current frame to the next frame. Based on this insight, the generative adversarial networks (GAN) is utilized to self‐learn 3D scene flow without ground truth. The fake point cloud is synthesized from the predicted scene flow and the point cloud of the first frame. The adversarial training of the generator and discriminator is realized through synthesizing indistinguishable fake point cloud and discriminating the real point cloud and the synthesized fake point cloud. The experiments on Karlsruhe Institute of Technology and Toyota Technological Institute (KITTI) dataset show that our method realizes promising results. Just as human, the proposed method can identify the similar local structures of two adjacent frames even without knowing the ground truth scene flow. Then, the local correspondence can be correctly estimated, and further the scene flow is correctly estimated. An interactive preprint version of the article can be found here: https://www.authorea.com/doi/full/10.22541/au.163335790.03073492 .
7
Advances in Neural Information Processing Systems 29
Onur Teymur, Kostas Zygalakis, Ben Calderhead · 2016 · 13.5K citations
Sparse scene flow segmentation for moving object detection in urban environments
Philip Lenz, Julius Ziegler, Andreas Geiger et al. · 2011 · 129 citations
A primal-dual framework for real-time dense RGB-D scene flow
Mariano Jaimez, Mohamed Souiai, Javier González-Jiménez et al. · 2015 · 113 citations
Hierarchical Attention Learning of Scene Flow in 3D Point Clouds
Guangming Wang, Xinrui Wu, Zhe Liu et al. · IEEE Transactions on Image Processing · 2021 · 73 citations · Full text