2009 · 96 citations · 20 references
ComputingComputer ScienceComputer VisionMachine VisionSensor Fusion3D ReconstructionMulti-view GeometryPose EstimationScene ReconstructionStereo VisionVisual Tracking3D Object Tracking3D Visual TrackingGreedy HeuristicsGreedy Randomized Adaptive Search ProcedureMulti-camera TrackingMulti-object TrackingMultiple Object TrackingScene Reconstruction From Multiple Views
We propose a multi-object multi-camera framework for tracking large numbers of tightly-spaced objects that rapidly move in three dimensions. We formulate the problem of finding correspondences across multiple views as a multidimensional assignment problem and use a greedy randomized adaptive search procedure to solve this NP-hard problem efficiently. To account for occlusions, we relax the one-to-one constraint that one measurement corresponds to one object and iteratively solve the relaxed assignment problem. After correspondences are established, object trajectories are estimated by stereoscopic reconstruction using an epipolar-neighborhood search. We embedded our method into a tracker-to-tracker multi-view fusion system that not only obtains the three-dimensional trajectories of closely-moving objects but also accurately settles track uncertainties that could not be resolved from single views due to occlusion. We conducted experiments to validate our greedy assignment procedure and our technique to recover from occlusions. We successfully track hundreds of flying bats and provide an analysis of their group behavior based on 150 reconstructed 3D trajectories.
20
Global data association for multi-object tracking using network flows
Li Zhang, Yuan Li, Ramakant Nevatia · 2008 · 941 citations