IEEE Transactions on Instrumentation and Measurement · 2023 · 13 citations · 20 references
ComputingComputer ScienceRobotics EngineeringAerial RoboticsComputer VisionRobot VisionMotion EstimationVideo AnalysisVisual TrackingDeep Feature LearningDeep Learning DetectionFeature-based StabilizationImage Feature ExtractionMotion CompensationMotion State EstimationReal-time StabilizationVideo Stabilization
With numerous applications in the field of intelligent unmanned systems for flight patrol, airborne cameras have become crucial tools for measuring and tracking targets. However, the video captured by these cameras is susceptible to external disturbances and jitter, and traditional stabilizers often fail to accurately extract image feature points. Although deep learning approaches can stabilize videos, they are constrained by limited datasets and weak model controllability, making it challenging to achieve real-time performance. We introduce a SuperPoint stabilization framework based on deep learning feature point detection. By combining traditional and deep learning methods, our approach aims to construct a controllable and real-time video stabilizer. First, we extract image feature points using SuperPoint neural network, which is better than traditional manual feature point detector. Second, the extracted image feature points are homogenized. Third, we adopt the pyramid Lucas–Kanade (LK) to improve feature points matching speed and the accuracy for motion estimation. Finally, we define the moving average filter and the Kalman filter, respectively, and combine them to smooth unstable camera trajectories and then output stable video sequences after motion compensation. Experimental results show that our proposed method produces competitive results with current representative methods, and more importantly, it only takes an average of 32 ms to stabilize a frame, which is faster than others.
20
Image quality assessment: from error visibility to structural similarity
Zhou Wang, Alan C. Bovik, Hamid R. Sheikh et al. · IEEE Transactions on Image Processing · 2004 · 56K citations
ORB: An efficient alternative to SIFT or SURF
Ethan Rublee, Vincent Rabaud, Kurt Konolige et al. · 2011 · 10.4K citations
Online Object Tracking: A Benchmark
Yi Wu, Jongwoo Lim, Ming–Hsuan Yang · 2013 · 4.1K citations