2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) · 2022 · 33 citations · 39 references
ComputingComputer ScienceData ScienceBiomedical Signal ProcessingComputer VisionMachine LearningBiomedical Signal ModelingCardiovascular MonitoringDeep LearningMotion CaptureSignal ProcessingVideo RecordingEfficiency MetricsHeart RateHeart Rate MonitoringIncremental AggregationPhotoplethysmogram Signal ProcessingPhotoplethysmographyRemote Cardiac MonitoringSpatio-temporal Representation
We present a lightweight neural model for remote heart rate estimation focused on the efficient spatio-temporal learning of facial photoplethysmography (PPG) based on i) modelling of PPG dynamics by combinations of multiple convolutional derivatives, and ii) increased flexibility of the model to learn possible offsets between the facial video PPG and the ground truth. PPG dynamics are modelled by a Temporal Derivative Module (TDM) constructed by the incremental aggregation of multiple convolutional derivatives, emulating a Taylor series expansion up to the desired order. Robustness to ground truth offsets is handled by the introduction of TALOS (Temporal Adaptive LOcation Shift), a new temporal loss to train learning-based models. We verify the effectiveness of our model by reporting accuracy and efficiency metrics on the public PURE and UBFC-rPPG datasets. Compared to existing models, our approach shows competitive heart rate estimation accuracy with a much lower number of parameters and lower computational cost.
39
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
ADADELTA: An Adaptive Learning Rate Method
Matthew D. Zeiler · arXiv (Cornell University) · 2012 · 5.5K citations · Full text
TSM: Temporal Shift Module for Efficient Video Understanding
Ji Lin, Chuang Gan, Song Han · 2019 · 2K citations
Remote plethysmographic imaging using ambient light
Wim Verkruysse, Lars O. Svaasand, J. Stuart Nelson · Optics Express · 2008 · 1.7K citations · Full text