Sensors · 2021 · 16 citations · 58 references
ComputingComputer EngineeringComputer ScienceComputer VisionMachine VisionSensorsDigital Image ProcessingFace RecognitionImage ClassificationImage ProcessingPattern RecognitionSmart SensorsFace Feature ExtractionHistogram Of Oriented GradientsImage Feature ExtractionLocal Binary PatternsLocal Feature DescriptorsLocal Feature DetectionParasitic ExtractionPixel Architecture
In this paper, we present the architecture of a smart imaging sensor (SIS) for face recognition, based on a custom-design smart pixel capable of computing local spatial gradients in the analog domain, and a digital coprocessor that performs image classification. The SIS uses spatial gradients to compute a lightweight version of local binary patterns (LBP), which we term ringed LBP (RLBP). Our face recognition method, which is based on Ahonen's algorithm, operates in three stages: (1) it extracts local image features using RLBP, (2) it computes a feature vector using RLBP histograms, (3) it projects the vector onto a subspace that maximizes class separation and classifies the image using a nearest neighbor criterion. We designed the smart pixel using the TSMC 0.35 μm mixed-signal CMOS process, and evaluated its performance using postlayout parasitic extraction. We also designed and implemented the digital coprocessor on a Xilinx XC7Z020 field-programmable gate array. The smart pixel achieves a fill factor of 34% on the 0.35 μm process and 76% on a 0.18 μm process with 32 μm × 32 μm pixels. The pixel array operates at up to 556 frames per second. The digital coprocessor achieves 96.5% classification accuracy on a database of infrared face images, can classify a 150×80-pixel image in 94 μs, and consumes 71 mW of power.
58
Understanding sources of inefficiency in general-purpose chips
Rehan Hameed, Wajahat Qadeer, Megan Wachs et al. · 2010 · 394 citations