An Ensemble DCNNs-Based Regression Model for Automatic Facial Beauty Prediction and Analyzation

Jwan Najeeb Saeed, Adnan Mohsin Abdulazeez, Dheyaa Ahmed Ibrahim

Traitement du signal · 2023 · 22 citations · 22 references

DOIFull text

Open access

Concepts

Abstract

One of the most effective social aspects of the human face is its attractiveness.Automatic facial beauty prediction (FBP) is an emerging research area that has gained much interest recently.However, identifying the significant facial traits and attributes that can contribute to the process of beauty attractiveness estimation is one of the main challenges in this research area.Furthermore, learning the beauty pattern from a relatively small, imbalanced dataset is another concern that needs to be addressed.This research proposes an ensemblebased regression model that integrates judgments made by three various DCNNs, each with a different structure representation.The proposed method efficiently predicts the beauty score by leveraging the strengths of each network as a complementary data source, and it draws attention to the most important beauty-related face features through the Gradientweighted Class Activation Mapping (Grad-CAM).The findings are promising, demonstrating the efficiency of fusing the decision of multiple predictors of the proposed ensemble DCNNs regression models that is significantly consistent with the ground truth of the employed datasets (SCUT-FBP, SCUT-FBP5500, and ME Beauty).Moreover, it can assist in comprehending the relationship between facial characteristics and the impression of attractiveness.

References

22