论文标题
使用双标签分布的轻巧的面部吸引力预测
Lightweight Facial Attractiveness Prediction Using Dual Label Distribution
论文作者
论文摘要
面部吸引力预测(FAP)旨在根据人类美学感知自动评估面部吸引力。使用深卷积神经网络的先前方法提高了性能,但是它们的大规模模型导致了灵活性的不足。此外,大多数方法无法充分利用数据集。在本文中,我们提出了一种新颖的端到端FAP方法,该方法集成了双标签分布和轻量级设计。手动评分,吸引力得分和标准偏差已明确构建双标签分布,以充分利用数据集,包括吸引力分布和评级分布。此类分布以及吸引力得分在基于标签分布学习(LDL)范式的联合学习框架下进行了优化。对于轻量级设计,将数据处理简化至最低限度,然后选择MobilenEtV2作为我们的骨干。在两个基准数据集上进行了广泛的实验,我们的方法在其中取得了有希望的结果,并成功地平衡了性能和效率。消融研究表明,我们精心设计的学习模块是必不可少的且相关的。此外,可视化表明我们的方法可以感知面部吸引力并捕获有吸引力的面部区域以促进语义预测。该代码可在https://github.com/enquan/2d_fap上找到。
Facial attractiveness prediction (FAP) aims to assess facial attractiveness automatically based on human aesthetic perception. Previous methods using deep convolutional neural networks have improved the performance, but their large-scale models have led to a deficiency in flexibility. In addition, most methods fail to take full advantage of the dataset. In this paper, we present a novel end-to-end FAP approach that integrates dual label distribution and lightweight design. The manual ratings, attractiveness score, and standard deviation are aggregated explicitly to construct a dual-label distribution to make the best use of the dataset, including the attractiveness distribution and the rating distribution. Such distributions, as well as the attractiveness score, are optimized under a joint learning framework based on the label distribution learning (LDL) paradigm. The data processing is simplified to a minimum for a lightweight design, and MobileNetV2 is selected as our backbone. Extensive experiments are conducted on two benchmark datasets, where our approach achieves promising results and succeeds in balancing performance and efficiency. Ablation studies demonstrate that our delicately designed learning modules are indispensable and correlated. Additionally, the visualization indicates that our approach can perceive facial attractiveness and capture attractive facial regions to facilitate semantic predictions. The code is available at https://github.com/enquan/2D_FAP.