论文标题
Freeenricher:富含额外费用的面部地标
FreeEnricher: Enriching Face Landmarks without Additional Cost
论文作者
论文摘要
近年来,面部对齐的显着增长。尽管在各种情况(例如,化妆品医学和面部美化)中,高度要求茂密的面部地标,但大多数作品仅考虑稀疏的面部对齐。为了解决这个问题,我们提出了一个框架,可以通过现有的稀疏里程碑数据集丰富地标密度,例如300W,分别为68分,WFLW并以98分。首先,我们观察到沿每个语义轮廓的局部斑块的外观高度相似。然后,我们提出了一个弱监督的想法,即学习原始稀疏地标的精炼能力并适应这种丰富地标的能力。同时,制定并组织了几位运营商来实施这一想法。最后,将经过训练的模型应用于现有面部对齐网络的插件模块。为了评估我们的方法,我们将密集地标在300W测试集上标记。我们的方法不仅可以在新建的密集300W测试集中,而且在原始稀疏300W和WFLW测试集中产生最新的精度,而无需额外的成本。
Recent years have witnessed significant growth of face alignment. Though dense facial landmark is highly demanded in various scenarios, e.g., cosmetic medicine and facial beautification, most works only consider sparse face alignment. To address this problem, we present a framework that can enrich landmark density by existing sparse landmark datasets, e.g., 300W with 68 points and WFLW with 98 points. Firstly, we observe that the local patches along each semantic contour are highly similar in appearance. Then, we propose a weakly-supervised idea of learning the refinement ability on original sparse landmarks and adapting this ability to enriched dense landmarks. Meanwhile, several operators are devised and organized together to implement the idea. Finally, the trained model is applied as a plug-and-play module to the existing face alignment networks. To evaluate our method, we manually label the dense landmarks on 300W testset. Our method yields state-of-the-art accuracy not only in newly-constructed dense 300W testset but also in the original sparse 300W and WFLW testsets without additional cost.