论文标题
佛罗伦萨4D面部表达数据集
The Florence 4D Facial Expression Dataset
论文作者
论文摘要
人的面部表情动态变化,因此应通过考虑2D或3D面部变形的时间演变来进行识别 /分析。尽管确实存在丰富的2D视频数据,但在3D中并非如此,在3D中,很少发布3D动态(4D)数据集供公众使用。这种数据稀缺性的负面后果通过当前的基于深度学习的方法来扩大面部表达分析,这些方法需要有效训练大量的Variegate样品。为了平息这种限制,在本文中,我们提出了一个名为Florence 4D的大数据集,该数据集由3D面部模型组成的动态序列,其中合成和真实身份的组合表现出了前所未有的4D面部表情,其中包括经典中性的中性型号过渡,但具有一般的表达方式。所有这些特征均未由任何现有的4D数据集公开,甚至无法通过组合多个数据集来获得它们。我们坚信,向社区公开使用这样的数据语料库将允许设计和实验到现在无法进行调查的新应用程序。为了在某种程度上显示我们数据的难度在不同的身份和不同表达式方面,我们还报告了可以用作基线的拟议数据集的基线实验。
Human facial expressions change dynamically, so their recognition / analysis should be conducted by accounting for the temporal evolution of face deformations either in 2D or 3D. While abundant 2D video data do exist, this is not the case in 3D, where few 3D dynamic (4D) datasets were released for public use. The negative consequence of this scarcity of data is amplified by current deep learning based-methods for facial expression analysis that require large quantities of variegate samples to be effectively trained. With the aim of smoothing such limitations, in this paper we propose a large dataset, named Florence 4D, composed of dynamic sequences of 3D face models, where a combination of synthetic and real identities exhibit an unprecedented variety of 4D facial expressions, with variations that include the classical neutral-apex transition, but generalize to expression-to-expression. All these characteristics are not exposed by any of the existing 4D datasets and they cannot even be obtained by combining more than one dataset. We strongly believe that making such a data corpora publicly available to the community will allow designing and experimenting new applications that were not possible to investigate till now. To show at some extent the difficulty of our data in terms of different identities and varying expressions, we also report a baseline experimentation on the proposed dataset that can be used as baseline.