论文标题

成年人作为对对比学习的面部情感识别儿童的增强

Adults as Augmentations for Children in Facial Emotion Recognition with Contrastive Learning

论文作者

Virgolin, Marco, De Lorenzo, Andrea, Alderliesten, Tanja, Bosman, Peter A. N.

论文摘要

儿童的情绪识别可以帮助在癌症治疗等压力很大的情况下早期识别和干预心理并发症。尽管深度学习模型越来越多地被采用,但数据稀缺通常是小儿医学中的问题,包括儿童面部情绪识别。在本文中,我们研究了基于数据增强的对比学习的应用,以克服儿童面部情绪识别中的数据稀缺性。我们通过将大量可用的成人数据添加到小儿数据中来学习更好的表示形式来探讨忽略世代间隙的想法。我们研究了可以与儿童一起使用的成年面部表情图像的不同方式。特别是,我们建议将每个小批量的成人图像中明确纳入儿童的增强。在学习方法和培训套件尺寸的$ 84 $组合中,我们发现对拟议培训计划的监督对比学习表现最佳,达到了通常超过第二好的方法之一的测试准确性,高于2%至3%。我们的结果表明,可以将成人数据视为儿科数据的有意义的增强,以识别儿童情绪表达的表达,并通过补充与成年人的儿童的儿童数据相辅相成,为对比的其他学习进行了其他应用,以改善儿科护理。

Emotion recognition in children can help the early identification of, and intervention on, psychological complications that arise in stressful situations such as cancer treatment. Though deep learning models are increasingly being adopted, data scarcity is often an issue in pediatric medicine, including for facial emotion recognition in children. In this paper, we study the application of data augmentation-based contrastive learning to overcome data scarcity in facial emotion recognition for children. We explore the idea of ignoring generational gaps, by adding abundantly available adult data to pediatric data, to learn better representations. We investigate different ways by which adult facial expression images can be used alongside those of children. In particular, we propose to explicitly incorporate within each mini-batch adult images as augmentations for children's. Out of $84$ combinations of learning approaches and training set sizes, we find that supervised contrastive learning with the proposed training scheme performs best, reaching a test accuracy that typically surpasses the one of the second-best approach by 2% to 3%. Our results indicate that adult data can be considered to be a meaningful augmentation of pediatric data for the recognition of emotional facial expression in children, and open up the possibility for other applications of contrastive learning to improve pediatric care by complementing data of children with that of adults.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源