论文标题

情绪感知的变压器编码器,用于同理心对话生成

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

论文作者

Goel, Raman, Susan, Seba, Vashisht, Sachin, Dhanda, Armaan

论文摘要

现代对话代理人经过训练,以模仿人类交流的方式。要与用户进行情感联系,这些虚拟代理需要意识到用户的情感状态。变形金刚是序列到序列学习的最新技术状态,涉及培训用词嵌入的编码器模型训练来自Tusterance-Response对的单词嵌入模型。我们提出了一种情感感知的变压器编码器,用于捕获用户话语中的情感商,以产生类似人类的善解人意的反应。 The contributions of our paper are as follows: 1) An emotion detector module trained on the input utterances determines the affective state of the user in the initial phase 2) A novel transformer encoder is proposed that adds and normalizes the word embedding with emotion embedding thereby integrating the semantic and affective aspects of the input utterance 3) The encoder and decoder stacks belong to the Transformer-XL architecture which is the recent state of the语言建模中的艺术。与现有方法相比,基准的Facebook AI同理对话数据集进行的实验证实了我们模型对生成的响应获得的较高BLEU-4分数的功效。现在,情感上聪明的虚拟代理已经成为现实,并且在不久的将来预见了所有人类机器界面中的情感。

Modern day conversational agents are trained to emulate the manner in which humans communicate. To emotionally bond with the user, these virtual agents need to be aware of the affective state of the user. Transformers are the recent state of the art in sequence-to-sequence learning that involves training an encoder-decoder model with word embeddings from utterance-response pairs. We propose an emotion-aware transformer encoder for capturing the emotional quotient in the user utterance in order to generate human-like empathetic responses. The contributions of our paper are as follows: 1) An emotion detector module trained on the input utterances determines the affective state of the user in the initial phase 2) A novel transformer encoder is proposed that adds and normalizes the word embedding with emotion embedding thereby integrating the semantic and affective aspects of the input utterance 3) The encoder and decoder stacks belong to the Transformer-XL architecture which is the recent state of the art in language modeling. Experimentation on the benchmark Facebook AI empathetic dialogue dataset confirms the efficacy of our model from the higher BLEU-4 scores achieved for the generated responses as compared to existing methods. Emotionally intelligent virtual agents are now a reality and inclusion of affect as a modality in all human-machine interfaces is foreseen in the immediate future.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源