论文标题
动态图神经网络的强大知识适应
Robust Knowledge Adaptation for Dynamic Graph Neural Networks
论文作者
论文摘要
图结构化数据通常具有自然界的动态字符。近年来见证了用于建模图形数据的动态图神经网络所付出的不断增加的注意力。但是,几乎所有现有的方法都基于这样的假设,即在建立新链接后,相邻节点的嵌入应进行更新以学习时间动态。然而,这些方法面临以下限制:如果新连接引入的节点包含嘈杂的信息,那么将其知识传播到其他节点变得不可靠,甚至可能导致模型崩溃。在本文中,我们提出了ADA-DYGNN:通过增强动态图神经网络的强化知识适应框架。与以前的方法相反,在添加新链接后,它立即更新邻居节点的嵌入方式,ADA-DYGNN自适应地确定应更新哪些节点。考虑到更新一个邻居节点的嵌入的决定可以显着影响其他邻居节点,因此我们将节点更新选择概念化为序列决策问题,并采用强化学习来有效地解决它。通过这种方式,我们可以将知识自适应地传播到其他节点,以学习强大的节点嵌入表示。据我们所知,我们的方法是通过专门针对动态图神经网络量身定制的强化学习来探索强大知识适应的首次尝试。在三个基准数据集上进行的广泛实验表明,ADA-DYGNN实现了最先进的性能。此外,我们通过在数据集中引入不同程度的噪声来进行实验,并定量和定性地说明ADA-DYGNN的鲁棒性。
Graph structured data often possess dynamic characters in nature. Recent years have witnessed the increasing attentions paid to dynamic graph neural networks for modelling graph data. However, almost all existing approaches operate under the assumption that, upon the establishment of a new link, the embeddings of the neighboring nodes should undergo updates to learn temporal dynamics. Nevertheless, these approaches face the following limitation: If the node introduced by a new connection contains noisy information, propagating its knowledge to other nodes becomes unreliable and may even lead to the collapse of the model. In this paper, we propose Ada-DyGNN: a robust knowledge Adaptation framework via reinforcement learning for Dynamic Graph Neural Networks. In contrast to previous approaches, which update the embeddings of the neighbor nodes immediately after adding a new link, Ada-DyGNN adaptively determines which nodes should be updated. Considering that the decision to update the embedding of one neighbor node can significantly impact other neighbor nodes, we conceptualize the node update selection as a sequence decision problem and employ reinforcement learning to address it effectively. By this means, we can adaptively propagate knowledge to other nodes for learning robust node embedding representations. To the best of our knowledge, our approach constitutes the first attempt to explore robust knowledge adaptation via reinforcement learning specifically tailored for dynamic graph neural networks. Extensive experiments on three benchmark datasets demonstrate that Ada-DyGNN achieves the state-of-the-art performance. In addition, we conduct experiments by introducing different degrees of noise into the dataset, quantitatively and qualitatively illustrating the robustness of Ada-DyGNN.