论文标题
部分可观测时空混沌系统的无模型预测
Efficiently Leveraging Multi-level User Intent for Session-based Recommendation via Atten-Mixer Network
论文作者
论文摘要
基于会话的建议(SBR)旨在根据简短和动态会议来预测用户的下一个操作。最近,人们对利用各种精心设计的图形神经网络(GNN)的兴趣越来越多,以捕获项目之间的配对关系,似乎暗示了更复杂的模型的设计是改善经验性能的灵丹妙药。但是,这些模型随着模型复杂性的指数增长而实现了相对边缘的改进。在本文中,我们剖析了基于GNN的经典SBR模型,并从经验上发现一些复杂的GNN传播是冗余的,鉴于读出模块在基于GNN的模型中起着重要作用。基于此观察结果,我们直观地建议删除GNN传播部分,而读取模块将在模型推理过程中承担更多责任。为此,我们提出了多级注意混合网络(Atten-mixer),该网络利用概念视图和实例视图读数来实现对项目过渡的多级推理。由于简单地列举所有可能的高级概念对于大型现实世界推荐系统来说是不可行的,因此我们进一步结合了与SBR相关的电感偏见,即局部不变性和固有的优先级,以修剪搜索空间。在三个基准上进行的实验证明了我们提议的有效性和效率。自2021年4月以来,我们还已经向大规模的电子商务在线服务推出了拟议的技术,在有关实时流量的在线实验中证明了顶级业务指标的显着改善。
Session-based recommendation (SBR) aims to predict the user's next action based on short and dynamic sessions. Recently, there has been an increasing interest in utilizing various elaborately designed graph neural networks (GNNs) to capture the pair-wise relationships among items, seemingly suggesting the design of more complicated models is the panacea for improving the empirical performance. However, these models achieve relatively marginal improvements with exponential growth in model complexity. In this paper, we dissect the classical GNN-based SBR models and empirically find that some sophisticated GNN propagations are redundant, given the readout module plays a significant role in GNN-based models. Based on this observation, we intuitively propose to remove the GNN propagation part, while the readout module will take on more responsibility in the model reasoning process. To this end, we propose the Multi-Level Attention Mixture Network (Atten-Mixer), which leverages both concept-view and instance-view readouts to achieve multi-level reasoning over item transitions. As simply enumerating all possible high-level concepts is infeasible for large real-world recommender systems, we further incorporate SBR-related inductive biases, i.e., local invariance and inherent priority to prune the search space. Experiments on three benchmarks demonstrate the effectiveness and efficiency of our proposal. We also have already launched the proposed techniques to a large-scale e-commercial online service since April 2021, with significant improvements of top-tier business metrics demonstrated in the online experiments on live traffic.