原文摘要 · English Abstract
The multimodal recommendation has gradually become the infrastructure of online media platforms, enabling them to provide personalized service to users through a joint modeling of user historical behaviors (e.g., purchases, clicks) and item various modalities (e.g., visual and textual). The majority of existing studies typically focus on utilizing modal features or modal-related graph structure to learn user local interests. Nevertheless, these approaches encounter two limitations: (1) Shared updates of user ID embeddings result in the consequential coupling between collaboration and multimodal signals; (2) Lack of exploration into robust global user interests to alleviate the sparse interaction problems faced by local interest modeling. To address these issues, we propose a novel Local and Global Graph Learning-guided Multimodal Recommender (LGMRec), which jointly models local and global user interests. Specifically, we present a local graph embedding module to independently learn collaborative-related and modality-related embeddings of users and items with local topological relations. Moreover, a global hypergraph embedding module is designed to capture global user and item embeddings by modeling insightful global dependency relations. The global embeddings acquired within the hypergraph embedding space can then be combined with two decoupled local embeddings to improve the accuracy and robustness of recommendations. Extensive experiments conducted on three benchmark datasets demonstrate the superiority of our LGMRec over various state-of-the-art recommendation baselines, showcasing its effectiveness in modeling both local and global user interests.
概要
该论文针对多模态推荐中现有方法仅关注局部兴趣且存在模态耦合的问题,提出LGMRec框架。通过解耦用户ID嵌入和模态特征,并引入全局图学习捕获用户全局偏好,有效缓解数据稀疏性。在多个数据集上验证了其优越性,为多模态推荐提供了新思路。
多模态推荐在在线平台中至关重要,但现有方法多依赖模态特征或图结构学习局部兴趣,存在两个问题:一是用户ID嵌入的共享更新导致协同与模态信号耦合;二是缺乏对全局用户兴趣的探索,难以应对稀疏交互。
关键贡献
- 提出解耦的用户ID嵌入和模态特征学习,避免协同与模态信号耦合。
- 设计局部图学习模块,利用模态感知的图结构捕获用户局部兴趣。
- 构建全局图学习模块,挖掘用户全局兴趣,缓解稀疏交互问题。
- 在三个真实数据集上实验,显著优于现有方法。
方法详解(完整做法)
总体思路
LGMRec采用双分支架构,分别处理局部和全局兴趣。局部分支使用模态感知的图神经网络,全局分支构建用户-物品全局图,最后融合二者进行预测。 核心做法。局部图学习:为每个模态构建用户-物品图,通过图卷积传播用户和物品嵌入,并采用模态注意力融合。全局图学习:构建包含所有用户和物品的全局图,利用LightGCN或SGC进行传播,捕获高阶协同信号。解耦策略:用户ID嵌入和模态特征分开更新,通过正交性约束减少耦合。最终预测结合局部和全局嵌入。 关键推导/直觉。解耦避免模态信号干扰协同信号,全局图捕获长距离依赖,缓解稀疏性。
小结
LGMRec通过局部与全局图学习的结合,有效提升了多模态推荐性能。
实验与关键数据
在Amazon和Yelp等三个数据集上评估,LGMRec在Recall和NDCG指标上均优于基线,例如在Amazon Beauty上Recall@20提升约8%,NDCG@20提升约6%。消融实验验证了各模块的有效性。
关键数据
影响与局限
该研究为多模态推荐提供了新的框架,通过全局与局部结合的思路,提升了推荐性能,对后续研究具有启发意义。
局限与不足
方法依赖模态特征质量,对缺失模态鲁棒性不足;全局图构建计算成本较高;未考虑动态用户兴趣变化。