HINRL4Rec: A Novel Integrated Heterogeneous Network Embedding with Reinforcement Learning for Recommendation

Abstract

\n Recent KG-oriented recommendation techniques mainly focus on the direct interaction between entities in the given KGs as the rich information sources for leveraging the quality of recommendation outputs. However, they are still hindered by the heterogeneity, type-varied entities and their relationships in knowledge graphs (KG) as the heterogeneous information networks (HIN). This limitation seems challenging to build up an effective approach for the KG-based recommendation system in both semantic path-based exploitation and heterogeneous information extraction. To meet these challenges, we proposed a novel integrated HIN embedding with reinforcement learning (RL)-based feature engineering for recommendation, called as: HINRL4Rec. First of all, we apply the combined textual meta-path-based embedding approach for learning multiple-rich-schematic representations of user/item and their associated entities. Then, these extracted multi-typed embeddings of user and item entities are fused into the unified embedding spaces during the KG embedding process. Finally, the unified representations of users and items are then used to facilitate the RL-based policy-driven searching process in the next steps for performing the recommendation task. Extensive experiments in real-world datasets demonstrate the effectiveness of our proposed model in comparing with recent state-of-the-art recommendation baselines.