Recommending news articles to anonymous users is a common yet challenging task. In recent years, several studies have focused on personalized recommendation based on user multi-interests in anonymous session scenarios. However, these studies neglect to utilize important temporal information within sessions when modeling user multi-interests, such as user browsing duration and news publication time. To address the issue, we propose a time highlighted multi-interest network for session-based news recommendation (TMN-SNR), aiming to explore users’ interests in various aspects of news and their degrees of interest by incorporating temporal information from news sessions, thereby comprehensively and precisely portraying user multi-interests. Specifically, we integrate the diverse content of news and news timeliness, considering the varying durations of users’ news browsing and news publication times, to achieve a comprehensive representation of user multiple interests. We also conduct comparative analyses of the impact of different multi-interest recommendation strategies on news recommendation performance. Furthermore, we propose a negative sampling method that integrates news publication time proximity and content similarity to enhance the representativeness of negative samples and improve model training performance. Experiments based on three real-world datasets and comparisons with baseline model performances prove that our method exhibits higher accuracy.
LüLMedoMYeungCH, et al.Recommender systems. Phys Rep2012; 519: 1–49.
2.
WuCWuFHuangY, et al.Personalized news recommendation: methods and challenges. ACM Trans Inf Syst2023; 41: 1–50.
3.
WangSCaoLWangY, et al.A survey on session-based recommender systems. ACM Comput Surv2021; 54: 1–38.
4.
HidasiBKaratzoglouABaltrunasL, et al.Session-based recommendations with recurrent neural networks. In: Proceedings of the 4th international conference on learning representations, ICLR, San Juan, 2016.
5.
LiJRenPChenZ, et al.Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM conference on information and knowledge management, ACM, New York, 2017, pp. 1419–1428. https://doi.org/10.1145/3132847.3132926.
6.
LiuQZengYMokhosiR, et al.Stamp: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, ACM, New York, 2018, pp. 1831–1839. https://doi.org/10.1145/3219819.3219950.
7.
LiCLiuZWuM, et al.Multi-interest network with dynamic routing for recommendation at Tmall. In: Proceedings of the 28th ACM international conference on information and knowledge management, ACM, New York, 2019, pp. 2615–2623. https://doi.org/10.1145/3357384.3357814.
8.
MaJSunTZhangX. Time highlighted multi-interest network for sequential recommendation. Comput Mater Contin2023; 76: 3569. https://doi.org/10.32604/cmc.2023.040005.
9.
MuCChenJChenY, et al.Multi-interest awareness model for session-based recommendation. In: 2024 IEEE international conference on web services, IEEE, Piscataway, 2024, pp. 1350–1352. https://doi.org/10.1109/ICWS62655.2024.00166.
10.
de Souza Pereira MoreiraGFerreiraFDa CunhaAM. News session-based recommendations using deep neural networks. In: Proceedings of the 3rd workshop on deep learning for recommender systems, ACM, New York, 2018, pp. 15–23. https://doi.org/10.1145/3270323.3270328.
11.
TangGZhuXGuoJ, et al.Time enhanced graph neural networks for session-based recommendation. Knowl Based Syst2022; 251: 109–204.
12.
GongSZhuKQ. Positive, negative and neutral: Modeling implicit feedback in session-based news recommendation. In: Proceedings of the 45th international ACM SIGIR conference on research and development in information retrieval, ACM, New York, 2022, pp. 1185–1195. https://doi.org/10.1145/3477495.3532040.
13.
LiJZhuJBiQ, et al.Miner: multi-interest matching network for news recommendation. In: Findings of the association for computational linguistics, ACL, Stroudsburg, 2022, pp. 343–352. https://doi.org/10.18653/v1/2022.findings-acl.29.
14.
WangRWangSLuW, et al.News recommendation via multi-interest news sequence modelling. In: IEEE international conference on acoustics, speech and signal processing, IEEE, Piscataway, 2022, pp. 7942–7946. https://doi.org/10.1109/ICASSP43922.2022.9747149.
15.
ZhouGZhuXSongC, et al.Deep interest network for click-through rate prediction. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, ACM, New York, 2018, pp. 1059–1068. https://doi.org/10.1145/3219819.3219823.
16.
ZhangQWuBSunZ, et al.Gating augmented capsule network for sequential recommendation. Knowl Based Syst2022; 247: 108817.
17.
ChengYFanYWangY, et al.Accurate multi-interest modeling for sequential recommendation with attention and distillation capsule network. Expert Syst Appl2024; 243: 122887.
18.
XiaoZYangLJiangW, et al.Deep multi-interest network for click-through rate prediction. In: Proceedings of the 29th ACM international conference on information & knowledge management, ACM, New York, 2020, pp. 2265–2268. https://doi.org/10.1145/3340531.3412092.
19.
ZuoZLuJTanL, et al.Knowledge-aware user multi-interest modeling method for news recommendation. Knowl Inf Syst2025; 67: 2911–2933.
20.
SabourSFrosstNHintonGE. Dynamic routing between capsules. In: Advances in neural information processing systems, Curran Associates, Red Hook, 2017, pp. 3856–3866.
21.
CenYZhangJZouX, et al.Controllable multi-interest framework for recommendation. In: Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, ACM, New York, 2020, pp. 2942–2951. https://doi.org/10.1145/3394486.3403344.
22.
WangZShenY. Time-aware multi-interest capsule network for sequential recommendation. In: Proceedings of the 2022 SIAM international conference on data mining, SIAM, Philadelphia, 2022, pp. 558–566. https://doi.org/10.1137/1.9781611977172.63.
23.
LiuTBaoXZhangJ, et al.Enhancing session-based recommendation with multi-interest hyperbolic representation networks. IEEE Trans Neural Netw Learn Syst2024; 36: 10567–10579. https://doi.org/10.1109/TNNLS.2024.3502769.
24.
ZhaoQChenXZhangH, et al.Dynamic hierarchical attention network for news recommendation. Expert Syst Appl2024; 255: 124667.
25.
LiJWangYMcAuleyJ. Time interval aware self-attention for sequential recommendation. In: Proceedings of the 13th international conference on web search and data mining, ACM, New York, 2020, pp. 322–330. https://doi.org/10.1145/3336191.3371786.
26.
WuCWuFQiT, et al.User modeling with click preference and reading satisfaction for news recommendation. In: Proceedings of the 29th international joint conference on artificial intelligence, IJCAI, California, 2020, pp. 3023–3029. https://dl.acm.org/doi/10.5555/3491440.3491858.
27.
ChenYYeWLinC, et al.Unbiased news recommendation model combining time and content. Expert Syst Appl2024; 256: 124864.
28.
ChenCMaWZhangM, et al.Revisiting negative sampling vs. non-sampling in implicit recommendation. ACM Trans Inf Syst2023; 41: 1–25.
29.
YangZDingMHuangT, et al.Does negative sampling matter? A review with insights into its theory and applications. IEEE Trans Pattern Anal Mach Intell2024; 46: 5692–5711. https://doi.org/10.1109/TPAMI.2024.3371473.
30.
WangYHuBYangS, et al.Not all negatives are worth attending to: Meta-bootstrapping negative sampling framework for link prediction. In: Proceedings of the 17th ACM international conference on web search and data mining, ACM, New York, 2024, pp. 760–768. https://doi.org/10.1145/3616855.3635840.
31.
WangCLiuAQinT. Learning-to-rank debias with popularity-weighted negative sampling and popularity regularization. Neurocomputing2024; 587: 127681.
32.
JinBLianDLiuZ, et al.Sampling-decomposable generative adversarial recommender. In: Advances in neural information processing systems, Curran Associates, Red Hook, 2020, Vol. 33. pp. 22629–22639.
33.
WangXXuYHeX, et al.Reinforced negative sampling over knowledge graph for recommendation. In: Proceedings of the web conference 2020, ACM, New York, 2020, pp. 99–109. https://doi.org/10.1145/3366423.3380098.
34.
WangPLiSPanR. Incorporating GAN for negative sampling in knowledge representation learning. In: Proceedings of the AAAI conference on artificial intelligence, AAAI Press, Palo Alto, 2018, Vol. 32. https://doi.org/10.1609/aaai.v32i1.11536.
35.
FanLPuJZhangR, et al.Neighborhood-based hard negative mining for sequential recommendation. In: Proceedings of the 46th international ACM SIGIR conference on research and development in information retrieval, ACM, New York, 2023, pp. 2042–2046. https://doi.org/10.1145/3539618.3591995.
36.
DingJQuanYYaoQ, et al.Simplify and robustify negative sampling for implicit collaborative filtering. In: Advances in neural information processing systems, Curran Associates, Red Hook, 2020, Vol. 33. pp. 1094–1105. https://dl.acm.org/doi/10.5555/3495724.3495817.
37.
MaHXieRMengL, et al.Exploring false hard negative sample in cross-domain recommendation. In: Proceedings of the 17th ACM conference on recommender systems, ACM, New York, 2023, pp. 502–514. https://doi.org/10.1145/3604915.3608791.
38.
LinZFengMSantosCNd, et alA structured self-attentive sentence embedding. In: Proceedings of the 5th international conference on learning representations, ICLR, Toulon, 2017.
39.
VaswaniAShazeerNParmarN, et al.Attention is all you need. In: Advances in neural information processing systems, Curran Associates, Red Hook, 2017, pp. 5998–6008.https://dl.acm.org/doi/10.5555/3295222.3295349.
40.
GullaJAZhangLLiuP, et al.The Adressa dataset for news recommendation. In: Proceedings of the international conference on web intelligence, ACM, New York, 2017, pp. 1042–1048. https://doi.org/10.1145/3106426.3109436.
41.
WuFQiaoYChenJH, et al.Mind: A large-scale dataset for news recommendation. In: Proceedings of the 58th annual meeting of the association for computational linguistics, ACL, Stroudsburg, 2020, pp. 3597–3606. https://doi.org/10.18653/v1/2020.acl-main.331.
42.
SottocornolaGSymeonidisPZankerM. Session-based news recommendations. In: Companion Proceedings of the web conference 2018, ACM, New York, 2018, pp. 1395–1399. https://doi.org/10.1145/3184558.3191582.
43.
GargDGuptaPMalhotraP, et al.Sequence and time aware neighborhood for session-based recommendations: Stan. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, ACM, New York, 2019, pp. 1069–1072. https://doi.org/10.1145/3331184.3331322.
44.
DeyRSalemFM. Gate-variants of gated recurrent unit (GRU) neural networks. In: IEEE 60th international midwest symposium on circuits and systems, IEEE, Piscataway, 2017, pp. 1597–1600. https://doi.org/10.1109/MWSCAS.2017.8053243.
45.
KangWCMcAuleyJ. Self-attentive sequential recommendation. In: 2018 IEEE international conference on data mining, IEEE, Piscataway, 2018, pp. 197–206. https://doi.org/10.1109/ICDM.2018.00035.
46.
ShinYChoiJWiH, et al.An attentive inductive bias for sequential recommendation beyond the self-attention. In: Proceedings of the AAAI conference on artificial intelligence, AAAI Press, Palo Alto, 2024, Vol. 38. pp. 8984–8992. https://doi.org/10.1609/aaai.v38i8.28747.
47.
XuLTianZLiB, et al.Sequence-level semantic representation fusion for recommender systems. In: Proceedings of the 33rd ACM international conference on information and knowledge management, ACM, New York, 2024, pp. 5015–5022.
48.
ChungJGulcehreCChoK, et al.Empirical evaluation of gated recurrent neural networks on sequence modeling. In: NIPS 2014 workshop on deep learning, Curran Associates, Red Hook, 2014.
49.
YangZYangDDyerC, et al.Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies, ACL, Stroudsburg, 2016, pp. 1480–1489. https://doi.org/10.18653/v1/N16-1174.
50.
ArevaloJSolorioTMontes-y GómezM, et al.Gated multimodal units for information fusion. In: Proceedings of the 5th international conference on learning representations, ICLR, Toulon, 2017.
51.
GheiniMRenXMayJ. Cross-attention is all you need: Adapting pretrained transformers for machine translation. In: Proceedings of the 2021 conference on empirical methods in natural language processing, ACL, Stroudsburg, 2021, pp. 1754–1765. https://doi.org/10.18653/v1/2021.emnlp-main.132.
