Graph Neural Networks (GNNs) have been successfully used to learn user and item representations for Collaborative Filtering (CF) based recommendations (GNN-CF). Besides the main recommendation task in a GNN-CF model, contrastive learning is taken as an auxiliary task to learn better representations. Both the main task and the auxiliary task face the noise problem and the distilling hard negative problem. However, existing GNN-CF models only focus on one of them and ignore the other. Aiming to solve the two problems in a unified framework, we propose a Multi-Mixing strategy for GNN-based CF (M2GCF). In the main task, M2GCF perturbs embeddings of users, items and negative items with sample-noise by a mixing strategy. In the auxiliary task, M2GCF utilizes a contrastive learning mechanism with a two-step mixing strategy to construct hard negatives. Extensive experiments on three benchmark datasets demonstrate the effectiveness of the proposed model. Further experimental analysis shows that M2GCF is robust against interaction noise and is accurate for long-tail item recommendations.
B.Alhijawi, Improving collaborative filtering recommender system results and performance using satisfaction degree and emotions of users, Web Intelligence17(3) (2019), 229–241. doi:10.3233/WEB-190415.
2.
J.Chen, H.Dong, X.Wang, F.Feng, M.Wang and X.He, Bias and debias in recommender system: A survey and future directions, 2021, arXiv preprint arXiv:2010.03240.
3.
X.Chen and K.He, Exploring simple Siamese representation learning, in: Proceedings of the 2021 International Conference on Computer Vision and Pattern Recognition, 2021, pp. 15750–15758.
4.
Z.Deng, L.Huang, C.Wang, J.Lai and P.S.Yu, DeepCF: A unified framework of representation learning and matching function learning in recommender system, in: Proceedings of the 33th International Conference on Artificial Intelligence, 2019, pp. 61–68.
5.
W.Feng, J.Zhang, Y.Dong, Y.Han, H.Luan, Q.Xu, Q.Yang, E.Kharlamov and J.Tang, Graph random neural networks for semi-supervised learning on graphs, in: Proceedings of the 2020 International Conference on Neural Information Processing Systems, 2020, pp. 22092–22103.
6.
C.Gao, Y.Zheng, N.Li, Y.Li, Y.Qin, J.Piao, Y.Quan, J.Chang, D.Jin, X.He and Y.Li, Graph neural networks for recommender systems: Challenges, methods, and directions, 2021, arXiv preprint arXiv:2109.12843.
7.
T.Geurts, S.Giannikis and F.Frasincar, Active learning strategies for solving the cold user problem in model-based recommender systems, Web Intelligence18(4) (2021), 269–283. doi:10.3233/WEB-210448.
8.
S.Gidaris, P.Singh and N.Komodakis, Unsupervised representation learning by predicting image rotations, in: Proceedings of the 6th International Conference on Learning Representations.
9.
X.Glorot and Y.Bengio, Understanding the difficulty of training deep feedforward neural networks, in: Proceedings of the 13th International Conference on Artificial Intelligence and Statistics, 2010, pp. 249–256.
10.
J.Grill, F.Strub, F.Altché, C.Tallec, P.H.Richemond, E.Buchatskaya, C.Doersch, B.Á.Pires, Z.Guo, M.G.Azar, B.Piot, K.Kavukcuoglu, R.Munos and M.Valko, Bootstrap your own latent: A new approach to self-supervised learning, in: Proceedings of the 2020 International Conference on Neural Information Processing Systems, 2020, pp. 21271–21284.
11.
W.L.Hamilton, Z.Ying and J.Leskovec, Inductive representation learning on large graphs, in: Proceedings of the 2017 International Conference on Neural Information Processing Systems, 2017, pp. 1024–1034.
12.
K.He, H.Fan, Y.Wu, S.Xie and R.B.Girshick, Momentum contrast for unsupervised visual representation learning, in: Proceedings of the 2020 International Conference on Computer Vision and Pattern Recognition, 2020, pp. 9726–9735.
13.
X.He, K.Deng, X.Wang, Y.Li, Y.Zhang and M.Wang, LightGCN: Simplifying and powering graph convolution network for recommendation, in: Proceedings of the 43th International Conference on Research and Development in Information Retrieval, 2020, pp. 639–648.
14.
X.He, Z.He, X.Du and T.Chua, Adversarial personalized ranking for recommendation, in: Proceedings of the 41th International Conference on Research Development in Information Retrieval, 2018, pp. 355–364.
15.
X.He, L.Liao, H.Zhang, L.Nie, X.Hu and T.Chua, Neural collaborative filtering, in: Proceedings of the 26th International Conference on World Wide Web, 2017, pp. 173–182. doi:10.1145/3038912.3052569.
16.
R.D.Hjelm, A.Fedorov, S.Lavoie-Marchildon, K.Grewal, P.Bachman, A.Trischler and Y.Bengio, Learning deep representations by mutual information estimation and maximization, in: Proceedings of the 7th International Conference on Learning Representations, 2019.
17.
T.Huang, Y.Dong, M.Ding, Z.Yang, W.Feng, X.Wang and J.Tang, MixGCF: An improved training method for graph neural network-based recommender systems, in: Proceedings of the 27th International Conference on Knowledge Discovery and Data Mining, 2021, pp. 665–674.
18.
Y.Kalantidis, M.B.Sariyildiz, N.Pion, P.Weinzaepfel and D.Larlus, Hard negative mixing for contrastive learning, in: Proceedings of the 2020 International Conference on Neural Information Processing Systems, 2020, pp. 21798–21809.
19.
D.P.Kingma and J.Ba, Adam: A method for stochastic optimization, in: Proceedings of the 3th International Conference on Learning Representations, 2015.
20.
T.N.Kipf and M.Welling, Semi-supervised classification with graph convolutional networks, in: Proceedings of the 5th International Conference on Learning Representations, 2017.
21.
Y.Koren, R.Bell and C.Volinsky, Matrix factorization techniques for recommender systems, Computer42(8) (2009), 30–37. doi:10.1109/MC.2009.263.
22.
W.Krichene and S.Rendle, On sampled metrics for item recommendation, in: Proceedings of the 26th International Conference on Knowledge Discovery and Data Mining, 2020, pp. 1748–1757.
23.
K.Lee, Y.Zhu, K.Sohn, C.Li, J.Shin and H.Lee, i-Mix: A domain-agnostic strategy for contrastive representation learning, in: Proceedings of the 9th International Conference on Learning Representations, 2021.
24.
Z.Liu, Y.Ma, Y.Ouyang and Z.Xiong, Contrastive learning for recommender system, 2021, arXiv preprint arXiv:2101.01317.
25.
K.Mao, J.Zhu, J.Wang, Q.Dai, Z.Dong, X.Xiao and X.He, SimpleX: A simple and strong baseline for collaborative filtering, in: Proceedings of the 30th International Conference on Information and Knowledge Management, 2021, pp. 1243–1252.
26.
J.J.McAuley, C.Targett, Q.Shi and A.van den Hengel, Image-based recommendations on styles and substitutes, in: Proceedings of the 38th International Conference on Research and Development in Information Retrieval, 2015, pp. 43–52.
27.
T.Mikolov, I.Sutskever, K.Chen, G.S.Corrado and J.Dean, Distributed representations of words and phrases and their compositionality, in: Proceedings of the 2013 International Conference on Neural Information Processing Systems, 2013, pp. 3111–3119.
28.
S.Rendle, C.Freudenthaler, Z.Gantner and L.Schmidt-Thieme, BPR: Bayesian personalized ranking from implicit feedback, in: Proceedings of the 25th International Conference on Uncertainty in Artificial Intelligence, 2009, pp. 452–461.
29.
Z.Shen, Z.Liu, Z.Liu, M.Savvides and T.Darrell, Un-Mix: Rethinking image mixture for unsupervised visual representation learning, in: Proceedings of the 36th International Conference on Artificial Intelligence, 2022.
30.
X.Tang, H.Yao, Y.Sun, Y.Wang, J.Tang, C.C.Aggarwal, P.Mitra and S.Wang, Investigating and mitigating degree-related biases in graph convoltuional networks, in: Proceedings of the 29th International Conference on Information and Knowledge Management, 2020, pp. 1435–1444.
31.
R.van den Berg, T.N.Kipf and M.Welling, Graph convolutional matrix completion, in: Proceedings of the 23th International Conference on Knowledge Discovery and Data Mining, 2018.
32.
V.Verma, T.Luong, K.Kawaguchi, H.Pham and Q.V.Le, Towards domain-agnostic contrastive learning, in: Proceedings of the 38th International Conference on Machine Learning, 2021, pp. 10530–10541.
33.
D.Walawalkar, Z.Shen, Z.Liu and M.Savvides, Attentive Cutmix: An enhanced data augmentation approach for deep learning based image classification, in: Proceedings of the 2020 International Conference on Acoustics, Speech and Signal Processing, 2020, pp. 3642–3646.
34.
H.Wang, N.Wang and D.Yeung, Collaborative deep learning for recommender systems, in: Proceedings of the 21th International Conference on Knowledge Discovery and Data Mining, 2015, pp. 1235–1244. doi:10.1145/2783258.2783273.
35.
J.Wang, L.Yu, W.Zhang, Y.Gong, Y.Xu, B.Wang, P.Zhang and D.Zhang, IRGAN: A minimax game for unifying generative and discriminative information retrieval models, in: Proceedings of the 40th International Conference on Research and Development in Information Retrieval, 2017, pp. 515–524.
36.
S.Wang, L.Hu, Y.Wang, X.He, Q.Z.Sheng, M.A.Orgun, L.Cao, F.Ricci and P.S.Yu, Graph learning based recommender systems: A review, in: Proceedings of the 30th International Joint Conference on Artificial Intelligence, 2021, pp. 4644–4652.
37.
W.Wang, F.Feng, X.He, L.Nie and T.Chua, Denoising implicit feedback for recommendation, in: Proceedings of the 14th International Conference on Web Search and Data Mining, 2021, pp. 373–381. doi:10.1145/3437963.3441800.
38.
X.Wang, X.He, M.Wang, F.Feng and T.Chua, Neural graph collaborative filtering, in: Proceedings of the 42th International Conference on Research and Development in Information Retrieval, 2019, pp. 165–174.
39.
J.Wu, X.Wang, F.Feng, X.He, L.Chen, J.Lian and X.Xie, Self-supervised graph learning for recommendation, in: Proceedings of the 44th International Conference on Research and Development in Information Retrieval, 2021, pp. 726–735.
40.
X.Xie, F.Sun, Z.Liu, J.Gao, B.Ding and B.Cui, Contrastive pre-training for sequential recommendation, 2021, arXiv preprint arXiv:2010.14395.
41.
H.Xue, X.Dai, J.Zhang, S.Huang and J.Chen, Deep matrix factorization models for recommender systems, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, pp. 3203–3209.
42.
Z.Yang, M.Ding, C.Zhou, H.Yang, J.Zhou and J.Tang, Understanding negative sampling in graph representation learning, in: Proceedings of the 26th International Conference on Knowledge Discovery and Data Mining, 2020, pp. 1666–1676.
43.
R.Ying, R.He, K.Chen, P.Eksombatchai, W.L.Hamilton and J.Leskovec, Graph convolutional neural networks for web-scale recommender systems, in: Proceedings of the 24th International Conference on Knowledge Discovery Data Mining, 2018, pp. 974–983.
44.
Y.You, T.Chen, Y.Sui, T.Chen, Z.Wang and Y.Shen, Graph contrastive learning with augmentations, in: Proceedings of the 2020 International Conference on Neural Information Processing Systems, 2020, pp. 5812–5823.
45.
S.Yun, D.Han, S.Chun, S.J.Oh, Y.Yoo and J.Choe, CutMix: Regularization strategy to train strong classifiers with localizable features, in: Proceedings of the 2019 International Conference on Computer Vision, 2019, pp. 6022–6031.
46.
H.Zhang, M.Cissé, Y.N.Dauphin and D.Lopez-Paz, mixup: Beyond empirical risk minimization, in: Proceedings of the 6th International Conference on Learning Representations, 2018.
47.
L.Zhang, Z.Deng, K.Kawaguchi, A.Ghorbani and J.Zou, How does mixup help with robustness and generalization?, in: Proceedings of the 9th International Conference on Learning Representations, 2021.
48.
W.Zhang, T.Chen, J.Wang and Y.Yu, Optimizing top-n collaborative filtering via dynamic negative item sampling, in: Proceedings of the 36th International Conference on Research and Development in Information Retrieval, 2013, pp. 785–788.
49.
K.Zhou, H.Wang, W.X.Zhao, Y.Zhu, S.Wang, F.Zhang, Z.Wang and J.Wen, S3-Rec: Self-supervised learning for sequential recommendation with mutual information maximization, in: Proceedings of the 29th International Conference on Information and Knowledge Management, 2020, pp. 1893–1902.
50.
X.Zhou, A.Sun, Y.Liu, J.Zhang and C.Miao, SelfCF: A simple framework for self-supervised collaborative filtering, 2021, arXiv preprint arXiv:2010.14395.
