skip to main content
research-article

Learning Informative Priors from Heterogeneous Domains to Improve Recommendation in Cold-Start User Domains

Published: 12 December 2016 Publication History

Abstract

In the real-world environment, users have sufficient experience in their focused domains but lack experience in other domains. Recommender systems are very helpful for recommending potentially desirable items to users in unfamiliar domains, and cross-domain collaborative filtering is therefore an important emerging research topic. However, it is inevitable that the cold-start issue will be encountered in unfamiliar domains due to the lack of feedback data. The Bayesian approach shows that priors play an important role when there are insufficient data, which implies that recommendation performance can be significantly improved in cold-start domains if informative priors can be provided. Based on this idea, we propose a Weighted Irregular Tensor Factorization (WITF) model to leverage multi-domain feedback data across all users to learn the cross-domain priors w.r.t. both users and items. The features learned from WITF serve as the informative priors on the latent factors of users and items in terms of weighted matrix factorization models. Moreover, WITF is a unified framework for dealing with both explicit feedback and implicit feedback. To prove the effectiveness of our approach, we studied three typical real-world cases in which a collection of empirical evaluations were conducted on real-world datasets to compare the performance of our model and other state-of-the-art approaches. The results show the superiority of our model over comparison models.

References

[1]
B. Li, Q. Yang, and X. Xue. 2009b. Transfer learning for collaborative filtering via a rating-matrix generative model. In Proceedings of the 26th Annual International Conference on Machine Learning, ACM, 1553454, 617--624.
[2]
N. N. Liu and Q. Yang. 2008. Eigenrank: A ranking-oriented approach to collaborative filtering. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Singapore, Singapore2008 ACM, 1390351, 83--90.
[3]
M. Long, J. Wang, G. Ding, W. Cheng, X. Zhang, and W. Wang. 2012. Dual transfer learning. In Proceedings of the 12th SIAM International Conference on Data Mining 2012, 540--551.
[4]
B. Loni, Y. Shi, M. Larson, and A. Hanjalic. 2014. Cross-domain collaborative filtering with factorization machines. In Advances in Information Retrieval, M. De Rijke, T. Kenter, A. de Vries, C. Zhai, F. de Jong, K. Radinsky, and K. Hofmann (Eds.). Springer International Publishing, 656--661.
[5]
M. Mørup. 2011. Applications of tensor (multiway array) factorizations and decompositions in data mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 1, 24--40.
[6]
P. Niyogi, F. Girosi, and T. Poggio. 1998. Incorporating prior information in machine learning by creating virtual examples. Proc. IEEE 86, 2196--2209.
[7]
R. Pan, Y. Zhou, B. Cao, N. N. Liu, R. Lukose, M. Scholz, and Q. Yang. 2008. One-class collaborative filtering. In Proceedings of the IEEE International Conference on Data Mining. IEEE, 502--511.
[8]
W. Pan, E. W. Xiang, N. N. Liu, and Q. Yang. 2010. Transfer learning in collaborative filtering for sparsity reduction. In Proceedings of the 24th AAAI Conference on Artificial Intelligence 2010.
[9]
I. Porteous, A. U. Asuncion, and M. Welling. 2010. Bayesian matrix factorization with side information and dirichlet process mixtures. In AAAI 2010.
[10]
S. Rendle. 2010. Factorization machines. In Proceedings of the IEEE 10<sup>th</sup> International Conference on Data Mining (ICDM), 2010, 995--1000.
[11]
S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. 2009a. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (Montreal, Quebec, Canada. AUAI Press, 1795167, 452--461.
[12]
S. Rendle, L. B. Marinho, A. Nanopoulos, and L. Schmidt-Thieme. 2009b. Learning optimal ranking with tensor factorization for tag recommendation. In Proceedings of the 15th ACM SIGKDD International Conference On Knowledge Discovery and Data Mining, ACM, 1557100, 727--736.
[13]
S. Rendle and L. Schmidt-Thieme. 2010. Pairwise interaction tensor factorization for personalized tag recommendation. In Proceedings of the 3rd ACM International Conference on Web Search and Data Mining. ACM, 1718498, 81--90.
[14]
P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom, and J. Riedl. 1994. Grouplens: An open architecture for collaborative filtering of netnews. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work, ACM, 192905, 175--186.
[15]
R. Salakhutdinov and A. Mnih. 2008. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems 2008, 1257--1264.
[16]
R. Salakhutdinov, A. Mnih, and G. Hinton. 2007. Restricted boltzmann machines for collaborative filtering. In Proceedings of the 24th International Conference on Machine Learning. ACM, 1273596, 791--798.
[17]
B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web, ACM, 372071, 285--295.
[18]
A. I. Schein, A. Popescul, L. H. Ungar and D. M. Pennock. 2002. Methods and metrics for cold-start recommendations. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, ACM, 564421, 253--260.
[19]
A. P. Singh and G. J. Gordon. 2008. Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Las Vegas, Nevada, USA2008 ACM, 1401969, 650--658.
[20]
N. Srebro and T. Jaakkola. 2003. Weighted low-rank approximations. In Proceedings of the 20th International Conference on Machine Learning, 720.
[21]
N. Srebro, J. D. M. Rennie, and T. Jaakkola. 2005. Maximum-margin matrix factorization. In Advances in Neural Information Processing Systems 1329--1336.
[22]
X. Su and T. M. Khoshgoftaar. 2009. A survey of collaborative filtering techniques. Advances in Artificial Intelligence, 19.
[23]
J. Tang, H. Gao, H. Liu, and A. D. Sarma. 2012. Etrust: Understanding trust evolution in an online world. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, ACM, 2339574, 253--261.
[24]
K. Train. 2003. Discrete Choice Methods with Simulation. Cambridge University Press.
[25]
P. Vincent, H. Larochelle, Y. Bengio, and P. A. Manzagol. 2008. Extracting and composing robust features with denoising autoencoders. In Proceedings of the 25th International Conference on Machine Learning, ACM, 1390294, 1096--1103.
[26]
L. Xiong, X. Chen, T. K. Huang, J. Schneider, and J. G. Carbonell. 2010. Temporal collaborative filtering with Bayesian probabilistic tensor factorization. In Proceedings of SIAM Data Mining 2010.
[27]
Z. H. Zhou and X. Y. Liu. 2010. On multi-class cost-sensitive learning. Computat Intel 26, 232--257.

Cited By

View all
  • (2024)Broad Recommender System: An Efficient Nonlinear Collaborative Filtering ApproachIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.33785998:4(2843-2857)Online publication date: Aug-2024
  • (2024)Broad collaborative filtering with adjusted cosine similarity by fusing matrix completionApplied Soft Computing10.1016/j.asoc.2024.112075165(112075)Online publication date: Nov-2024
  • (2023)A cross-domain recommendation model by unified modelling high-order information and rating informationJournal of Information Science10.1177/01655515231182068Online publication date: 8-Jul-2023
  • Show More Cited By

Index Terms

  1. Learning Informative Priors from Heterogeneous Domains to Improve Recommendation in Cold-Start User Domains

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Information Systems
      ACM Transactions on Information Systems  Volume 35, Issue 2
      April 2017
      232 pages
      ISSN:1046-8188
      EISSN:1558-2868
      DOI:10.1145/3001595
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 12 December 2016
      Accepted: 01 July 2016
      Revised: 01 May 2016
      Received: 01 August 2015
      Published in TOIS Volume 35, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Recommender systems
      2. cross-domain collaborative filtering
      3. multi-task learning
      4. probabilistic matrix factorization
      5. weighted irregular tensor factorization

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)18
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 14 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Broad Recommender System: An Efficient Nonlinear Collaborative Filtering ApproachIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2024.33785998:4(2843-2857)Online publication date: Aug-2024
      • (2024)Broad collaborative filtering with adjusted cosine similarity by fusing matrix completionApplied Soft Computing10.1016/j.asoc.2024.112075165(112075)Online publication date: Nov-2024
      • (2023)A cross-domain recommendation model by unified modelling high-order information and rating informationJournal of Information Science10.1177/01655515231182068Online publication date: 8-Jul-2023
      • (2023)Cross-domain Recommendation via Dual Adversarial AdaptationACM Transactions on Information Systems10.1145/363252442:3(1-26)Online publication date: 11-Nov-2023
      • (2023)RESUS: Warm-up Cold Users via Meta-learning Residual User Preferences in CTR PredictionACM Transactions on Information Systems10.1145/356428341:3(1-26)Online publication date: 7-Feb-2023
      • (2023)User Cold Start Problem in Recommendation Systems: A Systematic ReviewIEEE Access10.1109/ACCESS.2023.333870511(136958-136977)Online publication date: 2023
      • (2022)perCLTV: A General System for Personalized Customer Lifetime Value Prediction in Online GamesACM Transactions on Information Systems10.1145/353001241:1(1-29)Online publication date: 23-Apr-2022
      • (2022)Approaches and algorithms to mitigate cold start problems in recommender systems: a systematic literature reviewJournal of Intelligent Information Systems10.1007/s10844-022-00698-559:2(341-366)Online publication date: 23-Apr-2022
      • (2021)Interactive Sequential Basket Recommendation by Learning Basket Couplings and Positive/Negative FeedbackACM Transactions on Information Systems10.1145/344436839:3(1-26)Online publication date: 23-Feb-2021
      • (2021)Exploiting Category-Level Multiple Characteristics for POI RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2021.3088148(1-1)Online publication date: 2021
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media