以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：130

、訪客IP：3.138.170.67

姓名	林方瑜(Fang-Yu Lin)  查詢紙本館藏	畢業系所	資訊管理學系
論文名稱	研究基於知識蒸餾與交叉注意力機制之跨領域推薦系統 (A Study of Cross-Domain Recommendation Based on Knowledge Distillation and Cross-Attention)
相關論文	★ 台灣50走勢分析：以多重長短期記憶模型架構為基礎之預測 ★ 以多重遞迴歸神經網路模型為基礎之黃金價格預測分析 ★ 增量學習用於工業4.0瑕疵檢測 ★ 遞回歸神經網路於電腦零組件銷售價格預測之研究 ★ 長短期記憶神經網路於釣魚網站預測之研究 ★ 基於深度學習辨識跳頻信號之研究 ★ Opinion Leader Discovery in Dynamic Social Networks ★ 深度學習模型於工業4.0之機台虛擬量測應用 ★ A Novel NMF-Based Movie Recommendation with Time Decay ★ 以類別為基礎sequence-to-sequence模型之POI旅遊行程推薦 ★ A DQN-Based Reinforcement Learning Model for Neural Network Architecture Search ★ Neural Network Architecture Optimization Based on Virtual Reward Reinforcement Learning ★ 生成式對抗網路架構搜尋 ★ 以漸進式基因演算法實現神經網路架構搜尋最佳化 ★ Enhanced Model Agnostic Meta Learning with Meta Gradient Memory ★ 遞迴類神經網路結合先期工業廢水指標之股價預測研究
檔案	[Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   至系統瀏覽論文 (2029-3-1以後開放)
摘要(中)	隨著電子商務的發展，線上購物已經成為現代生活中不可或缺的一部份，而推薦系 統在這之中扮演著相當重要的角色，然而傳統的推薦系統在資料量較少的領域，容易面 臨到「資料稀疏(Data Sparsity)」與「冷啟動(Cold Start)」問題，跨領域推薦系統能夠很 好的改善這個問題，本研究提出兩個跨領域推薦模型，皆使用自注意機制(Self-attention) 來動態捕捉使用者在不同領域的偏好，並分別使用交叉注意力機制(Cross-attention)與知 識蒸餾(Knowledge Distillation)來將知識從來源領域移轉到目標領域，以改善傳統推薦系 統在目標領域上遇到問題，提升目標領域的推薦效果，最後使用來自現實世界的 Amazon 數據集進行評估，實驗結果顯示與其他跨領域推薦系統相比，我們研究中提出的兩個模 型，在三個指標與兩組資料集上平均提升了 8.49%與 4.78%。
摘要(英)	Recent years have seen a burgeoning of recommender systems and application of that recommender systems to E-commerce. Online shopping has become an indispensable part of modern life. The recommender system plays a crucial role in E-commerce. However, the main difficulty surrounding traditional recommender systems is the data sparsity and cold start issues in the domain with fewer data. In this study, we propose two different cross-domain recommendations, both of which utilize Self-attention to dynamically capture user preferences in different domains and implement Cross-attention and Knowledge Distillation to transfer knowledge from the source domain to the target domain respectively. The major purpose of our models is to improve the problem encountered by the traditional recommendation and enhance the effect of recommendation in the target domain. Last but not least, we utilize the real-world Amazon dataset to evaluate our two models. The experimental results show a striking improvement of our models on two datasets and three evaluation matrices in comparison to other state-of-the-art recommendation models.
關鍵字(中)	★ 跨領域推薦系統 ★ 交叉注意力機制 ★ 知識蒸餾 ★ 資料稀疏 ★ 冷啟動問題	關鍵字(英)	★ Cross-domain Recommendation System ★ Cross-attention ★ Knowledge Distillation ★ Data Sparsity ★ Cold Start Issue
論文目次	摘要 i Abstract ii 誌謝 iii 1. Introduction 1 2. Related Work 6 2-1 Recommendation 6 2-2 Cross-domain Recommendation 7 2-3 Knowledge Distillation 9 3. Proposed model 10 3-1 Cross-Domain Recommendation Based on Cross-Attention 12 3-2 Cross-Domain Recommendation Based on Knowledge Distillation 16 4. Experiment 20 4-1 Evaluation Metrics and Baseline Models 22 4-2 Performance Comparison 25 4-3 Multi-sources Performance Study 27 4-4 Sequence Length Study 29 4-5 Discussion of Temperature and Fusion Ratio on KD-CDRec 30 4-6 Ablation Model Study 31 4-7 Case Study 33 5. Conclusion 35 Reference 36
參考文獻	[1] R. Sirvi, G. Ramu, V. Revelli, G. Kumar, C. J. I. J. o. S. D. Pattnaik, and Research, "The role of E-commerce on customer engagement in 2021," vol. 6, no. 2, pp. 319- 324, 2021. [2] F. Ricci, L. Rokach, and B. J. R. s. h. Shapira, "Recommender systems: introduction and challenges," pp. 1-34, 2015. [3] F. Sun et al., "BERT4Rec: Sequential recommendation with bidirectional encoder representations from transformer," in Proceedings of the 28th ACM international conference on information and knowledge management, 2019, pp. 1441-1450. [4] B. Sarwar, G. Karypis, J. Konstan, and J. Riedl, "Item-based collaborative filtering recommendation algorithms," in Proceedings of the 10th international conference on World Wide Web, 2001, pp. 285-295. [5] Y. Koren, R. Bell, and C. J. C. Volinsky, "Matrix factorization techniques for recommender systems," vol. 42, no. 8, pp. 30-37, 2009. [6] W.-C. Kang and J. McAuley, "Self-attentive sequential recommendation," in 2018 IEEE international conference on data mining (ICDM), 2018, pp. 197-206: IEEE. [7] M. H. Abdi, G. Okeyo, and R. W. Mwangi, "Matrix factorization techniques for context-aware collaborative filtering recommender systems: A survey," 2018. [8] P. Alexandrin, "Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments," in Proceedings of 17th Conference on Uncertainty in Artificial Intelligence, 2001, 2001. [9] B. Hidasi and A. Karatzoglou, "Recurrent neural networks with top-k gains for session-based recommendations," in Proceedings of the 27th ACM international conference on information and knowledge management, 2018, pp. 843-852. 36 [10] B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. J. a. p. a. Tikk, "Session-based recommendations with recurrent neural networks," 2015. [11] L. Wu, S. Li, C.-J. Hsieh, and J. Sharpnack, "SSE-PT: Sequential recommendation via personalized transformer," in Proceedings of the 14th ACM Conference on Recommender Systems, 2020, pp. 328-337. [12] M. H. Mohamed, M. H. Khafagy, and M. H. Ibrahim, "Recommender systems challenges and solutions survey," in 2019 international conference on innovative trends in computer engineering (ITCE), 2019, pp. 149-155: IEEE. [13] R. J. I. A. Mu, "A survey of recommender systems based on deep learning," vol. 6, pp. 69009-69022, 2018. [14] T. Zang, Y. Zhu, H. Liu, R. Zhang, and J. J. A. T. o. I. S. Yu, "A survey on cross- domain recommendation: taxonomies, methods, and future directions," vol. 41, no. 2, pp. 1-39, 2022. [15] M. M. Khan, R. Ibrahim, and I. J. A. C. S. Ghani, "Cross domain recommender systems: a systematic literature review," vol. 50, no. 3, pp. 1-34, 2017. [16] A. P. Singh and G. J. Gordon, "Relational learning via collective matrix factorization," in Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, 2008, pp. 650-658. [17] B. Loni, Y. Shi, M. Larson, and A. Hanjalic, "Cross-domain collaborative filtering with factorization machines," in Advances in Information Retrieval: 36th European Conference on IR Research, ECIR 2014, Amsterdam, The Netherlands, April 13-16, 2014. Proceedings 36, 2014, pp. 656-661: Springer. [18] G. Hu, Y. Zhang, and Q. Yang, "Conet: Collaborative cross networks for cross- domain recommendation," in Proceedings of the 27th ACM international conference on information and knowledge management, 2018, pp. 667-676. 37 [19] H. Kuang, W. Xia, X. Ma, and X. Liu, "Deep matrix factorization for cross-domain recommendation," in 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), 2021, vol. 5, pp. 2171-2175: IEEE. [20] F. Zhu, Y. Wang, C. Chen, J. Zhou, L. Li, and G. J. a. p. a. Liu, "Cross-domain recommendation: challenges, progress, and prospects," 2021. [21] G. Hinton, O. Vinyals, and J. J. a. p. a. Dean, "Distilling the knowledge in a neural network," 2015. [22] Y. Hu, Y. Koren, and C. Volinsky, "Collaborative filtering for implicit feedback datasets," in 2008 Eighth IEEE international conference on data mining, 2008, pp. 263-272: Ieee. [23] J. Li, Y. Ren, and K. Deng, "FairGAN: GANs-based fairness-aware learning for recommendations with implicit feedback," in Proceedings of the ACM Web Conference 2022, 2022, pp. 297-307. [24] A. Van den Oord, S. Dieleman, and B. J. A. i. n. i. p. s. Schrauwen, "Deep content- based music recommendation," vol. 26, 2013. [25] X. He, H. Zhang, M.-Y. Kan, and T.-S. Chua, "Fast matrix factorization for online recommendation with implicit feedback," in Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, 2016, pp. 549-558. [26] T. Tran, K. Lee, Y. Liao, and D. Lee, "Regularizing matrix factorization with user and item embeddings for recommendation," in Proceedings of the 27th ACM international conference on information and knowledge management, 2018, pp. 687-696. [27] S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme, "Factorizing personalized markov chains for next-basket recommendation," in Proceedings of the 19th international conference on World wide web, 2010, pp. 811-820. 38 [28] R. He and J. McAuley, "Fusing similarity models with markov chains for sparse sequential recommendation," in 2016 IEEE 16th international conference on data mining (ICDM), 2016, pp. 191-200: IEEE. [29] X. Chen et al., "Sequential recommendation with user memory networks," in Proceedings of the eleventh ACM international conference on web search and data mining, 2018, pp. 108-116. [30] Z. Liu, Z. Fan, Y. Wang, and P. S. Yu, "Augmenting sequential recommendation with pseudo-prior items via reversely pre-training transformer," in Proceedings of the 44th international ACM SIGIR conference on Research and development in information retrieval, 2021, pp. 1608-1612. [31] H. Fang, D. Zhang, Y. Shu, and G. J. A. T. o. I. S. Guo, "Deep learning for sequential recommendation: Algorithms, influential factors, and evaluations," vol. 39, no. 1, pp. 1-42, 2020. [32] S. Wang, L. Hu, Y. Wang, L. Cao, Q. Z. Sheng, and M. J. a. p. a. Orgun, "Sequential recommender systems: challenges, progress and prospects," 2019. [33] J. Lian, F. Zhang, X. Xie, and G. Sun, "CCCFNet: A content-boosted collaborative filtering neural network for cross domain recommender systems," in Proceedings of the 26th international conference on World Wide Web companion, 2017, pp. 817-818. [34] A. K. Sahu and P. J. F. G. C. S. Dwivedi, "Knowledge transfer by domain- independent user latent factor for cross-domain recommender systems," vol. 108, pp. 320-333, 2020. [35] A. K. Sahu and P. J. P. c. s. Dwivedi, "Matrix factorization in cross-domain recommendations framework by shared users latent factors," vol. 143, pp. 387-394, 2018. [36] N. Alharbi and D. Caragea, "Cross-Domain Attentive Sequential Recommendations based on General and Current User Preferences (CD-ASR)," in IEEE/WIC/ACM 39 International Conference on Web Intelligence and Intelligent Agent Technology, 2021, pp. 48-55. [37] N. Alharbi and D. Caragea, "Cross-domain self-attentive sequential recommendations," in Proceedings of International Conference on Data Science and Applications: ICDSA 2021, Volume 2, 2022, pp. 601-614: Springer. [38] S.-T. Zhong, L. Huang, C.-D. Wang, J.-H. Lai, and S. Y. J. I. T. o. C. Philip, "An autoencoder framework with attention mechanism for cross-domain recommendation," vol. 52, no. 6, pp. 5229-5241, 2020. [39] J.-w. Lee, M. Choi, J. Lee, and H. Shim, "Collaborative distillation for top-N recommendation," in 2019 IEEE International Conference on Data Mining (ICDM), 2019, pp. 369-378: IEEE. [40] C. Yang, J. Pan, X. Gao, T. Jiang, D. Liu, and G. Chen, "Cross-task knowledge distillation in multi-task recommendation," in Proceedings of the AAAI Conference on Artificial Intelligence, 2022, vol. 36, no. 4, pp. 4318-4326. [41] X. Xia, H. Yin, J. Yu, Q. Wang, G. Xu, and Q. V. H. Nguyen, "On-device next-item recommendation with self-supervised knowledge distillation," in Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022, pp. 546-555. [42] J. Tang and K. Wang, "Ranking distillation: Learning compact ranking models with high performance for recommender system," in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 2018, pp. 2289-2298. [43] G. Chen, J. Chen, F. Feng, S. Zhou, and X. He, "Unbiased Knowledge Distillation for Recommendation," in Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, 2023, pp. 976-984. 40 [44] S. Kang, J. Hwang, W. Kweon, and H. Yu, "DE-RRD: A knowledge distillation framework for recommender system," in Proceedings of the 29th ACM International Conference on Information & Knowledge Management, 2020, pp. 605-614. [45] J. Ni, J. Li, and J. McAuley, "Justifying recommendations using distantly-labeled reviews and fine-grained aspects," in Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP), 2019, pp. 188-197. [46] S. Rendle, C. Freudenthaler, Z. Gantner, and L. J. a. p. a. Schmidt-Thieme, "BPR: Bayesian personalized ranking from implicit feedback," 2012. [47] R. He, W.-C. Kang, and J. McAuley, "Translation-based recommendation," in Proceedings of the eleventh ACM conference on recommender systems, 2017, pp. 161- 169. [48] X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua, "Neural collaborative filtering," in Proceedings of the 26th international conference on world wide web, 2017, pp. 173-182. [49] A. M. Elkahky, Y. Song, and X. He, "A multi-view deep learning approach for cross domain user modeling in recommendation systems," in Proceedings of the 24th international conference on world wide web, 2015, pp. 278-288. [50] Q. Liu, Y. Zeng, R. Mokhosi, and H. Zhang, "STAMP: short-term attention/memory priority model for session-based recommendation," in Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 2018, pp. 1831-1839.
指導教授	陳以錚	審核日期	2024-3-14
推文	facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu
網路書籤	Google bookmarks   del.icio.us   hemidemi   myshare