博碩士論文 106423054 詳細資訊




以作者查詢圖書館館藏 以作者查詢臺灣博碩士 以作者查詢全國書目 勘誤回報 、線上人數:9 、訪客IP:18.225.209.95
姓名 林君潔(Chun-Chieh Lin)  查詢紙本館藏   畢業系所 資訊管理學系
論文名稱 以類別為基礎sequence-to-sequence模型之POI旅遊行程推薦
(A Category based Sequence-to-Sequence Model for POI Recommendation)
相關論文
★ 台灣50走勢分析:以多重長短期記憶模型架構為基礎之預測★ 以多重遞迴歸神經網路模型為基礎之黃金價格預測分析
★ 增量學習用於工業4.0瑕疵檢測★ 遞回歸神經網路於電腦零組件銷售價格預測之研究
★ 長短期記憶神經網路於釣魚網站預測之研究★ 基於深度學習辨識跳頻信號之研究
★ Opinion Leader Discovery in Dynamic Social Networks★ 深度學習模型於工業4.0之機台虛擬量測應用
★ A Novel NMF-Based Movie Recommendation with Time Decay★ A DQN-Based Reinforcement Learning Model for Neural Network Architecture Search
★ Neural Network Architecture Optimization Based on Virtual Reward Reinforcement Learning★ 生成式對抗網路架構搜尋
★ 以漸進式基因演算法實現神經網路架構搜尋最佳化★ Enhanced Model Agnostic Meta Learning with Meta Gradient Memory
★ 遞迴類神經網路結合先期工業廢水指標之股價預測研究★ A Novel Reinforcement Learning Model for Intelligent Investigation on Supply Chain Market
檔案 [Endnote RIS 格式]    [Bibtex 格式]    [相關文章]   [文章引用]   [完整記錄]   [館藏目錄]   [檢視]  [下載]
  1. 本電子論文使用權限為同意立即開放。
  2. 已達開放權限電子全文僅授權使用者為學術研究之目的,進行個人非營利性質之檢索、閱讀、列印。
  3. 請遵守中華民國著作權法之相關規定,切勿任意重製、散佈、改作、轉貼、播送,以免觸法。

摘要(中) 由於現今LBSNs (Location-Based Social Network) 的盛行,有越來越多POI(Point of Interest)相關服務來協助預測使用者可能有興趣的POI。在複雜的順序資料中尋找規律並不是件容易的任務,從先前的傳統的方法主要是利用POI之間的相關性來進行推薦。然而近年來也有許多研究利用深度學習的方法來做POI的預測,透過訓練模型來分析使用者的移動習性,在旅遊規劃時,地點的類別是一極大的影響因素,但較少研究著重於地點類別對POI預測的影響。本文提出了一新穎的POI推薦系統,以深度學習中的序列型模型(Sequence-to-Sequence)為基礎,進一步導入類型演變的觀念,分析了使用者目前的軌跡並預測一系列未來有興趣之地點。除此之外,本文亦提出C-S2S、DEC-S2S和IEC-S2S這三種新的學習模型利用地點的類別來提高預測的精準度。而實驗結果顯示,S2S確實能比傳統遞迴神經網路更能有效地利用序列間的關係做預測,而C-S2S、DEC-S2S和IEC-S2S也更提高了預測的精準度。
摘要(英) Owing to the great advances of mobility technique, more and more POI (point of interests)-related series have emerged, which could help user to navigate or predict the POI that may be interesting. Obviously, predicting POI is a challenging task; the complex sequential transition regularities, and the heterogeneity and sparsity of the collected trajectory data really hinder recommending the precise POIs. Prior studies of successive POI recommendation only focus on modeling the correlation among POIs based on users′ check-in data, while omitting the other feature of check-in data. Both the historical footprint of users’ check-in location and the type of location are important factors which influencing users’ decisions. We also take the category of location into consideration with different methods C-S2S, IEC-S2S and DEC-S2S to get more precise. The result also shows that S2S can capture the structure between sequence efficiently. The C-S2S model and IEC-S2S model also increasing the precision score.
關鍵字(中) ★ 機器學習
★ POI 推薦
★ 遞歸神經網路
★ 長短期記憶模型
關鍵字(英) ★ machine learning
★ human mobility
★ POI recommendation
★ recurrent neural network
★ Long Short-Term Memory
★ spatial-temporal data
論文目次 中文摘要 ii
Abstract iv
Table of contents v
1. Introduction 1
2. Related Work 6
3. Preliminary 12
4. Proposed Recommendation System 13
4.1 Feature extraction and embedding 13
4.2 Learning Models and Training 15
4.3 Prediction Module of S2S 20
5. Performance Evaluation 21
5.1 Prediction Module of S2S 21
5.2 Analysis on Overall Performance 23
5.3 Comparing Model Performance on Precision and Recall 25
5.4 Order-Preserved Performance Evaluation 27
5.5 Discussion on Parameter Settings 28
6. Conclusion 32
Reference 33


參考文獻 [1] A. Graves, “Supervised Sequence Labelling,” Studies in Computational Intelligence Supervised Sequence Labelling with Recurrent Neural Networks, pp. 5–13, 2012.
[2] A. Monreale, F. Pinelli, R. Trasarti, and F. Giannotti, “WhereNext: a location predictor on trajectory pattern mining,” Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD 2009), pp.637-646, 2009.
[3] B. Zhang and Y. Feng, “Improving Temporal Recommendation Accuracy and Diversity via Long and Short-Term Preference Transfer and Fusion Models,” Web Technologies and Applications Lecture Notes in Computer Science, pp. 174–185, 2016.
[4] Berjani, B., & Strufe, T. (2011, April). A recommendation system for spots in location-based online social networks. In Proceedings of the 4th workshop on social network systems (p. 4). ACM.
[5] C. Aggarwal, “Context-Sensitive Recommender Systems,” Recommender Systems, pp. 255–281, 2016.
[6] C. Cheng, H. Yang, I. King, and M. Lyu. “Fused matrix factorization with geographical and social influence in location-based social networks,” Proceedings of the 26th AAAI Conference on Artificial Intelligence (AAAI 2012), pp. 17-23, 2012.
[7] C. Cheng, H. Yang, M. Lyu, and I. King, “Where you like to go next: successive point-of-interest recommendation,” Proceedings of the 23th international joint conference on Artificial Intelligence (IJCAI 2013), pp. 2605-2611, 2013.
[8] C. Zhang, K. Zhang, Q. Yuan, L. Zhang, T. Hanratty, and J. Han, “GMove: Group-Level Mobility Modeling Using Geo-Tagged Social Media,” Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2016), pp. 1305-1314, 2016.
[9] Chen, T., Chen, Y., Guo, H., & Luo, J. (2018, April). When E-commerce Meets Social Media: Identifying Business on WeChat Moment Using Bilateral-Attention LSTM. In Companion Proceedings of the The Web Conference 2018 (pp. 343-350). International World Wide Web Conferences Steering Committee.
[10] Cheng, C., Yang, H., King, I., & Lyu, M. R. (2012, July). Fused matrix factorization with geographical and social influence in location-based social networks. In Twenty-Sixth AAAI Conference on Artificial Intelligence.
[11] Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078.
[12] D. Graur, R. Mariş, R. Potolea, M. Dînşoreanu, and C. Lemnaru, “Complex Localization in the Multiple Instance Learning Context,” New Frontiers in Mining Complex Patterns Lecture Notes in Computer Science, pp. 93–106, 2018.
[13] D. Yao, C. Zhang, J. Huang, and J. Bi, “SERM: A Recurrent Model for Next Location Prediction in Semantic Trajectories,” Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM 2017), pp. 2411-2414, 2017.
[14] Gambs, S., Killijian, M. O., & del Prado Cortez, M. N. (2012, April). Next place prediction using mobility markov chains. In Proceedings of the First Workshop on Measurement, Privacy, and Mobility (p. 3). ACM.
[15] Ghosh, S., Vinyals, O., Strope, B., Roy, S., Dean, T., & Heck, L. (2016). Contextual lstm (clstm) models for large scale nlp tasks. arXiv preprint arXiv:1602.06291.
[16] H. Cheng, M. Ispir, R. Anil, Z. Haque, L. Hong, V. Jain, X. Liu, H. Shah, L. Koc, J. Harmsen, T. Shaked, T. Chandra, H. Aradhye, G. Anderson, G. Corrado, and W. Chai, “Wide & Deep Learning for Recommender Systems,” Proceedings of the 1st Workshop on Deep Learning for Recommender Systems (DLRS 2016), pp. 7-10, 2016.
[17] H. Dyvik, “Exploiting structural similarities in machine translation,” Computers and the Humanities, vol. 28, no. 4-5, pp. 225–234, 1994.
[18] H. Li, “Learning to Rank,” Encyclopedia of Machine Learning and Data Mining, pp. 1–6, 2016.
[19] H. Zhang, Y. Yang, H. Luan, S. Yang, and T. Chua, “Start from Scratch: Towards Automatically Identifying, Modeling, and Naming Visual Attributes,” Proceedings of the ACM International Conference on Multimedia (MM 2014), pp. 187-196, 2014.
[20] I. Baytas, C. Xiao, X. Zhang, F. Wang, A. Jain, and J. Zhou, “Patient Subtyping via Time-Aware LSTM Networks,” Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2017), pp. 65-74, 2017.
[21] J. Feng, Y. Li, C. Zhang, F. Sun, F. Meng, A. Guo, and D. Jin, “DeepMove: Predicting Human Mobility with Attentional Recurrent Networks,” Proceedings of the 2018 World Wide Web Conference on World Wide Web (WWW 2018), pp. 1459-1468, 2018.
[22] J. Manotumruksa, C. Macdonald, and I. Ounis, “A Contextual Attention Recurrent Architecture for Context-Aware Venue Recommendation,” Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR 2018), pp. 555-564, 2018.
[23] J. Manotumruksa, C. Macdonald, and I. Ounis, “A Deep Recurrent Collaborative Filtering Framework for Venue Recommendation,” Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM 2017), pp. 1429-1438, 2017.
[24] J. Yoo and S. Choi, “Probabilistic matrix tri-factorization,” Proceeding of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2009), pp. 1553-1556, 2009.
[25] J. Zhang and C. Chow, “CRATS: An LDA-Based Model for Jointly Mining Latent Communities, Regions, Activities, Topics, and Sentiments from Geosocial Network Data,” IEEE Transactions on Knowledge and Data Engineering (TKDE 2016), vol. 28, no. 11, pp. 2895–2909, 2016.
[26] L. Xiong, X. Chen, T. Huang, J. Schneider, and J. Carbonell, “Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorization,” Proceedings of the 2010 SIAM International Conference on Data Mining (SDM 2010), pp. 211-222, 2010.
[27] Li, P., Li, J., Sun, F., & Wang, P. (2017, August). Short Text Emotion Analysis Based on Recurrent Neural Network. In Proceedings of the 6th International Conference on Information Engineering (p. 6). ACM.
[28] M. Chen, Y. Liu, and X. Yu, “NLPMM: A Next Location Predictor with Markov Modeling,” Procedding of Advances in Knowledge Discovery and Data Mining Lecture Notes in Computer Science (PAKDD 2014), pp. 186–197, 2014.
[29] M. Ye, P. Yin, W. Lee, and D. Lee, “Exploiting geographical influence for collaborative point-of-interest recommendation,” Proceedings of the 34th international ACM SIGIR conference on Research and development in Information (SIGIR 2011), pp. 325-334, 2011.
[30] N. Du, H. Dai, R. Trivedi, U. Upadhyay, M. Gomez-Rodriguez, and L. Song, “Recurrent Marked Temporal Point Processes,” Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2016), pp. 1555-1564, 2016.
[31] Nallapati, R., Zhou, B., Gulcehre, C., & Xiang, B. (2016). Abstractive text summarization using sequence-to-sequence rnns and beyond. arXiv preprint arXiv:1602.06023.
[32] Nguyen, D. D., Le Van, C., & Ali, M. I. (2018, June). Vessel destination and arrival time prediction with sequence-to-sequence models over spatial grid. In Proceedings of the 12th ACM International Conference on Distributed and Event-based Systems (pp. 217-220).
[33] Park, S. H., Kim, B., Kang, C. M., Chung, C. C., & Choi, J. W. (2018, June). Sequence-to-sequence prediction of vehicle trajectory via LSTM encoder-decoder architecture. In 2018 IEEE Intelligent Vehicles Symposium (IV) (pp. 1672-1678). IEEE.
[34] Q. Liu, S. Wu, L. Wang, and T. Tan, “Predicting the next location: a recurrent model with spatial and temporal contexts,” Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI 2016), pp.194-200, 2016.
[35] Q. Wu and C. Pu, “Modeling and implementing collaborative editing systems with transactional techniques,” Proceedings of the 6th International ICST Conference on Collaborative Computing: Networking, Applications, Worksharing (CollaborateCom 2010), pp. 1-10, 2010.
[36] R. Mehta and K. Rana, “A review on matrix factorization techniques in recommender systems,” The 2nd International Conference on Communication Systems, Computing and IT Applications (CSCITA 2017), pp. 269-274, 2017.
[37] R. Rosenkrantz, “Information Theory and Statistical Mechanics I (1957),” E. T. Jaynes: Papers on Probability, Statistics and Statistical Physics, pp. 4–16, 1989.
[38] S. Gambs, M. Killijian, and M. Cortez, “Next place prediction using mobility Markov chains,” Proceedings of the First Workshop on Measurement, Privacy, and Mobility (MPM 2012), no. 3, pp. 1-6, 2012.
[39] S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme, “Factorizing personalized Markov chains for next-basket recommendation,” Proceedings of the 19th international conference on World Wide Web (WWW 2010), pp. 811-820, 2010.
[40] S. Zhao, M. Lyu, and I. King, “Geo-Teaser: Geo-Temporal Sequential Embedding Rank for POI Recommendation,” SpringerBriefs in Computer Science Point-of-Interest Recommendation in Location-Based Social Networks, pp. 57–78, 2018.
[41] S. Zhao, M. Lyu, and I. King, “STELLAR: Spatial-Temporal Latent Ranking Model for Successive POI Recommendation,” SpringerBriefs in Computer Science Point-of-Interest Recommendation in Location-Based Social Networks, pp. 79–94, 2018.
[42] Shi, Y., Serdyukov, P., Hanjalic, A., & Larson, M. (2011, July). Personalized landmark recommendation based on geotags from photo sharing sites. In Fifth International AAAI Conference on Weblogs and Social Media.
[43] Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in neural information processing systems (pp. 3104-3112).
[44] V. Sridhar, “Unsupervised Text Normalization Using Distributed Representations of Words and Phrases,” Proceedings of the 1st Workshop on Vector Space Modeling for Natural Language Processing, pp. 8-16, 2015.
[45] Venugopalan, S., Rohrbach, M., Donahue, J., Mooney, R., Darrell, T., & Saenko, K. (2015). Sequence to sequence-video to text. In Proceedings of the IEEE international conference on computer vision (pp. 4534-4542).
[46] W. Mathew, R. Raposo, and B. Martins, “Predicting future locations with hidden Markov models,” Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp 2012), pp. 911-918, 2012.
[47] Y. Zhang, H. Dai, C. Xu, J. Feng, T. Wang, J. Bian, B. Wang, and T. Liu, “Sequential click prediction for sponsored search with recurrent neural networks,” Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI 2014), pp. 1369-1375, 2014.
[48] Y. Zhu, H. Li, Y. Liao, B. Wang, Z. Guan, H. Liu, and D. Cai, “What to Do Next: Modeling User Behaviors by Time-LSTM,” Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI 2017), pp. 3602-3608, 2017.
[49] Yang, Q., He, Z., Ge, F., & Zhang, Y. (2017, May). Sequence-to-sequence prediction of personal computer software by recurrent neural network. In 2017 International Joint Conference on Neural Networks (IJCNN) (pp. 934-940). IEEE.
[50] Zaremba, W., Sutskever, I., & Vinyals, O. (2014). Recurrent neural network regularization. arXiv preprint arXiv:1409.2329.
指導教授 陳以錚(Yi-Cheng Chen) 審核日期 2019-7-27
推文 facebook   plurk   twitter   funp   google   live   udn   HD   myshare   reddit   netvibes   friend   youpush   delicious   baidu   
網路書籤 Google bookmarks   del.icio.us   hemidemi   myshare   

若有論文相關問題,請聯絡國立中央大學圖書館推廣服務組 TEL:(03)422-7151轉57407,或E-mail聯絡  - 隱私權政策聲明