運用Meta-path與注意力機制改善個人化穿搭推薦

以作者查詢圖書館館藏

、以作者查詢臺灣博碩士

、以作者查詢全國書目

、勘誤回報

、線上人數：6

、訪客IP：3.15.189.250

姓名

葉繁錡(Fan-Chi Yeh) 查詢紙本館藏

畢業系所

資訊管理學系

論文名稱

運用Meta-path與注意力機制改善個人化穿搭推薦
(Leveraging Meta-path based Context for Personal Outfit Recommendation with Co-Attention Mechanism)

相關論文

★ 不動產仲介業銷售住宅類別之成交預測模型—以不動產仲介S公司為例	★ 應用文字探勘技術建構預測客訴問題類別機器學習模型
★ 以機器學習技術建構顧客回購率預測模型：以某手工皂原料電子商務網站為例	★ 以機器學習建構股價預測模型：以台灣股市為例
★ 以機器學習方法建構財務危機之預測模型：以台灣上市櫃公司為例	★ 運用資料探勘技術於股票填息之預測模型：以台灣股市上市公司為例
★ 運用資料探勘技術優化次世代防火牆規則之研究	★ 應用資料探勘技術於電子病歷文本中識別相關新資訊
★ 應用深度學習於藥品後市場監督：Twitter文本分類任務	★ 運用電子病歷與資料探勘技術建構腦中風病人心房顫動預測模型
★ 考量特徵選取與隨機森林之遺漏值填補技術	★ 電子病歷縮寫消歧與一對多分類任務
★ 運用機器學習技術建構核保風險預測模型：以A公司為例	★ 風扇壽命預測使用大數據分析－以 X 公司為例
★ 使用文字探勘與深度學習技術建置中風後肺炎之預測模型	★ 利用文字探勘技術分析評論特徵因子對於體驗品評論有益性之影響：以IMDb 為例

檔案

[Endnote RIS 格式]

[Bibtex 格式]

[相關文章]

[文章引用]

[完整記錄]

[館藏目錄]

至系統瀏覽論文 (2027-6-30以後開放)

摘要(中)

隨著線上時尚零售蓬勃發展，客戶和商家對於服裝推薦的需求也逐漸增長，推薦的商品越能精準得滿足顧客喜好越能提升商家的銷售量。過去服裝推薦領域研究多著重在單品之間搭配程度計算，盡可能讓機器模擬人類的審美觀。然而服裝的審美其實包含許多主觀成分且因人而異，因此在穿搭推薦上不應該忽視個人化偏好因素。個人化資訊的提取過往多仰賴於用戶評分矩陣，並依據協同過濾相關方法預測用戶潛在喜好項目，屬於使用明確資訊的個人化推薦方法。在大數據時代下，科學家試圖探索從其他歷史資料提取有意義的內隱資訊幫助推薦，本研究使用結構化用戶物品Meta-path並搭配深度神經網路，試圖提取內隱資訊幫助個人化偏好的建立。
　　本研究提出之架構GPA-BPR(General Compatibility and Personal Preference with Co-Attention mechanism) 主要由兩模組建立而成，分別是服裝單品匹配模組和個人化偏好模組。服裝單品匹配模組依據單品其圖像及文字資訊做匹配度計算，並在圖像特徵提取建立實驗找出最適合方法。個人化偏好模組透過用戶單品網路建立之Meta-path，搭配深度網路提取重要之內隱資訊，相較於過往研究有助於提取更多的個人化資訊。
　　為探討本研究架構中各模組之必要性，本研究建立消融研究並使用真實世界資料集iQon3000作為訓練和驗證之依據，本研究採用AUC及MRR作為模型評估指標，探討訓練模型之判別能力以及推薦排序效果。從實驗結果可以得知本研究提出之複合架構在運用共同注意力機制深度網路可以有效地從Meta-path提取重要特徵，提升模型效能並且在iQon3000資料集上勝過過往研究，同時提高可解釋性。

摘要(英)

With the huge economic value of online fashion retail, the demand for clothing recommendations by customers has gradually increased. The more accurately the recommended products can meet the preferences of customers, the more the merchants can improve their sales.
Most existing research in the field of clothing recommendation focused on the calculation of general compatibility for the items, in order to allow the machine to simulate human’s perspective of aesthetics as much as possible. However, the aesthetics of clothing can be highly subjective, so personal preferences should not be ignored in outfit recommendations. In the past, the extraction of personalized preference relied on explicit information such as user rating matrices using collaborative filtering methods to predict the user′s preferences. In the era of Big Data, scientists are trying to extract meaningful implicit information from other historical data. This study uses structured user-item meta-paths and a deep neural network to extract implicit information to tackle the problem of personalized compatibility.
The proposed framework, GPA-BPR (General Compatibility and Personal Preference with Co-Attention mechanism), comprising of two important modules, namely the general compatibility module and the personal preference module. The general compatibility module is mainly based on the image and text information of the item for matching calculation. Also, the image feature extraction experiment is established to find the most suitable method. The personal preference module can be better than previous studies in terms of personalization through the analysis of the user-item meta-path.
Moreover, we use a large real-world dataset, iQon3000 for training and evaluation. We use AUC and MRR as model evaluation metrics to investigate the performance of the trained model and the recommended ranking effect. Extensive experiments have demonstrated the proposed architecture can effectively improve the representations for meta-path based context by using the co-attention mechanism, which further improves model performance and outperform previous studies on iQon3000 dataset and has potentially good interpretability.

關鍵字(中)

★ 推薦系統
★ 深度學習
★ 注意力機制
★ 異構網路

關鍵字(英)

★ Recommender System
★ Deep Learning
★ Attention Mechanism
★ Heterogeneous Information Network

論文目次

目錄
圖目錄 iii
表目錄 iv
第一章緒論 1
1.1 研究背景 1
1.2 研究動機 2
1.3 研究目的 4
第二章文獻探討 6
2.1 圖像特徵提取 6
2.2 推薦系統 7
2.3 服裝推薦系統 10
2.4 注意力機制 15
第三章研究方法 16
3.1 資料來源 18
3.2 資料預處理 20
3.2.1 圖像前處理 20
3.2.2 文字前處理 22
3.3 Meta-path 23
3.3.1 Meta-path定義 23
3.3.2 Meta-path抽樣 24
3.4 GPA-BPR 24
3.4.1 服裝匹配度模組 25
3.4.2 個人化偏好模組 26
3.4.3 BPR推薦演算法 29
3.5 實驗設計 30
3.6 模型評估指標 32
第四章實驗結果與分析 34
4.1 實驗資料 34
4.2 實驗結果與評估 36
4.2.1 實驗一、比較深度學習於服裝特徵提取之效果 37
4.2.2 實驗二、與其他服裝推薦模型比較 39
4.2.3 實驗三、驗證圖像模組與文字模組之功效 44
4.2.4 實驗四、驗證個人化模組、Meta-path模組之功效 46
第五章研究結論與建議 52
5.1 研究結論 52
5.2 研究限制 54
5.3 未來研究方向與建議 55
參考文獻 56

參考文獻

Ahonen, T., Hadid, A., & Pietikainen, M. (2006). Face description with local binary patterns: Application to face recognition. IEEE transactions on pattern analysis and machine intelligence, 28(12), 2037-2041.

Bahdanau, D., Cho, K., & Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.

Bao, Y., Fang, H., & Zhang, J. (2014, June). Topicmf: Simultaneously exploiting ratings and reviews for recommendation. In Twenty-Eighth AAAI conference on artificial intelligence.

Bourdev, L., Maji, S., & Malik, J. (2011, November). Describing people: A poselet-based approach to attribute classification. In 2011 International Conference on Computer Vision (pp. 1543-1550). IEEE.

Breiman, L. (2001). Random forests. Machine learning, 45(1), 5-32.

Brown, P. J., Bovey, J. D., & Chen, X. (1997). Context-aware applications: from the laboratory to the marketplace. IEEE personal communications, 4(5), 58-64.

Chang, C. C., & Lin, C. J. (2011). LIBSVM: a library for support vector machines. ACM transactions on intelligent systems and technology (TIST), 2(3), 1-27.

Dalal, N., & Triggs, B. (2005, June). Histograms of oriented gradients for human detection. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR′05) (Vol. 1, pp. 886-893). Ieee.

Dong, Y., Chawla, N. V., & Swami, A. (2017, August). metapath2vec: Scalable representation learning for heterogeneous networks. In Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 135-144).

Freedman, D. A. (2009). Statistical models: theory and practice. cambridge university press.

Févotte, C., & Idier, J. (2011). Algorithms for nonnegative matrix factorization with the β-divergence. Neural computation, 23(9), 2421-2456.

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ... & Bengio, Y. (2014). Generative adversarial nets. Advances in neural information processing systems, 27.

Guan, C., Qin, S., Ling, W., & Ding, G. (2016). Apparel recommendation system evolution: an empirical review. International Journal of Clothing Science and Technology.

Hadsell, R., Chopra, S., & LeCun, Y. (2006, June). Dimensionality reduction by learning an invariant mapping. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR′06) (Vol. 2, pp. 1735-1742). IEEE.

Han, X., Wu, Z., Jiang, Y. G., & Davis, L. S. (2017, October). Learning fashion compatibility with bidirectional lstms. In Proceedings of the 25th ACM international conference on Multimedia (pp. 1078-1086).

He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).

He, R., & McAuley, J. (2016, February). VBPR: visual bayesian personalized ranking from implicit feedback. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 30, No. 1).

He, X., Liao, L., Zhang, H., Nie, L., Hu, X., & Chua, T. S. (2017, April). Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web (pp. 173-182).

Hu, B., Shi, C., Zhao, W. X., & Yu, P. S. (2018, July). Leveraging meta-path based context for top-n recommendation with a neural co-attention model. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (pp. 1531-1540).

Hu, Y., Xiong, F., Pan, S., Xiong, X., Wang, L., & Chen, H. (2021). Bayesian personalized ranking based on multiple-layer neighborhoods. Information Sciences, 542, 156-176.

Kang, W. C., Fang, C., Wang, Z., & McAuley, J. (2017, November). Visually-aware fashion recommendation and design with generative image models. In 2017 IEEE International Conference on Data Mining (ICDM) (pp. 207-216). IEEE.

Koren, Y. (2008, August). Factorization meets the neighborhood: a multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 426-434).

Koren, Y. (2009, June). Collaborative filtering with temporal dynamics. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 447-456).

Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8), 30-37.

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems, 25, 1097-1105.

LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278-2324.

Lee, D. D., & Seung, H. S. (1999). Learning the parts of objects by non-negative matrix factorization. Nature, 401(6755), 788-791.

Li, Q., & Zheng, X. (2017). Deep collaborative autoencoder for recommender systems: a unified framework for explicit and implicit feedback. arXiv preprint arXiv:1712.09043.

Liu, S., Feng, J., Song, Z., Zhang, T., Lu, H., Xu, C., & Yan, S. (2012, October). Hi, magic closet, tell me what to wear!. In Proceedings of the 20th ACM international conference on Multimedia (pp. 619-628).

Lu, J., Yang, J., Batra, D., & Parikh, D. (2016). Hierarchical question-image co-attention for visual question answering. Advances in neural information processing systems, 29, 289-297.

McAuley, J., Targett, C., Shi, Q., & Van Den Hengel, A. (2015, August). Image-based recommendations on styles and substitutes. In Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval (pp. 43-52).

McLaughlin, M. R., & Herlocker, J. L. (2004, July). A collaborative filtering algorithm and evaluation metric that accurately model the user experience. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval (pp. 329-336).

Mnih, A., & Salakhutdinov, R. R. (2008). Probabilistic matrix factorization. In Advances in neural information processing systems (pp. 1257-1264).

Núñez-Valdez, E. R., Quintana, D., Crespo, R. G., Isasi, P., & Herrera-Viedma, E. (2018). A recommender system based on implicit feedback for selective dissemination of ebooks. Information Sciences, 467, 87-98.

Phan, M. C., Sun, A., Tay, Y., Han, J., & Li, C. (2017, November). NeuPL: Attention-based semantic matching and pair-linking for entity disambiguation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (pp. 1667-1676).

Qiao, Z., Zhang, P., Cao, Y., Zhou, C., Guo, L., & Fang, B. (2014, June). Combining heterogenous social and geographical information for event recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 28, No. 1).

Rendle, S., Freudenthaler, C., Gantner, Z., & Schmidt-Thieme, L. (2012). BPR: Bayesian personalized ranking from implicit feedback. arXiv preprint arXiv:1205.2618.

Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., ... & Fei-Fei, L. (2015). Imagenet large scale visual recognition challenge. International journal of computer vision, 115(3), 211-252.

Shi, C., Hu, B., Zhao, W. X., & Philip, S. Y. (2018). Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering, 31(2), 357-370.

Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.

Song, X., Feng, F., Liu, J., Li, Z., Nie, L., & Ma, J. (2017, October). Neurostylist: Neural compatibility modeling for clothing matching. In Proceedings of the 25th ACM international conference on Multimedia (pp. 753-761).

Song, X., Han, X., Li, Y., Chen, J., Xu, X. S., & Nie, L. (2019, October). GP-BPR: Personalized compatibility modeling for clothing matching. In Proceedings of the 27th ACM International Conference on Multimedia (pp. 320-328).

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., ... & Rabinovich, A. (2015). Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1-9).

Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016). Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818-2826).

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. In Advances in neural information processing systems (pp. 5998-6008).

Wang, C. M., Wang, C. L., & Xu, L. (2013). User-adaptive Item-based collaborative filtering recommendation algorithm. Application Research of Computers, 30(12), 3606-3609.

Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., ... & Bengio, Y. (2015, June). Show, attend and tell: Neural image caption generation with visual attention. In International conference on machine learning (pp. 2048-2057). PMLR.

Ye, F., & Zhang, H. (2016, July). A collaborative filtering recommendation based on users′ interest and correlation of items. In 2016 International Conference on Audio, Language and Image Processing (ICALIP) (pp. 515-520). IEEE.

Yu, W., Zhang, H., He, X., Chen, X., Xiong, L., & Qin, Z. (2018, April). Aesthetic-based clothing recommendation. In Proceedings of the 2018 world wide web conference (pp. 649-658).

Yu, X., Ren, X., Sun, Y., Gu, Q., Sturt, B., Khandelwal, U., ... & Han, J. (2014, February). Personalized entity recommendation: A heterogeneous information network approach. In Proceedings of the 7th ACM international conference on Web search and data mining (pp. 283-292).

Yunchen Pu, Zhe Gan, Ricardo Henao, Xin Yuan, Chunyuan Li, Andrew Stevens, and Lawrence Carin. Variational autoencoder for deep learning of images, labels and captions. In NIPS, pages 2352–2360, 2016.

Zhou, C., Bai, J., Song, J., Liu, X., Zhao, Z., Chen, X., & Gao, J. (2018, April). Atrank: An attention-based user behavior modeling framework for recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 32, No. 1).

指導教授

胡雅涵(Ya-Han Hu)

審核日期

2022-8-8

推文