簡易檢索 / 詳目顯示

研究生: 陳佑翔
Chen, You-Xiang
論文名稱: 提供具可解釋並改善評論缺漏問題之推薦系統
Explainable Recommendation System for Solving Review Loss
指導教授: 柯佳伶
Koh, Jia-Ling
學位類別: 碩士
Master
系所名稱: 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2020
畢業學年度: 108
語文別: 中文
論文頁數: 67
中文關鍵詞: 推薦系統評分預測評論生成可解釋推薦階層式注意力神經網路多任務學習深度學習
英文關鍵詞: recommendation system, rating prediction, review generation, explainable recommendation, hierarchical attention neural network, multi-task learning, deep learning
DOI URL: http://doi.org/10.6345/NTNU202000953
論文種類: 學術論文
相關次數: 點閱:237下載:15
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 儘管以評論特徵為基礎的相關研究,證實能克服用戶-商品間評分資料稀疏的問題以提升評分預測效能,然而其並未考慮評論缺漏的問題。本論文參考採用評論之階層式注意力神經網路模型HANN,更改原模型中部分輸入特徵資訊,並調整不同層級注意力機制的權重計算方式;此模型稱為HANN-RPM,用來進行用戶對商品的評分預測。此外,另建立了一個以編碼器-解碼器架構為基礎的評論生成模型HANN-RGM,結合HANN-RPM的商品子網路架構為編碼器,不僅可用於對評分結果生成文字解釋內容,並可用於對用戶未撰寫評論的購買商品補充缺漏的評論後提供給HANN-RPM,進一步提升評分預測的效果。實驗結果顯示,不論有無缺漏評論的情況下,HANN-RPM皆較HANN有更佳評分預測效果。而當用戶具有評論缺漏的情況,透過HANN-RGM生成缺漏部份的評論補足,可令HANN-RPM預測出接近於無評論缺漏情況下的評分預測效果。此外,HANN-RGM模型透過擷取出前k筆評論中的商品語意資訊,比起NRT能生成出更長且更多樣性的評論內容,可作為評分預測之文字解釋。

    In recently year, a variety of review-based recommendation systems have been developed to model user’s preference and item’s preference but few of researches considered review loss of users. In this paper, we present an approach for solving the problem of review loss by generating textual explanations to assist predicting user rating. Two frameworks of hierarchical attention learning models are proposed. The first one is a rating prediction model named HANN-RPM, which is extended from HANN model. We change the input features of in the inter-review GRU layer and adjust the computing method of attention mechanism in HANN to improve the effectiveness of feature extraction from reviews in the model. The second model is for review generation, named HANN-RGM, which is designed based on the encoder-decoder architecture. The hierarchical attention neural network for items learned from HANN-RPM is used to encode the latent representation of reviews for an item. Then a GRU neural network is employed to decode the latent representations into natural linguistic explanations by texts. The generated review not only provides explanation for user rating, but also used to fill the lost reviews of users for further improving the rating prediction of. Extensive experiments on real-world datasets of Amazon illustrate that our proposed model not only improves the rating prediction accuracy when the review-based recommendation system suffered from the problem of review loss, but also generates useful and fluent text explanations.

    第一章 緒論 1 1.1 研究動機 1 1.2 研究目的 2 1.3 論文方法 3 1.4 論文架構 5 第二章 文獻探討 6 2.1 協同過濾推薦系統 (Cooperative Filtering Recommender System) 6 2.2 可解釋性推薦系統 (Explainable Recommendation Systems) 9 第三章 問題定義與系統架構 16 3.1 問題定義 16 3.2 系統架構與流程 17 3.3 資料前處理(Data Pre-processing) 18 3.4 產生輸入特徵 (Input Feature Construction) 19 第四章 類神經網路模型建構方法 22 4.1 評分預測模型架構 (Rating Prediction Model) 22 4.2 評論生成模型架構 (Review Generation Model) 31 4.3 解決評論缺漏問題之學習機制 37 第五章 實驗評估 40 5.1 資料集與參數設定 41 5.2 效能評估指標 43 5.3 評分預測模型的效能評估 46 5.4 評論缺漏時的評分預測效能比較 52 5.5 評論生成模型的效能評估 55 第六章 結論與未來研究方向 60 參考文獻 62

    [1] Piotr Bojanowski, Edouard Grave, Armand Joulin and Tomas Mikolov, “Enriching Word Vectors with Subword Information”, Transactions of the Association for Computational Linguistics, vol. 5 , pp. 135—146, 2017.
    [2] Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma, “Neural Attentional Rating Regression with Review-level Explanations,” In Proceedings of the 27th International Conference on World Wide Web, pp. 1583—1592, 2018.
    [3] Zhongxia Chen, Xiting Wang, Xing Xie, Tong Wu, Guoqing Bu, Yining Wang and Enhong Chen, “Co-attentive multi-task learning for explainable recommendation,” in Proceedings of International Joint Conferences on Artificial Intelligence, pp. 1237—2143, 2019.
    [4] Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, Rohan Anil, Zakaria Haque, Lichan Hong, Vihan Jain, Xiaobing Liu and Hemal Shah, “Wide & deep learning for recommender systems,” in Proceedings of the 1st Workshop on Deep Learning for Recommender Systems, pp. 7—10, 2016.
    [5] Dawei Cong, Yanyan Zhao, Bing Qin, Yu Han, Murray Zhang, Alden Liu and Nat Chen, “Hierarchical Attention based Neural Network for Explainable Recommendation,” In Proceedings of the 2019 on International Conference on Multimedia Retrieval, pp. 373—381, 2019.
    [6] Felipe Costa, Sixun Ouyang, Peter Dolog and Aonghus Lawlor, “Automatic generation of natural language explanations,” in Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion, pp. 1—2, 2017.
    [7] Junyoung Chung, Caglar Gulcehre, KyungHyun Cho, Yoshua Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” arXiv preprint arXiv:1412.3555, 2014.
    [8] Tim Donkers, Benedikt Loepp, and Jürgen Ziegler, “Sequential user-based recurrent neural network recommendations,” in Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 152—160, 2017.
    [9] Jingyue Gao, Xiting Wang, Yasha Wang, and Xing Xie, “Explainable recommendation through attentive multi-view learning,” In Proceedings of the Association for the Advancement of Artificial Intelligence, 2019.
    [10] Li Gao, Hong Yang, Jia Wu, Chuan Zhou, Weixue Lu, and Yue Hu, “Recommendation with multi-source heterogeneous information,” in Proceedings of the 27th International Joint Conference on Artificial Intelligence, 2018.
    [11] Xiangnan He, Hanwang Zhang, Min-Yen Kan and Tat-Seng Chua, “Fast matrix factorization for online recommendation with implicit feedback,” in Proceedings of the 39th International ACM Special Interest Group on Information Retrieval conference on Research and Development in Information Retrieval, pp. 549—558, 2016.
    [12] Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua, “Neural collaborative filtering,” in Proceedings of the 26th International Conference on World Wide Web, 173—182, 2017.
    [13] Yehuda Koren, “Factorization meets the neighborhood: A multifaceted collaborative filtering model,” in Proceedings of the 14th ACM Special Interest Group on Knowledge Discovery and Data Mining International Conference on Knowledge Discovery & Data Mining, pp. 426—434, 2008.
    [14] Yehuda Koren, Robert Bell and Chris Volinsky, “Matrix factorization techniques for recommender systems,” IEEE Computer, vol.42, pp. 30—37, 2009.
    [15] Piji Li, Zihao Wang, Zhaochun Ren, Lidong Bing, and Wai Lam, “Neural Rating Regression with Abstractive Tips Generation for Recommendation,” in Proceedings of the 40th International ACM Special Interest Group on Information Retrieval Conference on Research and Development in Information Retrieval, pp. 345—354, 2017.
    [16] Qiao Liu, Yifu Zeng, Refuoe Mokhosi, and Haibin Zhang, “STAMP: Short-term attention/memory priority model for session-based recommendation,” in Proceedings of the 24th ACM Special Interest Group on Knowledge Discovery and Data Mining International Conference on Knowledge Discovery & Data Mining, pp.1831—1839, 2018.
    [17] Minh-Thang Luong, Hieu Pham, and Christopher D Manning, “Effective approaches to attention-based neural machine translation,” arXiv preprint arXiv:1508.04025, 2015.
    [18] Georgina Peake and Jun Wang, “Explanation Mining: Post Hoc Interpretability of Latent Factor Models for Recommendation Systems,” in Proceedings of the 24th ACM Special Interest Group on Knowledge Discovery and Data Mining International Conference on Knowledge Discovery & Data Mining. ACM, pp. 2060—2069, 2018.
    [19] Steffen Rendle, Christoph Freudenthaler, Zeno Gantner and Lars Schmidt-Thieme, “Bpr: Bayesian personalized ranking from implicit feedback,” in Uncertainty in Artificial Intelligence, pp. 452—461, 2009.
    [20] Yi Tay, Anh Tuan Luu, and Siu Cheung Hui, “Multi-pointer co-attention networks for recommendation,” in Proceedings of the 24th ACM Special Interest Group on Knowledge Discovery and Data Mining International Conference on Knowledge Discovery & Data Mining, pp. 2309—2318, 2018.
    [21] Hongwei Wang, Fuzheng Zhang, Xing Xie, and Minyi Guo, “DKN: Deep Knowledge-Aware Network for News Recommendation,” In Proceedings of the 2018 World Wide Web Conference on World Wide Web, International World Wide Web Conferences Steering Committee, pp.1835—1844, 2018.
    [22] Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng and Tat-Seng Chua, “Neural Graph Collaborative Filtering,” In Proceedings of the 42nd International ACM Special Interest Group on Information Retrieval Conference on Research and Development in Information Retrieval, 2019.
    [23] Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao and Tat-Seng Chua, “Explainable Reasoning over Knowledge Graphs for Recommendation,” in Proceedings of the Association for the Advancement of Artificial Intelligence, 2019.
    [24] Lei Zheng, Vahid Noroozi, and Philip S. Yu, “Joint deep modeling of users and items using reviews for recommendation,” In Proceedings of the Web Search and Data Mining, pp.425—434, 2017.
    [25] Yongfeng Zhang, Guokun Lai, Min Zhang, Yi Zhang, Yiqun Liu and Shaoping Ma, “Explicit factor models for explainable recommendation based on phrase-level sentiment analysis,” in Proceedings of the 37th International ACM Special Interest Group on Information Retrieval conference on Research & development in information retrieval, pp. 83—92, 2014.
    [26] Guorui Zhou, Chengru Song, Xiaoqiang Zhu, Xiao Ma, Yanghui Yan, Xingya Dai, Han Zhu, Junqi Jin, Han Li and Kun Gai, “Deep interest network for click-through rate prediction,” arXiv preprint arXiv:1706.06978, 2017.

    下載圖示
    QR CODE