簡易檢索 / 詳目顯示

研究生: 姜博文
Chiang, Bo-Wen
論文名稱: 醫療社群問答系統提問意圖偵測之研究
Automatic Detection of User’s Query Intentions for Community Question Answering
指導教授: 柯佳伶
學位類別: 碩士
Master
系所名稱: 資訊工程學系
Department of Computer Science and Information Engineering
論文出版年: 2018
畢業學年度: 106
語文別: 中文
論文頁數: 81
中文關鍵詞: 意圖類型分類醫療概念關鍵字特徵基於卷積神經網路的學習網路
英文關鍵詞: intention types classification, medical concept keyword feature, learning network based on CNN
DOI URL: http://doi.org/10.6345/THE.NTNU.DCSIE.030.2018.B02
論文種類: 學術論文
相關次數: 點閱:122下載:26
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本論文建立一個使用者提問文本之意圖類型偵測系統,提出三種類型的特徵資料,第一種是詞嵌入向量產生向量維度之間的關聯性特徵資料﹐第二種是每個單詞與醫療概念關鍵字相似度特徵資料,第三種是詞性嵌入向量特徵資料。本論文並提出兩種基於卷積神經網路的學習網路,第一種是CNN Joint Model,利用多種特徵資料的特徵向量,學習預測提問文本之意圖類型,第二種是Ensemble CNN Model,每種特徵資料會先獨立預測提問文本之意圖類型程度值,並利用Ensemble參數學習每個特徵比重,再將每個特徵資料的預測結果與比重相乘後再相加,用以調整模型預測結果。實驗結果顯示,醫療概念關鍵字特徵與詞向量維度關聯特徵同時作為輸入特徵時,能更有效地預測提問文本的意圖類型,再與傳統的詞嵌入向量或詞性嵌入向量做為同時輸入的特徵資料時,可使模型分類效果提升。透過實驗綜合評估,當系統推薦程度值大於門檻值0.3的意圖類型時,可以實現最佳的意圖類型預測效果,F1評估值可達到0.75。

    This paper aims to establish an intention type detection system for user questions. We propose three types of feature data. The first one is using the word embedding vector to generate the correlation features between the various vector dimensions. The second is the similarity features of each word with a set of pre-defined medical concept keywords. The third one is the embedded vector feature of the part-of-speech for each word. Then two frameworks of CNN-based learning models are proposed. The first one is CNN Joint Model, which concatenates CNN output results of various types of features to learn the intention types. The second one is Ensemble CNN Model. The feature data is used to predict the intention type degree value independently. Then the Ensemble parameters are used to learn the weight of each feature to combine the prediction results of various types of features. The results of experiments show that when the medical concept keyword feature and the word vector dimension association feature are combined as input features, the intent type of the question text can be predicted with high F1 measure. To combine with the traditional word embedding vector or part-of-speech embedding vector as the input feature data at the same time, the prediction result can be improved furthermore. Through the comprehensive evaluation on the experiments, when the predicted intention type degree value greater than a threshold value 0.3, the best result of intention types prediction can be achieved, whose F1 measure is at least 0.75.

    第一章 緒論 1 1.1 研究動機 1 1.2 研究目的 2 1.3 研究限制與範圍 4 1.4 論文方法 5 1.5 論文架構 6 第二章 文獻探討 7 2.1 關鍵字搜尋 7 2.2 自然語言提問 8 2.3 以類神經網路進行文本分類 9 第三章 系統架構與資料前處理 14 3.1 系統架構與流程 14 3.2 資料前處理 19 第四章 輸入特徵產生方式 23 4.1 詞嵌入和詞性嵌入向量預訓練 23 4.2 詞向量維度關聯特徵計算 24 4.3 概念關鍵字相似度計算 25 4.4 詞性嵌入向量特徵 27 第五章 使用者意圖偵測方法 28 5.1 CNN Joint Model 29 5.2 Ensemble CNN Model 35 第六章 實驗結果及探討 38 6.1 資料來源與討論 39 6.2 評估指標 40 6.3 CNN Joint Model之分類效果評估 42 6.4 Ensemble CNN Model之分類效果評估 52 6.5 各架構綜合評估 59 第七章 結論與未來研究方向 65 參考文獻 66 附錄一 詞嵌入向量特徵的CNN Model架構和參數設定 70 附錄二 系統預測真實提問文本的意圖類型 71

    [1] Adlassnig, K. P. (1986). Fuzzy set theory in medical diagnosis. In IEEE Transactions on Systems, Man, and Cybernetics.

    [2] Chen, Z., Lin, F., Liu, H., Liu, Y., Ma, W. Y., & Wenyin, L. (2002). User Intention Modeling in Web Applications Using Data Mining. In Journal of World Wide Web.

    [3] Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., & Kuksa, P. (2011). Natural Language Processing (Almost) from Scratch. In Journal of Machine Learning Research.

    [4] Chen, L., Zhang, D., & Levene, M. (2013). Question retrieval with user intent. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval.

    [5] Ding, X., Liu, T., Duan, J., & Nie, J. Y. (2015). Mining User Consumption Intention from Social Media Using Domain Adaptive Convolutional Neural Network. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence.

    [6] Hu, J., Wang, G., Lochovsky, F., Sun, J. T., & Chen, Z. (2009). Understanding user’s query intent with Wikipedia. In Proceedings of the 18th international conference on World wide web.

    [7] Hu, B., Zhang, Y., Chen, W., Wang, G., Yang, Q. (2011) Characterizing search intent diversity into click models. In Proceedings of the 20th international conference on World wide web.

    [8] Kalchbrenner, N., Grefenstette, E., & Blunsom, P. (2014). A Convolutional Neural Network for Modelling Sentences. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.

    [9] Kim, Y. (2014). Convolutional Neural Networks for Sentence Classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing.

    [10] LeCun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. In Proceedings of the IEEE.

    [11] Lai, S., Xu, L., Liu, K., & Zhao, J. (2015). Recurrent Convolutional Neural Networks for Text Classification. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence.

    [12] Tsoumakas, G., & Katakis, I. (2007). Multi-label classification: An overview. In Proceedings of the International Journal of Data Warehousing and Mining, pp. 1-13.

    [13] Xu, P., & Sarikaya, R. (2013). Convolutional neural network based triangular CRF for joint intent detection and slot filling. In IEEE Workshop on Automatic Speech Recognition and Understanding.

    [14] Xu, P., & Sarikaya, R. (2014). Contextual Domain Classification in Spoken Language Understanding Systems Using Recurrent Neural Network. In IEEE International Conference on Acoustics, Speech, and Signal Processing.

    [15] Yin, Y., Zhang, Y., Liu, X., Zhang, Y., Xing, C., & Chen, H. (2014). HealthQA: A Chinese QA summary system for smart health. In International Conference on Smart Health.

    [16] Zhang, H. P., Yu, H. K., Xiong, D.Y., & Liu, Q. (2003). HHMM-based Chinese lexical analyzer ICTCLAS. In Proceedings of the second SIGHAN workshop on Chinese language processing.

    [17] Zhang, X., Zhao, J., & LeCun, Y. (2015). Character-level convolutional networks for text classification. In Proceedings of the 28th International Conference on Neural Information Processing Systems.

    [18] Zhang, C., Fan, W., Du, N., & Yu, P. S. (2016). Mining user intentions from medical queries: A neural network based heterogeneous jointly modeling approach. In Proceedings of the 25th International Conference on World wide web.

    [19] Zhang, C., Du, N., Fan, W., Li, Y., Lu, C. T., & Yu, P. S. (2017). Bringing Semantic Structures to User Intent Detection in Online Medical Queries. In IEEE International Conference on Big Data.

    下載圖示
    QR CODE