跳到主要內容

簡易檢索 / 詳目顯示

研究生: 陳定宇
Chen, Ting-Yu
論文名稱: 基於性格特質的社群討論回應生成
Personality-based Response Generation for Social Discussion
指導教授: 黃佳慧
Huang, Chia-Hui
黃瀚萱
Huang, Hen-Hsen
口試委員: 張詠淳
Chang, Yung-Chun
學位類別: 碩士
Master
系所名稱: 商學院 - 統計學系
Department of Statistics
論文出版年: 2021
畢業學年度: 109
語文別: 中文
論文頁數: 86
中文關鍵詞: 對話生成鑑別學習人格特質建模
外文關鍵詞: Dialog generation, Personalities, Discriminative learning
DOI URL: http://doi.org/10.6814/NCCU202101488
相關次數: 點閱:64下載:13
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 在對話生成的研究中,雖然有部份研究針對個人化的文字生成有所探討,但主要專注於個人化的語言風格、或是職業性別等個人化的背景資訊。本研究嘗試了另一個向度的個人化文字生成,產生具有特定人格特質的文字,模擬不同性格的人,在社群媒體上的發文。本研究利用現有的資料集,再爬取社群媒體平台上的討論串,建立訓練資料集。為了強化文字生成模型對不同人格特質的建模,本研究發展了創新的鑑別學習法,引入新的損失函數,讓模型不僅能生成通順、合理的文字,並且呈現較為明顯的個人特質。實驗結果經自動與人工驗證,顯示本研究所提出之方法的效度。


    Previous works that attempt to emulate the human properties in dialog generation mostly focus on the incorporation of personal information or language style in the generated text. In this work, we aim to introduce a different kind of human properties in dialog generation, the personalities, to generate the response in social discussion according to a certain type of personality. We create a corpus that was crawled from a social platform with the label of personalities for the users. A novel discriminative learning approach is proposed to enhance the neural generation model toward the extrovert or the introvert personality. Both automatic and human evaluation are conducted for showing the effectiveness of our approach.

    第一章 緒論 10
    一、 背景 10
    二、 研究目標 13
    第二章 文獻探討 14
    一、 文獻回顧 14
    第三章 相關研究 16
    一、 序列對序列模型 16
    二、 基於規則系統(Rule-base System) 20
    三、 基於RNN 22
    四、 基於GPT-1 24
    五、 基於GPT-2 26
    六、 基於GPT-3 26
    七、 Conditional Transformer Language Model 28
    八、 自然語言處理與性格相關文獻 29
    第四章 資料集介紹 30
    一、 資料集背景 30
    二、 資料集 30
    三、 資料清洗 33
    四、 探索資料分析 34
    第五章 研究方法 41
    一、 條件定義 41
    二、 DialoGPT模型 41
    三、 CTRL模型 42
    四、 DialogRPT模型 43
    五、 XGBoost 45
    六、 不同模型下的條件應用 47
    第六章 實驗 48
    一、 評估標準 48
    二、 超參數設定 49
    三、 實驗結果 49
    四、 CTRL模型 49
    五、 DialogRPT模型 54
    六、 DialoGPT模型 63
    七、 XGBoost 74
    八、 鑑別學習 75
    九、 人工驗證 78
    十、 人工驗證結果 79
    第七章 結論與展望 84
    參考文獻 85

    AbuShawar, B., & Atwell, E. (2015). ALICE chatbot: Trials and outputs. Computación y Sistemas, 19(4), 625-632

    Adiwardana, D., & Luong, T. (2020). Towards a Conversational Agent that Can Chat About… Anything. Google AI Blog.

    Bogatu, A., Rotarescu, D., Rebedea, T., & Ruseti, S. (2015). Conversational Agent that Models a Historical Personality. In RoCHI (pp. 81-86).

    Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078..

    Chen, T., & Guestrin, C. (2016, August). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785-794).

    Furnham, A. (1996). The big five versus the big four: the relationship between the Myers-Briggs Type Indicator (MBTI) and NEO-PI five factor model of personality. Personality and individual differences, 21(2), 303-307.

    Gjurković, M., & Šnajder, J. (2018, June). Reddit: A gold mine for personality prediction. In Proceedings of the Second Workshop on Computational Modeling of People’s Opinions, Personality, and Emotions in Social Media (pp. 87-97).

    Gaikwad, S. (2019). Chatbots with Personality Using Deep Learning

    Gao, X., Zhang, Y., Galley, M., Brockett, C., & Dolan, B. (2020). Dialogue response ranking training with large-scale human feedback data. arXiv preprint arXiv:2009.06978.

    Keskar, N. S., McCann, B., Varshney, L. R., Xiong, C., & Socher, R. (2019). Ctrl: A conditional transformer language model for controllable generation. arXiv preprint arXiv:1909.05858.

    Louridas, A., Halstead, A., & Beddoes-Jones, F. (2002). An evaluation of the thinking preferences of engineers to assist in their personal and professional development. Greece 4th International Conference on Education, Athens

    Luyckx, K., & Daelemans, W. (2008, August). Authorship attribution and verification with many authors and limited data. In Proceedings of the 22nd International Conference on Computational Linguistics (Coling 2008) (pp. 513-520).

    Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners. OpenAI blog, 1(8), 9.

    Wright, D. (2014). Stylistics versus Statistics: A corpus linguistic approach to combining techniques in forensic authorship analysis using Enron emails (Doctoral dissertation, University of Leeds)

    Weizenbaum, J. (1966). ELIZA—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1), 36-45

    Wallace, R. S. (2009). The anatomy of ALICE. In Parsing the turing test (pp.181-210). Springer, Dordrecht.

    Zumstein, D., & Hundertmark, S. (2017). CHATBOTS--AN INTERACTIVE TECHNOLOGY FOR PERSONALIZED COMMUNICATION, TRANSACTIONS AND SERVICES. IADIS International Journal on WWW/Internet, 15(1)

    Zhou, L., Gao, J., Li, D., & Shum, H. Y. (2020). The design and implementation of xiaoice, an empathetic social chatbot. Computational Linguistics, 46(1), 53-93.

    Zhang, Y., Sun, S., Galley, M., Chen, Y. C., Brockett, C., Gao, X., ... & Dolan, B.(2019). Dialogpt: Large-scale generative pre-training for conversational response generation. arXiv preprint arXiv:1911.00536.

    QR CODE
    :::