| 研究生: |
周鼎智 Chou, Ting Chih |
|---|---|
| 論文名稱: |
矩陣分解法與隨機效應模型法應用於電影評分資料分析比較 Application of Matrix Factorization and Random Effect Model to analysis and comparison of movie rating data |
| 指導教授: |
翁久幸
Weng, Chiu Hsing |
| 口試委員: |
洪英超
Hung, Ying Chao 陳定立 Chen, Ting Li |
| 學位類別: |
碩士
Master |
| 系所名稱: |
商學院 - 統計學系 Department of Statistics |
| 論文出版年: | 2018 |
| 畢業學年度: | 106 |
| 語文別: | 中文 |
| 論文頁數: | 37 |
| 中文關鍵詞: | 推薦系統 、隨機效應模型法 、矩陣分解法 、MoiveLens |
| 外文關鍵詞: | Recommender system, Random effects model, Matrix factorization, MoiveLens |
| 相關次數: | 點閱:255 下載:37 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
推薦系統的出現是為了解決訊息過載的問題,其需求隨著科技的進步、網路的普及而增加,相關技術也越發多樣且成熟。廣泛應用於各領域的統計模型也在技術的行列中。
推薦系統的運作仰賴使用者偏好訊息,而使用者對項目所組成的偏好空間往往十分巨大且不平衡,統計上需要相對複雜的隨機效應模型或混合效應模型來描繪這樣的變數結構,且通常需要計算效率相對低的反覆疊代過程來估計模型參數。因此Perry(2014)、Gao & Owen(2016)先後提出以動差法處理階層線性模型與兩因子隨機效應模型,是一種犧牲統計效率換取計算效率的做法。
本研究便是採用統計模型中的隨機效應模型法,分別以最大概似法和動差法估計參數,與同為協同過濾技術觀點的矩陣分解法進行分析比較。透過預測準確度和運算效率兩個層面,來評估各演算法在MoiveLens這筆資料上的推薦表現。
根據試驗結果歸納出隨機效應模型法無論以什麼樣的參數估計方式,在預測準確度的表現上都不如矩陣分解法來得好;但以動差法估計參數在穩定度上與矩陣分解法的表現差不多,且在運算效率上好很多。
The recommender system (RS) appeared to solve the problem of information overload. The demand of the RS has increased with the advancement of technology and the popularity of the Internet, and related techniques have become more diverse and mature. The statistical models widely used in various fields are also in the list of techniques.
The operation of the RS relies on user preference information, and the space of users’ preference to items is often large and unbalanced. Statistically, relatively complex random effects models or mixed effects models are needed to describe such variable structures, and often require a large number of iterations to estimate model parameters. Perry (2014), Gao & Owen (2016) proposed using the moment-based method to deal with hierarchical linear models and two-factor random effects models, respectively, expressing an idea of sacrificing statistical efficiency in exchange for computational efficiency.
In this study, we analyze and compare the random effects model, using the maximum likelihood method and the moment-based method to estimate the parameters with the matrix factorization. Through the prediction accuracy and computational efficiency to evaluate the performance of each algorithm on the MoiveLens data.
According to the experiment results, the random effects model is not as good as the matrix factorization in terms of the prediction accuracy no matter what kind of parameter estimation method is used; however, the performance of the moment-based parameter estimation is consistent with the matrix factorization in terms of the prediction stability, and much better in terms of the efficiency.
第一章 緒論 1
1.1 研究背景 1
1.1.1 推薦系統簡介 1
1.1.2 推薦系統面臨的問題 4
1.2 研究目的 5
第二章 文獻探討 6
2.1 最近鄰法 6
2.2 矩陣分解法 9
2.3 統計模型法 11
第三章 研究方法 13
3.1 矩陣分解法 13
3.2 隨機效應模型法 16
3.2.1 最大概似法 16
3.2.2 動差法 19
第四章 實證研究 21
4.1 資料描述 21
4.2 試驗流程 22
4.3 結果分析 25
4.3.1 MovieLens 100K數據集 25
4.3.2 MovieLens 1M數據集 29
第五章 結論與建議 34
參考文獻 36
Ansari, A., Essegaier, S., & Kohli, R. (2000). Internet recommendations systems. J. Marketing Research 37, 363–375.
Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H., Dai, B., Grothendieck, G., & Green, P. (2015) Fitting Linear Mixed-Effects Models Using lme4 Journal of Statistical Software, 67(1), 1–48.
Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H., Dai, B., Grothendieck, G., & Green, P. (2017) lme4: Linear Mixed-Effects Models using 'Eigen' and S4. R package version 1.1-14. https://cran.r-project.org/web/packages/lme4/index.html
Chin, W. S., Zhuang, Y., Juan, Y. C., & Lin, C. J. (2015). A fast parallel stochastic gradient method for matrix factorization in shared memory systems. ACM Transactions on Intelligent Systems and Technology (TIST), 6(1), 2.
Condliff, M. K., Lewis, D. D., Madigan, D., & Posse, C. (1999). Bayesian mixed-effects models for recommender systems. In Proceedings of the ACM SIGIR ’99 Workshop on Recommender Systems: Algorithms and Evaluation.
Funk, S. (2006, Dec.). Netflix Update: Try This at Home. http://sifter.org/~simon/journal/20061211.html.
Gao, K. & Owen, A. (2016). Efficient Moment Calculations for Variance Components in Large Unbalanced Crossed. Electron. J. Statist. Volume 11, Number 1, 2017, 1235-1296.
Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8).
Matloff, N. S. (2017) rectools: Advanced Package for Recommender Systems. R package. https://github.com/Pooja-Rajkumar/rectools
Perry, P. (2014). Fast Moment-Based Estimation for Hierarchical Models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 79(1), 267-291.
Qiu, Y., Lin, C. J., Juan, Y. C., Chin, W. S., Zhuang, Y., Yuan, B. W., Yang, M. Y., et al. (2017) recosystem: Recommender System using Matrix Factorization. R package version 0.4.2. https://cran.r-project.org/web/packages/recosystem/index.html
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., & Riedl, J. (1994). GroupLens: an open architecture for collaborative filtering of netnews. In Proceedings of the 1994 ACM conference on Computer supported cooperative work (pp. 175-186). ACM.
Sarwar, B., Karypis, G., Konstan, J., & Riedl, J. (2001). Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web (pp. 285-295). ACM.