| 研究生: |
邱士涵 Chiu,Shih-Han |
|---|---|
| 論文名稱: |
趨近一般化資料倉儲與資料探勘之效能評估模型 Toward a More Generalized Benchmark Workload Model for Data Warehouse and Data Mining |
| 指導教授: |
諶家蘭
Seng,J.L. 季延平 Chi,Y.P. |
| 學位類別: |
碩士
Master |
| 系所名稱: |
商學院 - 資訊管理學系 Department of Management Information System |
| 論文出版年: | 2006 |
| 畢業學年度: | 95 |
| 語文別: | 英文 |
| 論文頁數: | 63 |
| 中文關鍵詞: | 資料倉儲 、資料探勘 、績效評估 、工作量模式 |
| 相關次數: | 點閱:313 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
隨著網際網路的發達以及資料庫技術的成熟,人們取得資料變得非常的容易,再加上許多網際網路的應用其實就是一個自動化的資料收集工具,資料量之大已幾近爆炸的程度。資料倉儲便是一種用來儲存大量歷史資料的資料庫,提供彙整或是統計的資訊,以提供決策使用的資訊技術。而資料探勘是從大量的資料當中把對於決策過程中有幫助的規則找出來,提供給管理人員做為決策的參考,開創新的商業契機。資料倉儲的效能表現對於使用者的工作效率有著深遠的影響。因此有些用以衡量與預測資料倉儲之效能與效率之工作量模式便孕育而生,一般稱之為績效評估工具,然而目前所公佈的一般資料倉儲績效評估工具是針對特定範圍領域建構出某些典型的領域規格,並沒有一個使用者需求導向的資料倉儲績效評估工具。在資料探勘方面,探勘結果的準確度比起資料探勘所花費的時間來得重要,目前卻沒有一個有效、使用者需求導向的工具來評估資料探勘結果的準確度。我們針對資料倉儲的效能評估以及資料探勘準確度評估,設計一個以使用者需求為導向的工作量模型,來評估資料倉儲與資料探勘工具。
As growth of Internet and mature of database technology, people can get the data much easily than before. Many applications on Internet, in fact, are the tools of gather data automatically so that the amount of data is growing bigger and bigger. Data warehouse is one kind of database to store lots of historical data to offer statistical information for the information technology of decisions. Data mining is to find the useful rules for decisions from the amount of data to help the managers make decisions and create the new opportunities of business. The performance of data warehouse is import to user’s work efficiency. Therefore, there are some workload model arise to evaluate and predict the performance and efficiency of data warehouse called benchmark. However, the data warehouse specification announced these days are constructed to some typical domain specific, and the performance evaluation stand on synthetic workload. But, when the difference between the domain of data warehouse user applied and domain of performance evaluation tool is very large, the performance metric may different a lot to the result of benchmark tool. In data mining, the accuracy of mining result is important to business. The accuracy of mining result is more important than the time spend on data mining. However, there is no any useful tool to evaluate the accuracy of mining result and there is no any standard of performance criteria for data mining, either. We design a user requirement-oriented workload to evaluate performance of data warehouse and precision of data mining.
Chapter 1 Introduction
1.1 Research Motivation
1.2 Research Problem
1.3 Research Objective
1.4 Research Limitation
1.5 Research Flow
1.6 Organization of Thesis
Chapter 2 Literature Review
2.1 Data Warehouse and Data Mining
2.2. Data Warehouse Benchmarks
2.2.1 TPC-H and TPC-R
2.2.2 TPC-DS
2.2.3 Data Warehouse Benchmark Comparison
2.3 Data Mining Benchmarks
2.3.1 Microsoft SQL Server 2000 Data Mining Algorithms
2.3.2 Precision Model
2.3.3 Data Mining Benchmark Comparison
Chapter 3 Research Method
3.1 Research Structure
3.2 Data Warehouse Data Model
3.3 Data Warehouse Operation Model
3.4 Data Mining Data Model
3.5 Data Mining Computation Model
3.6 Control model
3.7 Performance Metrics
3.8 Precision Metrics
Chapter 4 Prototype Development
4.1 Prototype Platform and Structure
4.2. Prototype System Design
4.3. Prototype System Implementation
4.3.1 Data Generator
4.3.2 Operation Selector
4.3.3 Computation Selector
4.3.4 Scheduler
4.3.5 Result Collector
Chapter 5 Research Experiment
5.1 Experiment Design
5.2 TPC-H Benchmark experiment
5.2.1 Experiment Specification
5.2.2 Experiment Results
5.3 Microsoft SQL Server 2000 Data Mining Benchmark Experiment
5.3.1 Experiment Specification
5.3.2 Experiment Results
Chapter 6 Research Discussion
6.1 Managerial Findings
6.2 Technical Findings
Chapter 7 Conclusions and Future Research Directions
7.1 Conclusions
7.2 Suggestions for Future Researches
References
1.Inmon, W. H. (2002). Building the Data Warehouse, John Wiley & Sons, Inc., New York, NY.
2.Berry, M. J. A., & Linoff, G. (1997). Data Mining Techniques: For Marketing, Sales, and Customer Support, John Wiley & Sons, Inc., New York, NY.
3.Han, J., & Kamber, M. (2000). Data Mining Concepts and Techniques, Morgan Kaufmann.
4.Fayyad, U. M., & Piatetsky-Shapiro, G., Smyth, P., & Uthurusamy, R. (1996). Advances in Knowledge Discovery and Data Mining. American Association for Artificial Intelligence, AAAAI/MIT Press.
5.Jose, S., Transaction Processing Performance Council (2002), TPC BenchmarkTM H Standard Specification Revision 2.1.0, 1993 - 2002 Transaction Processing Performance Council.
6.Jose, S., Transaction Processing Performance Council (2002), TPC BenchmarkTM R Standard Specification Revision 2.1.0, 1993 - 2002 Transaction Processing Performance Council.
7.Jose, S., Transaction Processing Performance Council (1998), TPC BenchmarkTM D Standard Specification Revision 2.1, 1993 - 1998 Transaction Processing Performance Council.
8.Frawley, W., Piatetsky-Shapiro, G., & Matheus C. (1992, Fall). Knowledge discovery in database: an overview. AI Magazine, 213-228.
9.Grupe, F., & Owrang, M. M. O. (1997). Database Tools to Acquire Knowledge for Rule-Based Systems, Information Software and Technology 39(9), 607-616.
10.Poess, M., & Floyd, C. (2000). New TPC Benchmarks for Decision Support and Web Commerce. ACM SIGMOD Record Volume 29(4), 64 – 71.
11.Hackman, S. T., Frazelle, E. H., Griffin, P. M., Griffin, S. O., & Vlasta D. A. (2001). Benchmarking Warehousing and Distribution Operations: An Input-Output Approach. Journal of Productivity Analysis, 16, 79–100.
12.Vassiliadis, P., Bouzeghoub, M., & Quiz, C. (2000). Towards Quality-oriented Data Warehouse Usage and Evolution. Information Systems 25(2), 89-l 15.
13.Pei, J., Mao, R., Hu, K., & Zhu, H. (2002). Towards Data Mining Benchmarking: A Test Bed for Performance Study of Frequent Pattern Mining. Paper presented at the meeting of the ACM SIGMOD International Conference on Management of Data.
14.Elnaffar, S., Martin, P., & Horman, R. (2002). Automatically Classifying Database. Paper presented at the meeting of the International Conference on Information and Knowledge Management.
15.Leutenegger, S. T., & Dias, D. (1993). A Modeling Study of The TPC-C Benchmark. Paper presented at the meeting of the ACM SIGMOD International Conference on Management of Data.
16.Gray, J. (1992). Database and Transaction Processing Benchmarks. Paper presented at the meeting of the ACM SIGMOD International Conference on Management of Data.
17.Doppelhammer, J., Hoppler, T., Kemper, A., & Kossmann, D. (1997). Database Performance in The Real World TPC-D and SAP R/3. Paper presented at the meeting of the ACM SIGMOD International Conference on Management of Data.
18.Poess, M., Smith, B., Kollar, L., & Larson, P. (2002). TPC-DS, Taking Decision Support Benchmarking to the Next Level. Paper presented at the meeting of the ACM SIGMOD International Conference on Management of Data.
19.Bhashyam, R. (1996). TPC-D - The Challenges, Issues and Results. Paper presented at the meeting of the International Conference on Very Large Data Bases.
20.Caruana, R. & NiculescuMizil, A. (2004, August). Data Mining in Metric Space: An Empirical Analysis of Supervised Learning Performance Criteria. Paper presented at the meeting of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.
21.Vieira, M., & Madeira, H. (2003). A Dependability Benchmark for OLTP Application Environments. Paper presented at the meeting of the International Conference on Very Large Data Bases.
22.Zeller, B., & Kemper, A. (2004). Benchmarking SAP R/3 Archiving Scenarios. Paper presented at the meeting of the International Conference on Data Engineering.
23.Wasserman, T. J., Martin, P., Skillicorn, D. B., & Rizvi, H. (2004), Business Intelligence: Developing a Characterization of Business Intelligence Workloads for Sizing New Database Systems. Paper presented at the meeting of the ACM international workshop on Data Warehousing and OLAP.
24.Fu, L., & Hammer, J. (2000). CubiST: A New Algorithm for Improving the Performance of Ad-hoc OLAP Queries. Paper presented at the meeting of the ACM international workshop on Data Warehousing and OLAP.
25.Poess, M., & Stephens, J. M. (2004). Generating Thousand Benchmark Queries in Seconds. Paper presented at the meeting of the International Conference on VLDB.
26.Gupta, A., Davis, K. C., & Grommon-Litton, J. (2002). Performance Comparison of Property Map and Bitmap Indexing. Paper presented at the meeting of the ACM International Workshop on Data Warehousing and OLAP.
27.Labio, W. J., Yang, J., Cui, Y., Garcia-Molina, H., & Widom, J. (2000). Performance Issues in Incremental Warehouse Maintenance, Paper presented at the meeting of the International Conference on VLDB.
28.Performance Study of Microsoft Data Mining Algorithms, Retrieved December 12, 2005 from http://www.microsoft.com/technet/prodtechnol/sql/2000/maintain/dmperf.mspx
29.Gartner (2004), Press Room, Quick Statistics. Retrieved June 1, 2004 from http://www.dataquest.com/press_gartner/quickstats/databases.html
30.IDC (2004), Worldwide Data Warehousing Tools 2004 Vendor Shares, September 2005, Retrieved March, 20, 2006 from http://www.idc.com
31.Gile, K. (2004), Forrester's Business Technographics November 2004 North American And European Benchmark Study, Retrieved from March, 20, 2006 from http://www.forrester.com
此全文未授權公開