| 研究生: |
李佳紋 Lee, Chia-Wen |
|---|---|
| 論文名稱: |
序貫方法於電腦化效標參照測驗之應用 Sequential Methods in Computerized Criterion-referenced Test |
| 指導教授: |
余清祥
張源俊 |
| 學位類別: |
碩士
Master |
| 系所名稱: |
商學院 - 統計學系 Department of Statistics |
| 論文出版年: | 2000 |
| 畢業學年度: | 88 |
| 語文別: | 英文 |
| 論文頁數: | 54 |
| 中文關鍵詞: | 電腦化效標參照測驗 、試題反應理論 、貝它保護 |
| 外文關鍵詞: | Computerized Criterion-referenced Test, Item Response Theory, beta-protection |
| 相關次數: | 點閱:219 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
在一場競爭性的考試中,我們如何決定要錄取或是淘汰這個考生?傳統的紙筆測驗方式固定題目總數,考生回答相同的題目,60分以上為及格。隨著電腦科技的快速發展,測驗型式也由紙筆轉換成電腦操作,也就是電腦化測驗。所謂電腦化效標參照測驗(computerized criterion-referenced test)即是把考生能力分成兩個以上的程度區間,藉由考生的答題狀況來判斷考生應歸屬於哪個區間。這種測驗方式與傳統測驗不同的是:電腦化測驗是依據考生的答題表現來給題,考生能力越偏離分段點(thresholds),需要的題數就越少;越接近分段點,需要的題數就越多。
在這篇論文中,我們運用兩個參數的羅吉斯模型(two-parameter logistic model)來估計考生之於試題的答對機率。藉由電腦模擬來探討結合貝它保護(beta-protection)方法和適性測驗對平均測驗題數及誤判率(亦即考生真正的能力與電腦判斷的區間不同)的影響。在模擬過程中,我們也介紹了試題參數的選擇情形,估計考生能力的方法以及在貝它保護下,停止選題的規則。根據這些原則,電腦模擬結果證明使用適性測驗加上貝它保護方法能夠有效地控制誤判率在規定的範圍內,程度不同的考生也能控制有不同的測驗題數。
In a traditional Paper-and-Pencil (p-and-p) test, all examinees have same test items and the number of items is fixed. The examinee fails or passes the exam depends on if his/her test score exceeds a predetermined scores, say, 60 out of 100. However, with the rapid advancement of modern computer technology, the test form has been converted from p-and-p to computer terminal. Computerized criterion-referenced classify the examinees into more than two categories according to his/her answers to the items. It differs from the conventional standardized test in that the selection of test items is tailored to each examinee’s ability level. Typically, those examinees with high ability or low ability will have shorter average test length (ATL) than examinees with ability that close to thresholds.
In this thesis, we assume that the probability of choosing correct response to an item follows a two-parameter logistic (2-PL) model. Our goal is to study the performance of ATL and misclassification rate (MR) using beta-protection method and adaptive sequential item selection. On the simulation procedures, we also introduce the selection rule of item parameter, the methods used to estimate an examinee’s ability, and the stopping rule with beta-protection. Simulation results show that using adaptive test and beta-protection method can control the MR within specified level and the number of test items required depends on the examinee’s ability.
封面頁
證明書
致謝詞
論文摘要
目錄
表目錄
圖目錄
1 Introduction
1.1 Item Response Theory
1.2 Sequential Probability Ratio Test
1.3 Confidence Intervals with Beta Protection
2 Methods for Criterion-referenced Test
2.1 Multiple-Category Classification Using a SPRT
2.2 Fully Sequential Procedure
2.3 Maximum Likelihood Estimate and Bias Correction for MLE
2.4 Choice of Discrimination Parameter
3 Computerized Mastery Test
3.1 Items, Ability and Threshold Selection
3.2 Simulation Results
3.3 Tables and Figures for CMT
4 Computerized Criterion-referenced Test
4.1 Simulation Procedures
4.2 Simulation Results
4.3 Tables and Figures for Criterion-referenced Test
5 Conclusions and Discussion
References
Chang, Hua-Hua and Ying, Zhiliang (1997a). Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive tests. The Annals of Statistics. Tentatively accepted.
Epstein, K. (1978). Applications of sequential testing procedures to performance testing. In D. J. Weiss (Ed.), Proceedings of the 1977 computerized adaptive testing conference. Minneapolis: university of Minnesota, Department of Psychology, Psychometric Methods Program.
Ferguson, R. L. (1969a). Computer-assisted Criterion-referenced Measurement (working Paper No. 41). Pittsburgh, PA: University of Pittsburgh, Learning and Research Development Center. (Eric Document Reproduction Service No. ED 037 089)
Ferguson, R. L. (1969b). The Development, implementation, and evaluation of a computer-assisted branched test for a program of individually prescribed instruction. Unpublished doctoral dissertation, University of Pittsburgh, PA. (University Microfilms No. 70-4530)
Hambleton, R. K., Swaminathan, H. and Rogers, H. Jane (1991). Fundamentals of Item Response Theory. Newbury Park, CA:Sage.
Juhlin, K. D. (1985). Sequential and non-sequential confidence intervals with guaranteed coverage probability and beta-protection. PhD Dissertation, University of Illinois.
Kingsbury, G. Gage and Weiss, D. J. (1983). A comparison of IRT-based adaptive mastery test and a sequential mastery testing procedure. In D.J. Weiss (Ed.), New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing (pp. 237-255). New York: Academic Press.
Lewis, C. and Sheehan, K. (1990). Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement, 14(4), 367-386.
Lord, F. M. (1952). A Theory of Test Scores (Psychometric Monograph No. 7). Iowa City, IA: Psychometric Society.
Lord, F. M. (1980). Applications of Item Response Theory to Practical Testing Problems. Hillsdale, NJ: Lawrence Erlbaum.
Lord, F. M. (1983). Unbiased estimators of ability parameters, of their variance, and of their parallel-forms reliability. Psychometrika, 48(2), 233-244.
(限達賢圖書館四樓資訊教室A單機使用)