| 研究生: |
黃秋霖 Huang, Qiu-Lin |
|---|---|
| 論文名稱: |
The Influence of Variance in Two-Armed Bandit Problems |
| 指導教授: |
余清祥
Yu, Qing-Xiang |
| 學位類別: |
碩士
Master |
| 系所名稱: |
商學院 - 統計學系 Department of Statistics |
| 論文出版年: | 1996 |
| 畢業學年度: | 84 |
| 語文別: | 英文 |
| 論文頁數: | 52 |
| 中文關鍵詞: | Two-armed bandit問題 、治療法 、策略 、效用函數 、變異因子 |
| 相關次數: | 點閱:203 下載:0 |
| 分享至: |
| 查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本論文主要是發掘變異數在Two-armed Bandit問題中的影響。在文中我們假設兩種治療法的成功率分別是θ1和θ2,且以π1~Beta(cα,cβ)和π2~Beta(α,β)為其驗前機率分配。此外,我們假設所有病人數(N)已知。
我們證明了當N=2、3,變異因子(c)>1時,最佳的策略是k1*=0,也就是說,我們不應在成功率的變異數較小的治療法上做試驗。這個結果和One-armed Bandit問題(c=∞)的結論是一樣的。但是,當N=10、12的例子中,我們發現k1*=0就並非是最佳的策略。
當α=β時,我們證明了效用函數是c的遞減函數。也就是說,其中一個治療法的變異越小,效用亦越小。當α=β=c=1時,最佳的策略是k^*=k_2^*≈√(1+N)-1。此外,我們也證明了效用函數是c的連續函數。
The focus of the report is to find the influence of variance in Two-armed Bandit problems. In this report, we consider the case when the success probabilities of the two treatmentsθ1,θ2 haveπ1~Beta(cα,cβ) andπ2~Beta(α,β) as their priors, and the total number of patients, N is known.
We showed that for N=2 and 3 the optimal strategy is k1*=0 if variance factor, c>1. That is, we should not make trials on the treatment which variance is smaller. But when N=10 and 12, we showed that k1*=0 is not optimal.
When α=β we showed that the utility function is a decreasing function of the c. That is, the smaller variance of a treatment is the smaller utility will be. We have found that
k^*=k_2^*≈√(1+N)-1 whenα=β=c=1. Besides, we also have the continuity of utility function in c.
Abstract i
1INTRODUCTION 1
1.1PRELIMINARIES..........1
1.2LITERATURE REVIEW..........4
2MODEL 7
2.1INTRODUCTION..........7
2.2ASSUMPTION..........7
2.3STRATEGIES..........9
3KNOWN TRIAL LENGTH 12
3.1INTRODUCTION..........12
3.2GENERAL RESULTS..........13
3.3THE INFLUENCE OF THE VARIANCE FACTOR..........24
3.4CONTINUITY OF UTILITY FUNCTION..........37
4CONCLUSION AND COMMENTS 41
Bibliography 43
[1] Apostal, T. M. (1975) Mathematical analysis. Addison- Wesley.
[2] Berry, D. A. and Fristedt, B. (1985) Bandit problems - Sequential allocation of experiments, Ch.apm.an and Hall.
[3] Berry, D. A. and Pearson, L. (1984) Optimal design for two-stage clinical trials with dichotomous responses. Unit. of Minnesota Tech.. Rep.
[4] Canner, P. L. (1970). Selecting one of the two treatments when the responses are dichotomous, J.A.S.A. , 65, 293-306.
[5] Chernoff, H. and Ray, S. N. (1965). A bayes sequential sampling inspection plan. Ann. Math.. Statist. 36, 1387-1407.
[6] Clayton, M. K. and ' Witmer, J. A. (1988) Two-stage bandit , Annals of Stat. Vo1.16 , No.2, 887-894.
[7] Colton, T. (1963) A model for selecting one of two medical treatment. J.A.S.A. , 58, 388-400.
[8] Cornfield, J., Halperin, M. , and Greenhouse, S.W. (1969). An adaptive procedure for sequential clinical trials. 1. A.S.A, 64, 759- 770.
[9] Eick, S. G. (1988) The two-armed bandit with delayed responses, Annals of Stat, Vol.l6, No.2: 254-264.
[10] Eick, S. G. (1988) Gittins procedures for bandits with delayed responses: J.R.S.S. , Soc. B , 50, No.1, 125-132 .
[11] Petkau, A. J. (1978) Sequential medical trials for comparing an experimental with a standard treatment. 1. Am.er. Statist. Assoc, 73, 328-338.
[12] Witmer, J. A. (1983) Bayesian multistage decision problems, Ph. D. Thesis.
[13] Witmer , J. A. (1986) Bayesian multistage decision problems, Annals of Stat., Vol. 14, No. 1. 283-297.
(限達賢圖書館四樓資訊教室A單機使用)