The concern over test consequence has inspired research into the wider impact of language tests and testing policies, but few studies have examined this subject in the context of Taiwan. With the goal of enhancing Taiwan’s global competitiveness by upgrading manpower quality, the central government implemented a 2002 policy to develop the English proficiency of civil servants by recognizing passing marks on approved English language proficiency tests as a promotion criterion. This thesis reports on a research study that adopted a multi-method approach to assess the testing policy’s impact on test-takers and analyze the rationale and consequences of revisions to the policy that were implemented between 2002 and the 2011. A survey of 282 civil servants working in the banking, economics, and finance sectors yielded data about the participants’ self-assessment of their English proficiency and workplace need for the language, English study and test-taking experience, impressions of English proficiency tests, and assessment of the effectiveness of the testing policy. Statistical analysis of the test impression and policy effectiveness data revealed significant correlation between positive assessments of the policy’s impact and the perceived fairness of the testing policy, the policy’s influence on motivation to study English, and the participants’ intrinsic interest in improving their English. Interviews with officials involved in formulating and implementing the testing policy and a review of government documents related to the policy provided data that were incorporated into the Geelhoed-Schouwstra policy analysis framework and facilitated the identification of factors that influenced the outcomes of the testing policy. The results of this study of an English language testing policy help to clarify who the test-takers and test users are, how and why tests are being used, and what the consequences of test use are.

Alderson, J.C. (2007). The CEFR and the need for more research. Modern Language
Journal 91(4), 659-663.

Alderson, J. C., & Wall, D. (1993). Does washback exist? Applied Linguistics 14(2), 115-
129.

Bachman, L. (2005). Building and supporting a case for test use. Language Assessment
Quarterly 2(1), 1-34.

---. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.

Baldauf Jr., R.B. et al. (2007). Successes and failures in language planning for European
languages in Asian Nations. Paper presented at 5th Nitobe Symposium, Tokyo.

Bandura, A. (1989). Self-regulation of motivation and action through internal standards and
goal systems. In A. Pervin, Goal concepts in personality and social psychology
(pp. 19-85). Hillsdale, NJ: Lawrence Erlbaum Associates.

---. (1991). Self-regulation of motivation through anticipatory and self-reactive
mechanisms. In R. A. Dienstbier (Ed.), Nebraska symposium on motivation 1990: Perspectives on motivation (pp. 69-164). Lincoln: University of Nebraska Press.

Boggs, D. L. (1981). Philosophies at issue. In B.W. Kreitlow (Ed.), Examining controversies in
adult education. San Francisco: Jossey-Bass.

Business Language Testing Service (BULATS). (2011). BULATS.
http://www.bulats.org/Bulats/Overview.html.

Byrnes, H. (2007). Developing national language education policies: Reflections of the
CEFR. Modern Language Journal 91(4), 679-685.

Chalhoub-Deville, M. (2009). The intersection of test impact, validation, and
educational reform policy. Annual Review of Applied Linguistics 29, 118-131.

Chen, J., Warden, C., & Chang, H.T. (2005). Motivators that do not motivate:
The case of Chinese EFL learners and the influence of culture on motivation. TESOL Quarterly 39(4), 609-633.

Cheng, L. (2010). The history of examinations: Why, how, what and whom to
select? In Liying Cheng and Andy Curtis (Eds.), English language assessment and the Chinese learner (pp. 13-25). New York: Routledge.

Clement, R., Gardner, R.C., & Smythe, P.C. (1980). Social and individual factors in second
language acquisition. Canadian Journal of Behavioural Science 12, 293-302.
Cooper, R.L. (1989). Language planning and social change. Cambridge: Cambridge
University Press.

Council of Europe. (2001). Common European Framework of Reference for Languages:
learning, teaching, and assessment. Cambridge: Cambridge University Press.

---. (2009). Relating language examinations to the Common European Framework of References
for Languages: Learning, teaching, assessment: A Manual. Strasbourg: Council of Europe.

Cropley, A. (1980). Lifelong learning and systems of education: an overview. In A. Cropley
(Ed.), Towards a system of lifelong education: Some practical considerations. Oxford, Pergamon Press.

Deci, E.L. & Ryan, R.M. (1985). Intrinsic motivation and self-determination in
human behavior. New York: Plenum.

Dörnyei, Z. & Otto I. (1998). Motivation in action: A process model of L2 motivation. In
Working papers in applied linguistics 4. London: Thames Valley University.

Educational Testing Service (ETS). (2007) TOEIC examinee handbook. Princeton: Educational
Testing Service.

---. (2011a). TOEFL iBT test content. http://www.ets.org/toefl/ibt/about/content/.

---. (2011b). TOEIC home. http://www.ets.org/toeic.

---. (2011c). 2010 Taiwan TOEIC results report. http://www.toeic.com.tw/file/11063020.pdf.

Entwhistle, N. (1987). Motivation to learn: conceptualizations and practicalities. British
Journal of Educational Studies 35(2), 129-148.

Fulcher, G. (2005). Deluded by artifices? The Common European Framework and
harmonization. Language Assessment Quarterly 1(4), 253-266.

Fulcher, G. & Davidson, F. (2007). Language testing and assessment; An
advanced resource book. Oxford: Routledge.

Gardner, R.C. (1985). Social psychology and second language learning: The role of attitudes
and motivation. London: Edward Arnold.

Gardner, R.C. & Lambert, W.E. (1972). Attitudes and motivation in second language learning.
Rowley, MA: Newbury.

Gardner, R.C. & McIntyre, P.D. (1991). A instrumental motivation in language study: Who
says it isn’t effective? Studies in Second Language Acquisition 13, 57-72.
Hamp-Lyons, L. (2000). Fairness in language testing. In A.J. Kunnan (Ed.), Studies in Language
Testing: Fairness and validation in language assessment. Cambridge: Cambridge University Press.

Harlen, W., & Crick, R.D. (2003). Testing and motivation for learning. Assessment in Education
10(2), 169-203.

Hawkey, R. (2006). Studies in Language Testing 24: Impact theory and practice.
Cambridge: Cambridge University Press.

Hsu, H.F. (2009). The impact of implementing English proficiency tests as a graduation
requirement at Taiwanese universities of technology. (Doctoral dissertation, University of
York). Retrieved from etheses.whiterose.ac.uk/576/1/PhD_thesis.pdf.

Hughes, A. (2003). Testing for language teachers. Cambridge: Cambridge University Press.

Hughes, C. & Tight, M. (1995). The myth of the learning society. British Journal of
Educational Studies 43(3), 290-304.

Hyatt, D. & Brooks, G. (2009). Investigating stakeholders’ perceptions of IELTS as an entry
requirement for higher education in the UK. In IELTS Research Reports Volume 10.
London: IELTS Australia and British Council.

International English Language Testing Service (IELTS). (2009). Guide for stakeholders.
Cambridge: Cambridge ESOL Examinations.
www.ielts.org/PDF/IELTS Guide for Stakeholders March 2009.pdf.

Jones, N. (2009). A comparative approach to constructing a multilingual proficiency
framework: Constraining the role of standard setting. Cambridge ESOL Research Notes 3, 6-9.

Jones, N. & Saville, N. (2009). European Language Policy: Assessment, learning, and the
CEFR. Annual Review of Applied Linguistics 29, 51-63.

Kellaghan, T., Madaus, G, & Raczek, A. (1996). The use of external examinations to improve
student motivation. Washington, DC: AERA.

Khalifa, H. & French, A. (2008). Aligning Cambridge ESOL Examinations to the
CEFR: Issues and practice. Paper presented at 34th Annual Conference, International Association for Educational Assessment.

Knowles, M.S. (1980). The modern practice of adult education. New York: The Adult Education
Company.

Kunnan, A.J. (2005). “Language assessment from a wider context. In Eli Hinkel (Ed.),
Handbook of research in second language teaching and learning. London: Lawrence
Erlbaum Associates.

Kunnan, A. J. & Wu, J. (2009). Language Training and Training Center, Taiwan: Past,
present and future. In L. Cheng & A. Curtis (Ed.), Language Assessment for Chinese
Learners (pp. 77-91). Philadelphia, PA: Routledge.

Language Training and Testing Center (LTTC). (2009). 2009 annual report.
http://www.lttc.ntu.edu.tw/Annualreportfiles/2009annualreport.pdf.

---. (2011a). Foreign Language Proficiency Test.
http://www.lttc.ntu.edu.tw/flpt/Foreign_version/FLPTe.htm.

---. (2011b). Language Testing. http://www.lttc.ntu.edu.tw/E_LTTC/languagetesting.htm.

---. (2011c). GEPT-CEFR alignment.
http://www.lttc.ntu.edu.tw/E_LTTC/E_GEPT/alignment.htm.

---. (2011d). GEPT level descriptors: Superior.
http://www.lttc.ntu.edu.tw/E_LTTC/E_GEPT/superior.htm.

Little, D. (2007). The Common European Framework of reference for languages:
Perspectives on the making of supranational policy. Modern Language Journal 91(4), 645-655.

McNamara, T., and Roever, C. (2006). Language testing: The social dimension. Oxford:
Blackwell Publishing.

Medel-Añonuevo, C., Ohsako, T., & Mauch, W. (2001). Revisiting lifelong learning for the 21st
century. New York: UNESCO Institute for Education.

Messick, S. (1989). Validity,” In R.L. Linn (Ed.), Educational Measurement (pp. 13-103). New
York: Macmillan/American Council on Education.

North, B. (2006). The Common European Framework of Reference: Development,
theoretical, and practical issues. Paper presented at the Osaka University of Foreign
Studies, March 5, 2006.

---. (2007). The CEFR illustrative descriptor scales. Modern Language Journal 91(4), 656-659.

Norton Pierce, B. (1995). Social identity, investment, and language learning. TESOL
Quarterly 29(1), 9-32.

Powers, D.E., Kim, H.J. & Weng, V. (2008). The redesigned TOEIC (Listening and
Reading) Test: Relations to test-taker perceptions of proficiency in English. Princeton:
Educational Testing Service.

Ross, S.J. (2008). Language testing in Asia: Evolution, innovation, and policy changes.
Language Testing 25(1), 5-13.

Saville, N. (2003). The process of test development and revision within Cambridge EFL. In C.
Weir & M. Milanovic (Eds.), Continuity and innovation: Revising the Cambridge
Proficiency in English Examination 1913-2002. Cambridge: Cambridge
ESOL/Cambridge University Press.

Schouwstra, M. & Ellman, M. (2006). A new explanatory model for policy
analysis and evaluation. Tinbergen Institute Discussion Paper. Amsterdam: Tinbergen
Institute.

Shohamy, E. (1982). Affective considerations in language testing. The Modern
Language Journal 66(1), 13-17.

Shohamy, E. (2000). The social responsibility of language testers. In R. Cooper, E. Shohamy,
& J. Walters (Eds.), New perspectives in educational language policy. Philadelphia: John Benjamins Publishing.

Shohamy, E. (2001). The power of tests. A critical perspective on the uses of language
tests. Harlow, Essex: Pearson Education.

Shohamy, E. (2008). Language policy and language assessment: The relationship.
Language Planning 9(3), 363-373.

Sloane, F.C. & Kelly, A.E. (2003). Issues in high-stakes testing programs. Theory into Practice
42(1), 12-17.

Spolsky, B. (1995). Measured Words: The development of objective language testing. Oxford:
Oxford University Press.

Suen, H.K. & Yu, L. (2006). Chronic consequences of high-stakes testing? Lessons
from the Chinese civil service exam. Comparative Education Review 50(1), 46-65.

Taiwan Central Personnel Administration. (2005) English examination promotion scoring
table. http://www.ejob.gov.tw/official/english.htm.

---. (2009). Statistics: Analysis of Public Servants Manpower (Executive Yuan and Subordinate
Administrative Agencies and Schools, 2009 2nd Quarter)
http://www.cpa.gov.tw/%5C/ct.asp?xItem=7276&ctNode=321&mp=10.

Taiwan Executive Yuan. (2005) Action plan for creating English-friendly living environment.
http://www.i-
taiwan.nat.gov.tw/en/index.php?option=com_content&view=article&id=142:action-
plan&catid=31:creating-an-english-friendly-living-environment&Itemid=91.

Taiwan Government Information Office. (2005). Challenge 2008: The six-year national
development plan. http://www.gio-gov.tw/taiwan-website/4-
oa/20020521/2002052101.htm.

Taiwan Ministry of Civil Service. (2008). Civil Service Employment Act.
http://www.mocs.gov.tw/english/英譯法規/任用法_英_-修3.pdf.

----. (n.d.) Introduction to the civil service legal system of Republic of China.
http://www.mocs.gov.tw/english/ls.asp.

Taiwan Ministry of Education. (n.d.) ROC (Taiwan) students in the U.S.A. (1950-2004).
http://english.moe.gov.tw/public/Data/72817222271.jpg.

---. (2005). E-generation national manpower cultivation plan.
http://english.moe.gov.tw/ct.asp?xItem=7043&ctNode=784&mp=3#I.

Taiwan Ministry of Examination. (2008) English to be required as common subject on civil
service examinations. http://www.moex.gov.tw.

Taylor, L. (2004). IELTS, Cambridge ESOL examinations and the common European
framework. Cambridge ESOL Research Notes 18, 2-3.

---. (2005). Washback and impact. ELT Journal 59(2), 154-155.

Tight, M. (1998) Lifelong learning: Opportunity or compulsion? British Journal of
Educational Studies 46(3), 251-63.

Tremblay, P.F. & Gardner, R.C. (1995). Expanding the motivation construct in
language learning. Modern Language Journal 79, 505-18.

Wall, D. (2005). Studies in Language Testing 22: The impact of high-stakes
examinations on classroom teaching. Cambridge: Cambridge University Press.

Weir, C. (2005). Language testing and validation; An evidence-based approach. New
York: Palgrave and Macmillan.

---. (2005). Limitations of the Common European Framework for developing
comparable examinations and tests. Language Testing 22, 281.

Wu, J.R.W. & Wu, R.Y.F. (2010). Relating the GEPT comprehension tests to the
CEFR. Studies in Language Testing 33: Aligning tests with the CEFR: Reflections on using the Council of Europe’s draft manual. Cambridge: Cambridge University Press.