研究生: |
蕭郁霖 Hsiao, Yu-Lin |
---|---|
論文名稱: |
建構與驗證英文詞彙知識測驗 Constructing and Validating an English Vocabulary knowledge Test |
指導教授: |
朱錫琴
Chu, Hsi-Chin |
學位類別: |
碩士 Master |
系所名稱: |
英語學系 Department of English |
論文出版年: | 2018 |
畢業學年度: | 106 |
語文別: | 中文 |
論文頁數: | 110 |
中文關鍵詞: | 潛在特質理論 、英文單字字彙頻率 、試題發展 、英文單字量測驗 、單字難度 |
英文關鍵詞: | Latent Trait Theory, word frequency, word difficulty, English vocabulary size test, test development |
DOI URL: | http://doi.org/10.6345/THE.NTNU.DE.011.2018.A07 |
論文種類: | 學術論文 |
相關次數: | 點閱:194 下載:21 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
由於單字量和語言學習各方面有著緊密的關係,因此在語言學習中有著舉足輕重的地位。為了有效率地學習新字彙,學生必須先了解自己的單字量在哪個階層,才能有效地把學習重點放在符合自己程度的教材上。目前台灣學校英語學習教育多採用大考中心所公布的6,840參考字彙表,但是裡面已有部分單字對於當前台灣中小學語言學習者來說,有難度過高的狀況產生,因此本研究採用最新以COCA語料庫為基礎的字頻表,並從裡面依據字頻挑選前6,050個單字來製作單字測驗。
本測驗分A和B兩份試卷共180題,每題皆有四個選項的單選題。不同於以往的單字測驗的選字模式,本測驗只集中挑選六個單字階層中附近的字彙來製作試題,期望以是否通過某單字階層來解釋受試者的字彙量。以潛在特質理論驗證裡面的三個項度: 難易度、鑑別度、及猜測度來驗證本測驗的試題品質。受試者為台北地區的高中生及大學生,共1,198人。
根據研究結果顯示,本測驗在三個項度之中皆展現良好的適合度。由此可知此為具有高效度及信度的測驗,同時也可得知選擇題測驗是適合單字測驗的模式。字彙的難度與單字頻率有著顯著的關係,單字頻率越高,則表示其難度越低越常見。從難度上升幅度來看,階層四到六的幅度遠小於階層一到三的幅度。由此可見,單字階層三為單字學習重要的分水嶺。若學習者能融會貫通階層一到三的單字,便能應用原有的單字基模來學習更多新的單字。此外,從試題困難度分析中,題幹與選項中的詞綴會對試題困難度造成影響。因此,試題設計者須在這方面多加留意。
Vocabulary size has been considered crucial in language learning because of its strong correlation with various aspects of language acquisition. On account of its decisive status in language learning, the issue of how to learn vocabulary effectively has attracted significant attention in second language acquisition studies. Therefore, learners have to know which vocabulary size they should work toward so that they can focus on suitable learning materials. Currently, most schools in Taiwan have adopted the official CEEC wordlist, but it has been found that some of the words are too difficult for language learners. In other words, some low frequency words have been put in Level Two or Three, which hinders learners from making progress in language learning. Thus, the present study adopted the latest word frequency list from COCA and chose the most frequent 6,050 words as the sample pool to develop a vocabulary test.
The present study was divided into two forms, Form A and Form B. The format of the test is four-choice multiple choice questions. Unlike traditional vocabulary size tests, the present study only chose target words near each frequency band in order to explore the concept of passing a certain frequency level to explore learners’ vocabulary sizes. The quality of the test is checked through the difficulty, discrimination, and guessing parameters of Latent Trait Theory. The participants of the present study consisted of high school students and senior students in a national university.
According to the results of this study, this vocabulary test presents good overall model fit, which supports the validity and reliability of the present study and further indicates that the multiple choice format is suitable for a test of vocabulary size. Word difficulty has much to do with word frequency: The more frequently vocabulary occurs, the easier it is. Considering the slope of difficulty, the slope from Levels Four to Six is less steep than that from Levels One to Three, which indicates that Level Three is the cutoff point for vocabulary learning. If language learners can master the words of the first three levels, they can easily use their pre-existing word schemata to acquire more new words.
Moreover, it is noted that the influence of telltale morphemes should be taken in to consideration when analyzing the difficulty of the test. If stems are embedded so as to provide hints of corresponding word parts, caution must be taken when designing the distractors.
Aizawa, K. (2006). Rethinking frequency markers for English-Japanese dictionaries. In M. Murata, K. Minamide, Y. Tono and S. Ishikawa (eds) English lexicography in Japan (pp. 108-119). Tokyo: Taishukan-shoten.
Alderson, J. C., Clapham, C., & Wall, D. (1995). Language test construction and evaluation. Cambridge, England: Cambridge University Press.
Anastasi, A., &Urbina, S. (1997). Psychological testing. New York: Macmillan. Anderson, R. C., &Freebody, P. (1979). Vocabulary Knowledge (Technical Report No.136). Urbana, IL: Center for the Study of Reading. (ERIC ED177480) Anderson, R. C., &Freebody, P. (1981). Vocabulary knowledge. In J. T. Guthrie (ed.),Comprehension and teaching: Research Reviews (pp. 77-117). Newark. DE: International Reading Association.
Attali, Y., & Bar‐Hillel, M. (2003). Guess where: The position of correct answers in multiple‐choice test items as a psychometric variable. Journal of Educational Measurement, 40(2), 109-128.
Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford, England: Oxford University Press.
Bachman, L. F. (2004). Statistical analyses for language assessment: Cambridge, England: Cambridge University Press.
Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford, England: Oxford University Press.
Baylor, C., Hula, W., Donovan, N. J., Doyle, P. J., Kendall, D., &Yorkston, K. (2011). An introduction to item response theory and Rasch models for speech-language pathologists. American Journal of Speech-Language Pathology, 20(3), 243-259.
Bauer, L., & Nation, P. (1993). Word families. International Journal of Lexicography, 6(4), 253-279.
Baumann, J. F., Kame’enui, E. J., & Ash, G. E. (2003). Research on vocabulary instruction: Voltaire redux. In Lapp, D. (Eds.), Handbook of research on teaching the English language arts (pp752-785). Hoboken, NJ : Taylor & Francis.
Beglar, D. (2010). A Rasch-based validation of the Vocabulary Size Test. Language Testing, 27(1), 101-118.
Beglar, D., & Hunt, A. (1999). Revising and validating the 2000 word level and university word level vocabulary tests. Language Testing, 16(2), 131-162.
Bernhardt, E. B., &Kamil, M. L. (1995). Interpreting relationships between L1 and L2 reading: Consolidating the linguistic threshold and the linguistic interdependence hypotheses. Applied Linguistics, 16(1), 15-34.
Bertram, R., Baayen, R. H., &Schreuder, R. (2000). Effects of family size for complex words. Journal of Memory and Language, 42(3), 390-405.
Blachowicz, C. L., & Fisher, P. (2004). Vocabulary lessons. Educational Leadership, 61(6), 66-69.
Brown, J. D., & Hudson, T. (2002). Criterion-referenced language testing. Cambridge, England: Cambridge University Press.
Carrell, P. L., &Eisterhold, J. C. (1983). Schema theory and ESL reading pedagogy. TESOL Quarterly, 17(4), 553-573.
Carver, R. P. (1994). Percentage of unknown vocabulary words in text as a function of the relative difficulty of the text: Implications for instruction. Journal of Literacy Research, 26(4), 413-437.
Campion, M. E., & Elley, W. B. (1971). An academic vocabulary list. New Zealand Council for Educational Research.
Chen, L.-J. (2011). An application of Item Response Theory to Developing and Validating a Vocabulary Levels Test. Unpublished master’s thesis, National Taiwan Normal University, Taipei, R.O.C.
Cheng,M.H.(2014).The Application of Latent Trait Theory to Developing and Validating a Vocabulary Size Test. Retrieved October 18, 2017, from http://etds.lib.ntnu.edu.tw/cgibin/gs32/gsweb.cgi?o=dstdcdr&s=id=%22GN0599211103%22.&searchmode=basic
Christenfeld, N. (1995). Choices from identical options. Psychological Science, 6(1), 50-55.
Cizek, G. J. (1994). The effect of altering the position of options in a multiple-choice examination. Educational and psychological measurement, 54(1), 8-20.
Coady, J., &Huckin, T. (1997). Second language vocabulary acquisition: A rationale for pedagogy. New York: Cambridge University Press.
College Entrance Examination Center. (2000). 大考中心高中英文參考詞彙表.Retrieved from http://www.ceec.edu.tw/Research/paper_doc/ce37/ce37.htm
Corson, D. (1995). Using English words. Dordrecht, The Netherlands: Kluwe Academic Publishers.
Coxhead, A. (2000). A new academic word list. TESOL quarterly, 34(2), 213-238.
Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological bulletin, 52(4), 281.
Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6(4), 475-494.
Cronbach, L. J. (1950). Further evidence on response sets and test design.Educational and Psychological Measurement, 10, 3-31.
Cronbach, L. J. (1971). Test validation. Educational Measurement, 2, 443-507.
Daller, H., Milton, J., &Treffers-Daller, J. (2007). Modelling and assessing vocabulary knowledge. Cambridge, England: Cambridge University Press.
Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T., & McNamara, T. (1999).Dictionary of language testing. Cambridge, England: Cambridge University Press.
Fagley, N. (1987). Positional response bias in multiple-choice tests of learning: Its relation to testwiseness and guessing strategy. Journal of Educational Psychology, 79(1), 95.
Fan, M. (2000). How big is the gap and how to narrow it? An investigation into the active and passive vocabulary knowledge of L2 learners. RELC Journal, 31(2), 105-119.
Gardner, D., & Davies, M. (2013). A new academic vocabulary list. Applied Linguistics, 35(3), 305-327.
Goulden, R., Nation, P., & Read, J. (1990). How large can a receptive vocabulary be? Applied Linguistics, 11(4), 341-363
Graves, M. F., & Watts-Taffe, S. M. (2002). The place of word consciousness in a research-based vocabulary program. What research has to say about reading instruction, 3, 140-165.
Jeng, H.S., Chang,H.S., Cheng, Y.S. &Gu, Y.S.(2002). 6,480-word list for English teaching and textbook writing at senior high school level in Taiwan. College Entrance Examination Center. Retrieved May. 29, 2013, from http://www.ceec.edu.tw/research/paper_doc/ce37/2.pdf
Kean, J., & Reilly, J. (2014). Item response theory. Handbook for Clinical Research: Design, Statistics and Implementation.(pp195-198). New York, NY: Demos Medical Publishing.
Kučera, H., & Francis, W. N. (1967). Computational analysis of present-day American English. Providence, RI: Brown University Press.
Haladyna, T. M., & Rodriguez, M. C. (2004). Developing and validating multiple-choice test items. New York: Routledge.
Hambleton, R. K., &Swaminathan, H. (1984). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff Publishing.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, California: Sage Publications.
Hanna, G. S., &Dettmer, P. A. (2004). Assessment for effective teaching: Using context-adaptive planning.Boston: Pearson A and B.
Heaton, J. B. (1975). Writing English language tests. New York: Longman.
Heaton, J. B. (1990). Classroom testing. New York: Longman.
Hilton, H. (2008). The link between vocabulary knowledge and spoken L2 fluency.Language Learning Journal, 36(2), 153.
Hirsh, D., & Nation, P. (1992). What vocabulary size is needed to read unsimplified texts for pleasure?. Reading in a Foreign Language, 8, 689-689.
Hsueh-Chao, M. H., & Nation, P. (2000). Unknown Vocabulary Density and Reading Comprehension. Reading in a Foreign Language, 13(1), 403-430.
Hughes, A. (2003). Testing for language teachers. New York: Cambridge University Press.
Hula, W. D., Fergadiotis, G., & Martin, N. (2012). Model choice and sample size in item response theory analysis of aphasia tests. American Journal of Speech-Language Pathology, 21(2), S38-S50.
Laufer, B. (1982). Does the EFL reader need reading strategies more than language Some experimental evidence. Paper presented at the Annual Meeting of the American Council on the Teaching of Foreign Languages, New York.
Laufer, B. (1997). The lexical plight in second language reading: Words you don’t know, words you think you know, and words you can’t guess. In Coady, J., &Huckin, T. (Eds.), Second language vocabulary acquisition: A rationale for pedagogy (pp.20-34). Cambridge, England: Cambridge University Press.
Laufer, B. (1998). The development of passive and active vocabulary in a second language: Same or different? Applied Linguistics, 19(2), 255-271.
Laufer, B. (2010). Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size and reading comprehension. Reading in a Foreign Language, 22(1), 15.
Laufer, B., Elder, C., Hill, K., &Congdon, P. (2004). Size and strength: do we need both to measure vocabulary knowledge? Language Testing, 21(2), 202-226.
Laufer, B., &Paribakht, T. S. (1998). The relationship between passive and active vocabularies: Effects of languagelearning context. Language Learning, 48(3), 365-391.
Lee, J. W., &Schallert, D. L. (1997). The relative contribution of L2 language proficiency and L1 reading ability to L2 reading performance: A test of the threshold hypothesis in an EFL context. Tesol Quarterly, 31(4), 713-7
Lin, C.H.(2006). A Quantitative Analysis of the Vocabulary in the First Volume of Taiwanese Senior High School English Textbooks. Unpublished MA thesis, University.
Mackey, W. F. (1967). Language teaching analysis. Bloomington, IN: Indiana University Press.
McCarthy, M. (1990). Vocabulary. Oxford, England: Oxford University Press.
McNamara, T. F., &Candlin, C. N. (1996). Measuring second language performance.London, England: Longman.
McNamara, W. J., & Weitzman, E. (1945). The effect of choice placement on the difficulty of multiple-choice questions. Journal of Educational Psychology, 36(2), 103.
Meara, P. M. (1992). EFL vocabulary tests: Swansea: Centre for Applied Language Studies, University of Wales.
Meara, P. M. (1996). The dimensions of lexical competence. In Brown, G., Malmkjaer, K., & Williams, J. (Eds.), Performance and competence in second language acquisition (pp. 35-53). Cambridge, England: Cambridge University Press.
Meara, P. M., & Milton, J. L. (2003). X_Lex: The Swansea vocabulary levels test.Newbury, England: Express.
Melka, F. (1997). Receptive vs. productive aspects of vocabulary. In Schmitt, N., & McCarthy, M. (Eds.), Vocabulary: Description, acquisition and pedagogy (pp. 84-102). Cambridge, England: Cambridge University Press.
MelkaTeichroew, F. J. (1982). Receptive versus productive vocabulary: a survey.Interlanguage Studies Bulletin, 6(2), 5-33.
Messick, S. (1980). Test validity and the ethics of assessment. American Psychologist, 35(11), 1012.
Messick, S. (1990). Validity of test interpretation and use. Princeton, NJ: Educational Testing Service. (ERIC ED 395031)
Messick, S. (1996). Validity and washback in language testing. Language Testing, 13(3), 241-256.
Milton, J. (2006). X-Lex: The Swansea vocabulary levels test. In Coombe, C., Davidson, P., & Lloyd, D. (Eds.), Proceedings of the 7thand 8thCurrent Trends in English Language Testing (CTELT) Conference: Vol. 4. (pp. 29-39). UAE: TESOL Arabia.
Milton, J. (2009). Measuring second language vocabulary acquisition. Bristol, England: Multilingual Matters.
Milton, J., &Daller, H. (2007). The interface between theory and learning in vocabulary acquisition. Paper presented at EUROSLA 2008, Newcastle, UK.
Morgan, B., &Oberdeck, L. M. (1930). Active and passive vocabulary. Studies in Modern Language Teaching, 16, 213-221.
Morton, J. (1979). Word recognition. Ithaca, NY: Cornell University Press.
Nagy, W., Anderson, R. C., Schommer, M., Scott, J. A., & Stallman, A. C.(1989).Morphological families in the internal lexicon. Reading Research Quarterly, 262-282.
Nagy, W. E., Herman, P. A., & Anderson, R. C. (1985). Learning words from context. Reading Research Quarterly, 233-253.
Nagy, W. E., & Scott, J. A. (1990). Word schemas: Expectations about the form and meaning of new words. Cognition and Instruction, 7(2), 105-127.
Nation, P. (2001). Learning vocabulary in another language. Cambridge, England: Cambridge University Press.
Nation, P. (2006). How Large a Vocabulary is Needed For Reading and Listening? Canadian Modern Language Review, 63(1), 59-82.
Nation, P. (1990). Teaching and learning vocabulary. New York: Heinle&Heinle Boston.
Nation, P., &Waring, R. (1997). Vocabulary size, text coverage and word lists. In Schmitt, N., & McCarthy, M. (Eds.), Vocabulary: Description, acquisition and pedagogy (pp. 6-19). Cambridge, England: Cambridge University Press.
Nevo, N. (1989). Test-taking strategies on a multiple-choice test of reading comprehension. Language Testing, 6(2), 199-215.
Palmer, H. E. (1968). The scientific study and teaching of languages. London: Oxford U.P..
Paribakht, T. S., &Wesche, M. (1997). Vocabulary enhancement activities and reading for meaning in second language vocabulary acquisition. In Coady, J., &Huckin, T. (Eds.), Second language vocabulary acquisition: A rationale for pedagogy (pp. 174-200). Cambridge, England: Cambridge University Press.
Qian, D. D. (2002). Investigating the relationship between vocabulary knowledge and academic reading performance: An assessment perspective. Language Learning, 52(3), 513-536.
Read, J. (1988). Measuring the Vocabulary Knowledge of Second Langauge Learners.RELC Journal, 19(2), 12-25.
Read, J. (2000). Assessing vocabulary. Cambridge, England: Cambridge University Press.
Riazi, A. M., &Mosalanejad, N. (2010). Evaluation of Learning Objectives in Iranian High-School and Pre-University English Textbooks Using Bloom'sTaxonomy. TESL-EJ,13(4).
Schmitt, N. (2010). Researching vocabulary: A vocabulary research manual.Basingstoke, U.K.: Palgrave Macmillan.
Schmitt, N., & McCarthy, M. (1997). Vocabulary: Description, acquisition and pedagogy. Cambridge, England: Cambridge University Press.
Schmitt, N., Schmitt, D., &Clapham, C. (2001). Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18(1), 55-88.
Schonell, F., Meddleton, I., Shaw, B., Routh, M., Popham, D., Gill, G., et al. (1956). A Study of the Oral Vocabulary of Adults. Brisbane and London: University of Queensland Press/ University of London Press.
Schumacker, R. E. (2005). Classical test analysis. Unpublished doctoral thesis, Applied Measurement Associates.
Scott, J. A., & Nagy, W. E. (2009). Developing word consciousness. In Graves, M. F. (Eds.), Essential readings on vocabulary instruction (pp. 102-113). Newark, DE: International Reading Association
Slakter, M. J. (1968). The effect of guessing strategy on objective test scores. Journal of Educational Measurement, 5(3), 217-222.
Stæhr, L. S. (2008). Vocabulary size and the skills of listening, reading and writing. Language learning journal, 36(2), 139-152.
Stæhr, L. S. (2009). Vocabulary knowledge and advanced listening comprehension in English as a foreign language. Studies in Second Language Acquisition, 31(04), 577.
Taylor, P. H. (1966). A study of the effects of instructions in a multiple‐choice mathematics test. British Journal of Educational Psychology, 36(1), 1-6.
Thorndike, R. L. (1949). Personnel selection; test and measurement techniques. Oxford, England: Wiley.
Thorndike, E.L., &Lorge, I. (1944). The teacher’s word book of 30,000 words. New York: Teachers College, Columbia University.
Ulijn, J. M., &Strother, J. B. (1990). The effect of syntactic simplification on reading EST texts as L1 and L2. Journal of Research in Reading, 13(1), 38-54.
Waring, R. (1997). A comparison of the receptive and productive vocabulary sizes of some second language learners. Immaculata(1), 53-68.
Webb, S. (2005). Receptive and productive vocabulary learning. Studies in Second Language Acquisition, 27, 33-52.
Webb, S. (2007). The effects of repetition on vocabulary knowledge. Applied Linguistics, 28(1), 46-65.
Webb, S. (2008). Receptive and productive vocabulary sizes of L2 learners. Studies in Second Language Acquisition, 30(1), 79.
West, M. (1953). A general service list of English words. London: Longman, Green and Co.
Nagy, W.E., Herman, P.A. & Anderson R.C. (1985). Learning words from context.Reading Research Quarterly, 20(2), 20.
Xue, G., & Nation, I. S. P. (1984). A university word list. Language learning and communication, 3(2), 215-229.
Zareva, A., Schwanenflugel, P., &Nikolova, Y. (2005). Relationship between lexica competence and language proficiency: Variable sensitivity. Studies in Second Language Acquisition, 27(04), 567-595