研究生: |
陳秀娟 Hsiu-chuan Chen |
---|---|
論文名稱: |
英語閱讀能力測驗之內涵與閱讀能力之評析:以大學學科能力測驗與指定科目考試為例 An Analysis of the Reading Skills Measured in Reading Comprehension Tests on the Scholastic Achievement English Test (SAET) and the Department Required English Test (DRET) |
指導教授: |
陳秋蘭
Chen, Chiou-Lan |
學位類別: |
碩士 Master |
系所名稱: |
英語學系 Department of English |
論文出版年: | 2009 |
畢業學年度: | 97 |
語文別: | 英文 |
論文頁數: | 107 |
中文關鍵詞: | 閱讀技巧 、閱讀測驗 、試題分析 、大學學科能力測驗英文考科 、大學指定科目考試英文考科 |
英文關鍵詞: | reading skills, reading comprehension tests, item analysis, Scholastic Achievement English Test (SAET), Department Required English Test (DRET) |
論文種類: | 學術論文 |
相關次數: | 點閱:333 下載:36 |
分享至: |
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報 |
本研究使用語言學家Nuttall的閱讀技巧分類之修正版來探討近六年(2002-2007年)大學學科能力測驗及指定科目考試英文閱讀測驗試題中欲測試的閱讀技巧為何,以及歷屆考生在各類題型上的表現。
本研究採質化與量化分析法。質的分析採內容分析法,將一百六十七個考題依照Nuttall的閱讀技巧分類之修正版分類。量化分析則使用電腦統計軟體SPSS 13.0來檢測各種閱讀技巧類型在考試中出現的頻率及分布,雙因子變異數分析用來個別檢測二種考試中各類題型之答對率間有無顯著差距及其差距是否每年相同,同時並了解高分組與低分組學生於各類題型上表現的差距。
本研究之主要研究發現如下:
(一)研究結果顯示,在二種考試中,試題欲測量的閱讀技巧可以分為八類(「由上下文推測字彙意義」、「辨認連接詞」、「辨認細節」、「辨認功能價值」、「辨認文章組織結構」、「辨認作者的預設立場」、「推論」以及「辨認主旨」。
(二)「辨認細節」這類考「由下往上」(bottom-up)的技巧的題目類型在二種考試中最常被考,因此可推論二種考試都比較偏好考「由下往上」(bottom-up)類型的技巧,而出現次數最少的題型則為「辨認文章組織結構」。此外,大學學科能力測驗及指定科目考試的英文閱讀測驗的最大差異在於閱讀技巧類型出現的頻率、出現處以及分佈。在大學學科能力測驗中每年都會出現的技巧是「由上下文推測字彙意義」以及「辨認細節」此二種題型,而在指定科目考試的英文閱讀測驗每年都出現的則只有「辨認細節」此類題型。
(三)二因子變異的分析研究顯示在大學學科能力測驗以及指定科目考試中,不同題型對於答對率並沒有顯著影響,亦即不同題型答對率的高低在六年當中並不一致。
(四)在二種考試當中,低層次的閱讀技巧(local skill)最能區隔高低分組的學生。在大學學科能力測驗當中,所有的題型在高低分組的答對率差距方面都有達到最低標準,然而在指定科目考試方面有二類題型的鑑別度低於最低標準,像是「推論」以及「辨認作者的預設立場」。此結果暗示這二類題型可能對所有的考生來說太難,以致於無法適當區隔高低分組的表現。
根據上述分析結果,本研究最後提出一些教學建議以供參考。
The present study aimed to adopt a revised version of Nuttall’s taxonomy to investigate the reading skills measured in the SAET (Scholastic Achievement English Test) and the DRET (Department Required English Test) administered from 2002 to 2007, and to explore how test takers (all examinees, high achievers, and low achievers) performed on different types of items.
Both qualitative and quantitative analyses were adopted. The qualitative analysis was conducted by categorizing each of the 167 reading comprehension items into reading skill type in the revised Nuttall’s Taxonomy. For the quantitative analysis, SPSS 13.0 statistical package was used to examine the frequency distribution of the item types. The two-way ANOVA test was applied to the SAET and the DRET to see whether there were significant differences among the passing rates of different question types and to investigate whether these differences were consistent throughout the years. Also, the discrimination indexes were analyzed via the two-way ANOVA to see how the high achievers and low achievers differed while answering different types of reading questions each year. The results of this study are summarized as follows:
First, the findings showed that in both tests, eight types of reading skills were measured: “Word Inference from Context,” “Recognizing Cohesive Devices,” “Recognizing and Interpreting Details,” “Recognizing Functional Value,” “Recognizing Text Organization,” “Recognizing Presuppositions Underlying the Text,” “Recognizing Implications and Making Inferences,” and “Recognizing and Understanding the Main Idea.”
Second, the most frequent items tested in the SAET and DRET are items on “Recognizing and Interpreting Details,” which indicated that this type of reading skill is favored in both tests. However, “Recognizing Text Organization” is the least tested skill. In addition, the similarities and differences between the SAET and DRET lay in the frequency, occurrences, and distribution of reading skill item types. Two types of items occurred every year in the SAET, including local items on “Word Inference from Context” and “Recognizing and Interpreting Details.” However, only “Recognizing and Interpreting Details” occurred every year in the DRET.
Third, the ANOVA analysis showed that there was no significant effect of items on the examinees’ average passing rates. In other words, the ranking of passing rates of different item types in the SAET and DRET were not consistent throughout the years.
Finally, in both SAET and DRET, items on local skills best discriminated high and low achievers. In the SAET, the discrimination indexes of all item types reached the ideal discrimination index whereas in the DRET two types of items had unsatisfactory discriminatory power: items on “Recognizing Implications and Making Inferences” and “Recognizing Presuppositions Underlying the Text.” This indicated that these two types of items were probably too difficult for most examinees and did not appropriately distinguish the high and low achievers.
Based on the aforementioned analysis of results, some pedagogical implications for reading instruction and testing in senior high schools were provided.
Abbott, M. L. (2007). A confirmatory approach to differential item functioning on an ESL reading assessment. Language Testing, 24(1), 7-36
Alderson, J. C. (2000). Assessing reading. UK: Cambridge University Press.
Anderson, N. J., (1999). Exploring second language reading: Issues and strategies. Boston, MA: Heinle & Heinle Publishers.
Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
Bachman, L. F. & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University Press.
Bernhardt, E.B. (1991). Reading development in a second language: Theoretical, empirical and classroom perspectives. Norwood, Ablex Publishing Corporation, N.J.
Brown, H. D. (2001). Teaching by principles: An interactive approach to language pedagogy. 2nd ed. New York: Longman.
Brown, H. D. (2003). Language assessment: Principles and classroom practices. New York: Longman.
Carrell, P. L. (1983a). Some issues in studying the role of schemata, or background knowledge in second language comprehension. Reading in a Foreign Language, 1(2), 81-92.
Carrell, P. L. (1988a). Introduction: Interactive approaches to second language reading. In Carrell, P. L., Devine, J. & Esdey, D. (Eds.), Interactive approaches to second language reading (pp.1-7). Cambridge: Cambridge University Press.
Carrell, P. L. (1988b). Some causes of text-boundedness and schema interference in ESL reading. In Carrell, P. L., Devine, J. & Eskey, D. (Eds.), Interactive approaches to second language reading (pp.101-113). Cambridge: Cambridge University Press.
Carrell, P. L., & Eisterhold, J. (1983). Schema theory and ESL reading pedagogy. In M.H. Long and J.C. Richards (Eds.), Methodology in TESOL: A book of reading (pp. 218-232). Boston, Mass: Heinle & Heinle Publishers.
Carver, D. (1978). Reading comprehension—Is there such a thing,” English Language Teaching, 32(4), 291-297
Chen, K. T. (1995) 英文科試題分析 [An item analysis of the 1995 SAET]. Taipei: CEEC., 38-49
Chen, J. C (2005). Explicit instruction of reading strategies at senior high school in Taiwan. Unpublished Master Thesis. Kaohsiung: National Kaohsiung Normal University.
Coady, J. (1979). A psycholinguistic model of the ESL reader. In R. Hackay, B. Brakeman, and R.R. Jordan (Eds.), Reading in a second language (pp. 5-12). Rowley, MA: Newbury House Publishers.
Cohen, A. D. (1994). Assessing language ability in the classroom (2md ed.). Boston: Newbury House/Heinle & Heinle.
Cohen, A.D. (1998). Strategies and process in test taking and SLA. In L.F. Bachman and A.D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 90-111). Cambridge: Cambridge University Press.
Cummings, O. W. (1982). Differential measurement of reading comprehension skills for students with discrepant subskill profiles. Journal of Education Measurement, 19(1), 59-66
Dillner, M. H. & Olson, J. P. (1982). Personalizing reading instruction in middle, junior, and senior high schools: Utilizing a competency-based instructional system. New York: Macmillan.
Dubin, F.D., Eskey, D. E. & Grabe, W. (1986). Teaching second language reading for academic purposes. Reading. Mass: Addison-Wesley.
Dunmore, D. (1989). Using Contextual Clues to Infer Word Meaning: An Evaluation of Current Exercise Types. Reading in a Foreign Language, 6 (1), 337-347
Eskey, D. E. (1988). Holding in the bottom: an interactive approach to the language problems of second language readers. In Carrell, P. L., Devine, J. and Esdey, D. (Eds.), Interactive approaches to second language reading (pp. 93-100). Cambridge: Cambridge University Press.
Goodman, K.S. (1967). Reading: A psycholinguistic guessing game. In H. Singer & R. Ruddell (Eds.), Theoretical models and processes of reading. Newark, Delaware: International Reading Association.
Gough, P. B. (1972). One second of reading. In Kavenagh, F.J. and Mattingly, G. (Eds.), pp. 331-358.
Grabe, W. (1991). Current developments in second language reading research. TESOL Quarterly, 25(3), 375-406.
Grabe. W. (1986). The transition from theory to practice in teaching reading. In F. Dubin, D. E. Eskey, & W. Grabe (Eds.), Teaching second language reading for academic purposes (pp. 25-48). Reading, MA: Addision-Wesley Publishing Company.
Grellet, F. (1981). Developing reading skills: A practical guide to reading comprehension exercises. Cambridge: Cambridge University Press.
Farr, R., Prichard, R. & Smitten, B. (1990). A description of what happens when an examinee takes a multiple-choice reading comprehension test. Journal of Educational Measurement, 27(3), 209-226
Harris, D. P. (1969). Testing English as a second language. New York: McGraw Hill
Harrison, A. (1983). A language testing handbook. London: Macmillan.
Heaton, J. B. (1988). Writing English language tests. New York: Longman.
Hsu, W. L. (2005). An analysis of the reading comprehension questions in the JCEE English test. Unpublished master thesis: Kaohsiung: National Kaohsiung Normal University.
Huangl, T. L. (1993). 大學生英文選詞連句成段能力之研究 [An analysis of college students’ abilities to use cohesive ties], New Horizons in English Language Teaching. (pp. 202-241). Taipei: The Crane Publishing Company.
Huang, T.S. (1994). A qualitative analysis of the JCEE English tests. Taipei: The Crane Publishing Company.
Hughes, A. (2003). Testing for language teachers. Cambridge: Cambridge University Press.
Jeng, H. S. (1992). 中華民國八十年度大學年考英文選擇題統計數值分析 [A Statistical Analysis of English Test Items in 1991 JCEE], presented at the First International Symposium on English Teaching in ROC., held in Taipei, included in the Proceedings, 251-271.
Jiang, W. J., & Lin, B. F. (1999). 八十八學年度大學聯考英文試題簡析[A brief analysis of English test items in 1999 JCEE]. English Teaching and Learning, 24(1), 3-23
Kirby, J. R. (1988). Style, strategy, and skill in reading. In R.R. Schmeck (Ed.), Learning strategies and learning styles (pp. 229-274). New York: Plenum Press.
Lan, W. H. (2007). An analysis of reading comprehension questions on the SAET and the DRET using revised Bloom's Taxonomy. Unpublished master’s thesis. Taipei: National Taiwan Normal University.
Lu, J. Y. (2002). An analysis of the reading comprehension test given in the English Subject Ability Test in Taiwan and its pedagogical implications. Unpublished master’s thesis. Taipei: National Chengchi University.
Mackay, R. (1987) Teaching the information gathering skills. In M.H. Long and J.C. Richards (Eds.), Methodology in TESOL: A book of reading (pp. 248-258). Boston, Mass: Heinle & Heinle Publishers.
McNamara, T. (2000). Language testing. Oxford: Oxford University Press.
Madsen, H. S. (1983) Techniques in Testing. New York: Oxford University Press.
Munby, J. (1978) Communicative Syllabus Design. Cambridge, Cambridge University Press.
Mo, C. C. (1987). A study of English reading comprehension and general guidelines for testing reading. Journal of National Chengchi University, 55, 173-206. Taipei: National Chengchi University.
Nevo, N. (1989). Test-taking strategies on a multiple-choice test of reading comprehension. Language Testing, 6, 199-215.
Nuttall, C. (1996). Teaching reading skills in a foreign language. London: Heinemann.
Omaggio, A. H. (2001). Teaching language in context. Boston: Heinle & Heinle.
Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20, 26–56.
Pressley, M. (2000). Comprehension Instruction: What makes sense now, what might make sense soon. Handbook of Reading Research. Vol. 3. Retrieved February 18, 2008, from http://www.readingonline.org/articles/handbook/pressley/
Purpura, J. (1997). An analysis of the relationships between test takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47, 289–325.
Raygor, A. L. & Raygor , R. D. (1985). Effective reading: Improving reading rates and comprehension. New York: McGraw-Hill.
Richards, J. C. (1997). From reader to reading teaching: Issues & strategies for second language classrooms. Cambridge: Cambridge University Press.
Richards, J. C. & Schmidt, R. (2002). Longman dictionary of language teaching & applied linguistics (3rd ed.). Pearson Education Limited.
Richards, J. C. (2003). 30 years of TEFL/TESL: A personal reflection. Retrieved September 17, 2007, from www.professorjackrichards.com/pdfs/30-years-of-TEFL.pdf
Rumelhart, D. E. (1977). Toward an interactive model of reading. In S. Dornic, (Ed.), (pp. 573-603). Attention and Performance VI. Hillsdale, NJ.: Erbaurn.
Rumelhart, D. E. (2004). Toward an interactive model of reading. In R. B, Ruddell and N. J, Unrau (5th edition), Theoretical models and processes of reading. Newark, Delaware: International Reading Association.
Sequera, W. (1995). Construct Validity in Reading Tests. Forum, 33(1), 49
Shi, Y. H. (1991). Teaching to the Test: A Case Study of Taiwan. Studies in English Literature & Linguistics, 1991, 51-63
Slomp, H. D. (2005). Teaching and assessing language skills: Defining the knowledge that matters. English Teaching: Practice and Critique, 4(3), 141-155
Smith, F. (1971). Understanding reading: A psycholinguistic analysis of reading and learning to read. New York: Holt, Rinehart & Winston.
Stanovich, K. E. (1980). Toward and interactive compensatory model of individual differences in the development of reading fluency. Reading Research Research Quarterly, 16(1), 32-71.
Su, C. (2001). Evaluation of reading skills applied in the first-year college English Reading Course. Selected Papers from the 10th International Symposium on English Teaching. (pp. 579-587). Taipei: The Crane Publishing Co.
Teale, W. H. & Rowley, G. (1984). Standardized Testing and the teaching of reading: A practical guide with evaluations of reading tests commonly used in Australian schools. San Antonio: The University of Texas, Division of Education School of Social and Behavioral Sciences. (ED 291 769).
Urquhard, A. H. & Weir, C. J. (1998). Reading in a second language: Process, product and practice. London: Longman.
Wallace, C. (1992). Reading Oxford, Oxford University Press.
Weir, C. J. (1990). Communicative language testing. New Jersey: Prentice Hall.
Weir, C. J. (1993). Understanding and developing language tests. New York: Prentice Hall.
Williams, R. (1983). Teaching the Recognition of Cohesive Ties in Reading a Foreign Language. Reading in a Foreign Language, 1(1), pp35-52
Williams, E. & Moran, C. (1989). Reading in a foreign language at intermediate and advanced levels with particular reference to English. Language Teaching, 22(4), 217-228.
Williams, R. (1983). Teaching the recognition of cohesive ties in reading a foreign language. Reading in a Foreign Language, 1(1), 35-52
Xu, Y. J., & Lu, S. F. (1998). 八十七學年度大學聯考英文試題簡評[A brief criticism of English test items in 1998 JCEE]. English Teaching and Learning, 23(2), 23-40