簡易檢索 / 詳目顯示

研究生: 陳秀娟
Hsiu-chuan Chen
論文名稱: 英語閱讀能力測驗之內涵與閱讀能力之評析:以大學學科能力測驗與指定科目考試為例
An Analysis of the Reading Skills Measured in Reading Comprehension Tests on the Scholastic Achievement English Test (SAET) and the Department Required English Test (DRET)
指導教授: 陳秋蘭
Chen, Chiou-Lan
學位類別: 碩士
Master
系所名稱: 英語學系
Department of English
論文出版年: 2009
畢業學年度: 97
語文別: 英文
論文頁數: 107
中文關鍵詞: 閱讀技巧閱讀測驗試題分析大學學科能力測驗英文考科大學指定科目考試英文考科
英文關鍵詞: reading skills, reading comprehension tests, item analysis, Scholastic Achievement English Test (SAET), Department Required English Test (DRET)
論文種類: 學術論文
相關次數: 點閱:333下載:36
分享至:
查詢本校圖書館目錄 查詢臺灣博碩士論文知識加值系統 勘誤回報
  • 本研究使用語言學家Nuttall的閱讀技巧分類之修正版來探討近六年(2002-2007年)大學學科能力測驗及指定科目考試英文閱讀測驗試題中欲測試的閱讀技巧為何,以及歷屆考生在各類題型上的表現。
    本研究採質化與量化分析法。質的分析採內容分析法,將一百六十七個考題依照Nuttall的閱讀技巧分類之修正版分類。量化分析則使用電腦統計軟體SPSS 13.0來檢測各種閱讀技巧類型在考試中出現的頻率及分布,雙因子變異數分析用來個別檢測二種考試中各類題型之答對率間有無顯著差距及其差距是否每年相同,同時並了解高分組與低分組學生於各類題型上表現的差距。
    本研究之主要研究發現如下:
    (一)研究結果顯示,在二種考試中,試題欲測量的閱讀技巧可以分為八類(「由上下文推測字彙意義」、「辨認連接詞」、「辨認細節」、「辨認功能價值」、「辨認文章組織結構」、「辨認作者的預設立場」、「推論」以及「辨認主旨」。
    (二)「辨認細節」這類考「由下往上」(bottom-up)的技巧的題目類型在二種考試中最常被考,因此可推論二種考試都比較偏好考「由下往上」(bottom-up)類型的技巧,而出現次數最少的題型則為「辨認文章組織結構」。此外,大學學科能力測驗及指定科目考試的英文閱讀測驗的最大差異在於閱讀技巧類型出現的頻率、出現處以及分佈。在大學學科能力測驗中每年都會出現的技巧是「由上下文推測字彙意義」以及「辨認細節」此二種題型,而在指定科目考試的英文閱讀測驗每年都出現的則只有「辨認細節」此類題型。
    (三)二因子變異的分析研究顯示在大學學科能力測驗以及指定科目考試中,不同題型對於答對率並沒有顯著影響,亦即不同題型答對率的高低在六年當中並不一致。
    (四)在二種考試當中,低層次的閱讀技巧(local skill)最能區隔高低分組的學生。在大學學科能力測驗當中,所有的題型在高低分組的答對率差距方面都有達到最低標準,然而在指定科目考試方面有二類題型的鑑別度低於最低標準,像是「推論」以及「辨認作者的預設立場」。此結果暗示這二類題型可能對所有的考生來說太難,以致於無法適當區隔高低分組的表現。
    根據上述分析結果,本研究最後提出一些教學建議以供參考。

    The present study aimed to adopt a revised version of Nuttall’s taxonomy to investigate the reading skills measured in the SAET (Scholastic Achievement English Test) and the DRET (Department Required English Test) administered from 2002 to 2007, and to explore how test takers (all examinees, high achievers, and low achievers) performed on different types of items.
    Both qualitative and quantitative analyses were adopted. The qualitative analysis was conducted by categorizing each of the 167 reading comprehension items into reading skill type in the revised Nuttall’s Taxonomy. For the quantitative analysis, SPSS 13.0 statistical package was used to examine the frequency distribution of the item types. The two-way ANOVA test was applied to the SAET and the DRET to see whether there were significant differences among the passing rates of different question types and to investigate whether these differences were consistent throughout the years. Also, the discrimination indexes were analyzed via the two-way ANOVA to see how the high achievers and low achievers differed while answering different types of reading questions each year. The results of this study are summarized as follows:
    First, the findings showed that in both tests, eight types of reading skills were measured: “Word Inference from Context,” “Recognizing Cohesive Devices,” “Recognizing and Interpreting Details,” “Recognizing Functional Value,” “Recognizing Text Organization,” “Recognizing Presuppositions Underlying the Text,” “Recognizing Implications and Making Inferences,” and “Recognizing and Understanding the Main Idea.”
    Second, the most frequent items tested in the SAET and DRET are items on “Recognizing and Interpreting Details,” which indicated that this type of reading skill is favored in both tests. However, “Recognizing Text Organization” is the least tested skill. In addition, the similarities and differences between the SAET and DRET lay in the frequency, occurrences, and distribution of reading skill item types. Two types of items occurred every year in the SAET, including local items on “Word Inference from Context” and “Recognizing and Interpreting Details.” However, only “Recognizing and Interpreting Details” occurred every year in the DRET.
    Third, the ANOVA analysis showed that there was no significant effect of items on the examinees’ average passing rates. In other words, the ranking of passing rates of different item types in the SAET and DRET were not consistent throughout the years.
    Finally, in both SAET and DRET, items on local skills best discriminated high and low achievers. In the SAET, the discrimination indexes of all item types reached the ideal discrimination index whereas in the DRET two types of items had unsatisfactory discriminatory power: items on “Recognizing Implications and Making Inferences” and “Recognizing Presuppositions Underlying the Text.” This indicated that these two types of items were probably too difficult for most examinees and did not appropriately distinguish the high and low achievers.
    Based on the aforementioned analysis of results, some pedagogical implications for reading instruction and testing in senior high schools were provided.

    TABLE OF CONTENTS Page CHINESE ABSTRACT..............................................................................................i ENGLISH ABSTRACT.............................................................................................iii ACKNOWLEDGEMENTS.......................................................................................v TABLE OF CONTENTS...........................................................................................vi LIST OF TABLES.....................................................................................................vii CHAPTER ONE INTRODUCTION.........................................................................1 Background and Motivation.......................................................................................1 Research Questions ....................................................................................................5 Significance of the Present Study...............................................................................6 Organization of the Thesis..........................................................................................6 CHAPTER TWO LITERATURE REVIEW ..............................................................9 The Rationale of Reading ...........................................................................................9 Reading Process Models .....................................................................................9 Reading Comprehension and Reading Skills.............................................................14 Theoretical Reading Skill Frameworks..............................................................15 The Original Nuttall’s Taxonomy.......................................................................17 Reading Skill Instruction............................................................................................24 Testing ESL/EFL Reading Comprehension................................................................26 Why Testing (The Relationship of Teaching and Testing)..................................27 Testing Comprehension with Multiple-choice Questions...................................28 Studies of Reading Tests Analysis (Item Analysis).............................................30 vii Summary .....................................................................................................................38 CHAPTER THREE METHOD...................................................................................41 Materials......................................................................................................................41 Participants..................................................................................................................42 Instrument....................................................................................................................43 Data Analysis...............................................................................................................46 Formal Analysis...........................................................................................................46 Analysis of the Data Coded and the Passing Rates....................................................48 Summary.....................................................................................................................49 CHAPTER FOUR DATA ANALYSIS AND RESULTS.............................................51 Qualitative and Quantitative Data Analysis and Results.............................................51 The Reading Skills Measured in SAET & DRET...............................................51 Similarities and Differences between the SAET & the DRET...........................53 Similarities and Differences between Reading Skills Measured in the SAET and the DRET...........................................................................................55 Examinees’ Performance on Each Question Type .....................................................59 SAET...................................................................................................................59 DRET...................................................................................................................63 Comparisons of High and Low Achievers’ Performances on Different Item Types...........................................................................................66 Results of the SAET............................................................................................67 Results of the SAET............................................................................................74 Summary .....................................................................................................................80 viii CHAPTER FIVE DISCUSSION AND CONCLUSION.............................................83 Discussion of Major Findings......................................................................................83 Reading Skills Measured in the SAET & DRET.................................................84 Similarities and Differences between the Reading Skills Tested in the SAET and the DRET...........................................................................................84 Examinees’ Performances on Various Item Types...............................................86 Comparisons of High and Low Achievers’ Performances on Different Item Types............................................................................................................88 Conclusions..................................................................................................................90 Summary of the Major findings...........................................................................90 Pedagogical Implications.....................................................................................91 Limitation Suggestions for Future Research .......................................................93 REFERENCES............................................................................................................95 APPENDIX 1: Principles for Classification of the Reading Skills Based on the Revised Nuttall’s Taxonomy.........................................................102 APPENDIX 2: Results of the Formal Item Analysis..................................................107 LIST OF TABLES Table 1 Structure of Nuttall’ Original Taxonomy 22 Table 2 The Number of Reading Passages and Comprehension Test Items 42 Table 3 The Number of Examinees Taking the SAET from 2002 to 2007 42 Table 4 The Number of Examinees Taking the DRET from 2002 to 2007 43 Table 5 Structure of the Revised Nuttall’s Taxonomy 45 Table 6 Reading Level Tested in the SAET & DRET 51 Table 7 The Frequencies of Reading Skills Measured in the SAET & the DRET 52 Table 8 Reading Level Tested in the SAET & DRET from 2002 to 2007 53 Table 9 Reading Skills Measured in both SAET & DR ET 54 Table 10 Reading Skills Measured in 2002-2007 SAET & DRET 58 Table 11 Average Passing Rates of Items Measuring Different Reading Skills in 2002-2007 SAET and DRET 60 Table 12 The ANOVA Analysis of the Passing Rates in the SAET 63 Table 13 The ANOVA Analysis of the Passing Rates in the DRET 66 Table 14 Passing Rates of High & Low Achievers and the Discrimination Indexes on Different Reading Levels in the SAET & DRET 68 Table 15 Passing Rates of the High & Low Achievers and the Discrimination Indexes on Different Item Types in 2002-2007 SAET 69 Table 16 The ANOVA Analysis of Discrimination Indexes in the SAET 74 Table 17 Passing Rates of the High & Low Achievers and the Discrimination Indexes on Different Item Types in 2002-2007 DRET 76 Table 18 The ANOVA Analysis of Discrimination Indexes in the DRET 79

    Abbott, M. L. (2007). A confirmatory approach to differential item functioning on an ESL reading assessment. Language Testing, 24(1), 7-36
    Alderson, J. C. (2000). Assessing reading. UK: Cambridge University Press.
    Anderson, N. J., (1999). Exploring second language reading: Issues and strategies. Boston, MA: Heinle & Heinle Publishers.
    Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.
    Bachman, L. F. & Palmer, A. S. (1996). Language testing in practice. Oxford: Oxford University Press.
    Bernhardt, E.B. (1991). Reading development in a second language: Theoretical, empirical and classroom perspectives. Norwood, Ablex Publishing Corporation, N.J.
    Brown, H. D. (2001). Teaching by principles: An interactive approach to language pedagogy. 2nd ed. New York: Longman.
    Brown, H. D. (2003). Language assessment: Principles and classroom practices. New York: Longman.
    Carrell, P. L. (1983a). Some issues in studying the role of schemata, or background knowledge in second language comprehension. Reading in a Foreign Language, 1(2), 81-92.
    Carrell, P. L. (1988a). Introduction: Interactive approaches to second language reading. In Carrell, P. L., Devine, J. & Esdey, D. (Eds.), Interactive approaches to second language reading (pp.1-7). Cambridge: Cambridge University Press.
    Carrell, P. L. (1988b). Some causes of text-boundedness and schema interference in ESL reading. In Carrell, P. L., Devine, J. & Eskey, D. (Eds.), Interactive approaches to second language reading (pp.101-113). Cambridge: Cambridge University Press.
    Carrell, P. L., & Eisterhold, J. (1983). Schema theory and ESL reading pedagogy. In M.H. Long and J.C. Richards (Eds.), Methodology in TESOL: A book of reading (pp. 218-232). Boston, Mass: Heinle & Heinle Publishers.
    Carver, D. (1978). Reading comprehension—Is there such a thing,” English Language Teaching, 32(4), 291-297
    Chen, K. T. (1995) 英文科試題分析 [An item analysis of the 1995 SAET]. Taipei: CEEC., 38-49
    Chen, J. C (2005). Explicit instruction of reading strategies at senior high school in Taiwan. Unpublished Master Thesis. Kaohsiung: National Kaohsiung Normal University. 
    Coady, J. (1979). A psycholinguistic model of the ESL reader. In R. Hackay, B. Brakeman, and R.R. Jordan (Eds.), Reading in a second language (pp. 5-12). Rowley, MA: Newbury House Publishers.
    Cohen, A. D. (1994). Assessing language ability in the classroom (2md ed.). Boston: Newbury House/Heinle & Heinle.
    Cohen, A.D. (1998). Strategies and process in test taking and SLA. In L.F. Bachman and A.D. Cohen (Eds.), Interfaces between second language acquisition and language testing research (pp. 90-111). Cambridge: Cambridge University Press.
    Cummings, O. W. (1982). Differential measurement of reading comprehension skills for students with discrepant subskill profiles. Journal of Education Measurement, 19(1), 59-66
    Dillner, M. H. & Olson, J. P. (1982). Personalizing reading instruction in middle, junior, and senior high schools: Utilizing a competency-based instructional system. New York: Macmillan.
    Dubin, F.D., Eskey, D. E. & Grabe, W. (1986). Teaching second language reading for academic purposes. Reading. Mass: Addison-Wesley.
    Dunmore, D. (1989). Using Contextual Clues to Infer Word Meaning: An Evaluation of Current Exercise Types. Reading in a Foreign Language, 6 (1), 337-347
    Eskey, D. E. (1988). Holding in the bottom: an interactive approach to the language problems of second language readers. In Carrell, P. L., Devine, J. and Esdey, D. (Eds.), Interactive approaches to second language reading (pp. 93-100). Cambridge: Cambridge University Press.
    Goodman, K.S. (1967). Reading: A psycholinguistic guessing game. In H. Singer & R. Ruddell (Eds.), Theoretical models and processes of reading. Newark, Delaware: International Reading Association.
    Gough, P. B. (1972). One second of reading. In Kavenagh, F.J. and Mattingly, G. (Eds.), pp. 331-358.
    Grabe, W. (1991). Current developments in second language reading research. TESOL Quarterly, 25(3), 375-406.
    Grabe. W. (1986). The transition from theory to practice in teaching reading. In F. Dubin, D. E. Eskey, & W. Grabe (Eds.), Teaching second language reading for academic purposes (pp. 25-48). Reading, MA: Addision-Wesley Publishing Company.
    Grellet, F. (1981). Developing reading skills: A practical guide to reading comprehension exercises. Cambridge: Cambridge University Press.
    Farr, R., Prichard, R. & Smitten, B. (1990). A description of what happens when an examinee takes a multiple-choice reading comprehension test. Journal of Educational Measurement, 27(3), 209-226
    Harris, D. P. (1969). Testing English as a second language. New York: McGraw Hill
    Harrison, A. (1983). A language testing handbook. London: Macmillan.
    Heaton, J. B. (1988). Writing English language tests. New York: Longman.
    Hsu, W. L. (2005). An analysis of the reading comprehension questions in the JCEE English test. Unpublished master thesis: Kaohsiung: National Kaohsiung Normal University.
    Huangl, T. L. (1993). 大學生英文選詞連句成段能力之研究 [An analysis of college students’ abilities to use cohesive ties], New Horizons in English Language Teaching. (pp. 202-241). Taipei: The Crane Publishing Company.
    Huang, T.S. (1994). A qualitative analysis of the JCEE English tests. Taipei: The Crane Publishing Company.
    Hughes, A. (2003). Testing for language teachers. Cambridge: Cambridge University Press.
    Jeng, H. S. (1992). 中華民國八十年度大學年考英文選擇題統計數值分析 [A Statistical Analysis of English Test Items in 1991 JCEE], presented at the First International Symposium on English Teaching in ROC., held in Taipei, included in the Proceedings, 251-271.
    Jiang, W. J., & Lin, B. F. (1999). 八十八學年度大學聯考英文試題簡析[A brief analysis of English test items in 1999 JCEE]. English Teaching and Learning, 24(1), 3-23
    Kirby, J. R. (1988). Style, strategy, and skill in reading. In R.R. Schmeck (Ed.), Learning strategies and learning styles (pp. 229-274). New York: Plenum Press.
    Lan, W. H. (2007). An analysis of reading comprehension questions on the SAET and the DRET using revised Bloom's Taxonomy. Unpublished master’s thesis. Taipei: National Taiwan Normal University.
    Lu, J. Y. (2002). An analysis of the reading comprehension test given in the English Subject Ability Test in Taiwan and its pedagogical implications. Unpublished master’s thesis. Taipei: National Chengchi University.
    Mackay, R. (1987) Teaching the information gathering skills. In M.H. Long and J.C. Richards (Eds.), Methodology in TESOL: A book of reading (pp. 248-258). Boston, Mass: Heinle & Heinle Publishers.
    McNamara, T. (2000). Language testing. Oxford: Oxford University Press.
    Madsen, H. S. (1983) Techniques in Testing. New York: Oxford University Press.
    Munby, J. (1978) Communicative Syllabus Design. Cambridge, Cambridge University Press.
    Mo, C. C. (1987). A study of English reading comprehension and general guidelines for testing reading. Journal of National Chengchi University, 55, 173-206. Taipei: National Chengchi University.
    Nevo, N. (1989). Test-taking strategies on a multiple-choice test of reading comprehension. Language Testing, 6, 199-215.
    Nuttall, C. (1996). Teaching reading skills in a foreign language. London: Heinemann.
    Omaggio, A. H. (2001). Teaching language in context. Boston: Heinle & Heinle.
    Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20, 26–56.
    Pressley, M. (2000). Comprehension Instruction: What makes sense now, what might make sense soon. Handbook of Reading Research. Vol. 3. Retrieved February 18, 2008, from http://www.readingonline.org/articles/handbook/pressley/
    Purpura, J. (1997). An analysis of the relationships between test takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47, 289–325.
    Raygor, A. L. & Raygor , R. D. (1985). Effective reading: Improving reading rates and comprehension. New York: McGraw-Hill.
    Richards, J. C. (1997). From reader to reading teaching: Issues & strategies for second language classrooms. Cambridge: Cambridge University Press.
    Richards, J. C. & Schmidt, R. (2002). Longman dictionary of language teaching & applied linguistics (3rd ed.). Pearson Education Limited.
    Richards, J. C. (2003). 30 years of TEFL/TESL: A personal reflection. Retrieved September 17, 2007, from www.professorjackrichards.com/pdfs/30-years-of-TEFL.pdf
    Rumelhart, D. E. (1977). Toward an interactive model of reading. In S. Dornic, (Ed.), (pp. 573-603). Attention and Performance VI. Hillsdale, NJ.: Erbaurn.
    Rumelhart, D. E. (2004). Toward an interactive model of reading. In R. B, Ruddell and N. J, Unrau (5th edition), Theoretical models and processes of reading. Newark, Delaware: International Reading Association.
    Sequera, W. (1995). Construct Validity in Reading Tests. Forum, 33(1), 49
    Shi, Y. H. (1991). Teaching to the Test: A Case Study of Taiwan. Studies in English Literature & Linguistics, 1991, 51-63
    Slomp, H. D. (2005). Teaching and assessing language skills: Defining the knowledge that matters. English Teaching: Practice and Critique, 4(3), 141-155
    Smith, F. (1971). Understanding reading: A psycholinguistic analysis of reading and learning to read. New York: Holt, Rinehart & Winston.
    Stanovich, K. E. (1980). Toward and interactive compensatory model of individual differences in the development of reading fluency. Reading Research Research Quarterly, 16(1), 32-71.
    Su, C. (2001). Evaluation of reading skills applied in the first-year college English Reading Course. Selected Papers from the 10th International Symposium on English Teaching. (pp. 579-587). Taipei: The Crane Publishing Co.
    Teale, W. H. & Rowley, G. (1984). Standardized Testing and the teaching of reading: A practical guide with evaluations of reading tests commonly used in Australian schools. San Antonio: The University of Texas, Division of Education School of Social and Behavioral Sciences. (ED 291 769).
    Urquhard, A. H. & Weir, C. J. (1998). Reading in a second language: Process, product and practice. London: Longman.
    Wallace, C. (1992). Reading Oxford, Oxford University Press.
    Weir, C. J. (1990). Communicative language testing. New Jersey: Prentice Hall.
    Weir, C. J. (1993). Understanding and developing language tests. New York: Prentice Hall.
    Williams, R. (1983). Teaching the Recognition of Cohesive Ties in Reading a Foreign Language. Reading in a Foreign Language, 1(1), pp35-52
    Williams, E. & Moran, C. (1989). Reading in a foreign language at intermediate and advanced levels with particular reference to English. Language Teaching, 22(4), 217-228.
    Williams, R. (1983). Teaching the recognition of cohesive ties in reading a foreign language. Reading in a Foreign Language, 1(1), 35-52
    Xu, Y. J., & Lu, S. F. (1998). 八十七學年度大學聯考英文試題簡評[A brief criticism of English test items in 1998 JCEE]. English Teaching and Learning, 23(2), 23-40

    下載圖示
    QR CODE