Investigating the Content Validity of the Basic Competence Test of English

Abstract

本研究旨在探查台灣國中基本學力測驗英語科之內容效度，以期了解國中基本學力測驗英語科之試題內容是否達到出題者宣稱之目的，進而對英語教師、教育學者、學生、及社會大眾能有啟示作用。\r\n 本研究兼採質及量的分析方法。質的研究取自51位現任國中英語教師之專業判斷，以2003年第一次國中基測英語試題為例，從課本的符合程度、學校教學、學校評量、試題難易度等四方面逐題審視國中基測與教學之相關程度，及問卷調查此51位教師對國中基測與課程標準之總目標、分項目標、基測命題原則、及學力指標之看法，透過Aiken之效度指數檢測是否達到顯著。量的研究取自台灣四所國中共1204位畢業生在校三年之英語段考平均成績分別與國中基測英語原始分數之相關。\r\n研究結果顯示：國中基本學力測驗英語科具有內容效度。

The purpose of this study is to investigate the content validity of Basic Competence Test (BCT) in English, hoping to verify whether or not the test reaches what the tester claims to test, and further promote a better understanding of BCT toward teachers, students, educators and the public.\r\n This study adopts both qualitative and quantitative analyses. Fifty-one qualified junior high school teachers examine the relationship between BCT’s items and curricular instruction from textbook coverage, instruction, evaluation, and item difficulty. They also offer their perceptions toward BCT from the content domain the tester claims to test, i.e. the general and specific objectives of Curriculum Standards, test principles from the BCT Center, and Core Competence Indicators. Aiken’s Validity Index checks if items are significantly content valid. Computing the correlation coefficient between 1204 students’ academic scores of monthly tests for three years at four schools and BCT’s raw scores does the quantitative analysis.\r\n The result of this study indicates that first BCT items have high accordance with curricular instruction. Second, students’ performance at school correlates highly to that on BCT. Third, what the BCT Center claims to test is highly acclaimed by the junior high school teachers. In other words, BCT’s content validity is established.