學術產出-Periodical Articles

Article View/Open

Publication Export

Google ScholarTM

政大圖書館

Citation Infomation

題名 Assessing creative problem-solving with automated text grading
作者 Li, Tsai-yen
李蔡彥
Chang, Chun-yen
Wang, Hao-chuan
貢獻者 資科系
關鍵詞 Computer-aided assessment; Automated grading; Creative problem-solving; Science learning assessment; Machine learning application
日期 2008
上傳時間 8-May-2015 16:08:43 (UTC+8)
摘要 The work aims to improve the assessment of creative problem-solving in science education by employing language tech- nologies and computational-statistical machine learning methods to grade students` natural language responses automat- ically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit students` constructed responses are beneficial. But the high cost required in manually grading constructed responses could become an obstacle in applying open-ended questions. In this study, automated grading schemes have been developed and evalu- ated in the context of secondary Earth science education. Empirical evaluations revealed that the automated grading schemes may reliably identify domain concepts embedded in students` natural language responses with satisfactory inter-coder agreement against human coding in two sub-tasks of the test (Cohen`s Kappa = .65-.72). And when a single holistic score was computed for each student, machine-generated scores achieved high inter-rater reliability against human grading (Pearson`s r = .92). The reliable performance in automatic concept identification and numeric grading demon- strates the potential of using automated grading to support the use of open-ended questions in science assessments and enable new technologies for science learning.
關聯 Computers & Education , vol. 51, no. 4, pp. 1450-1466
資料類型 article
DOI http://dx.doi.org/10.1016/j.compedu.2008.01.006
dc.contributor 資科系-
dc.creator (作者) Li, Tsai-yen-
dc.creator (作者) 李蔡彥zh_TW
dc.creator (作者) Chang, Chun-yenen_US
dc.creator (作者) Wang, Hao-chuanen_US
dc.date (日期) 2008-
dc.date.accessioned 8-May-2015 16:08:43 (UTC+8)-
dc.date.available 8-May-2015 16:08:43 (UTC+8)-
dc.date.issued (上傳時間) 8-May-2015 16:08:43 (UTC+8)-
dc.identifier.uri (URI) http://nccur.lib.nccu.edu.tw/handle/140.119/75061-
dc.description.abstract (摘要) The work aims to improve the assessment of creative problem-solving in science education by employing language tech- nologies and computational-statistical machine learning methods to grade students` natural language responses automat- ically. To evaluate constructs like creative problem-solving with validity, open-ended questions that elicit students` constructed responses are beneficial. But the high cost required in manually grading constructed responses could become an obstacle in applying open-ended questions. In this study, automated grading schemes have been developed and evalu- ated in the context of secondary Earth science education. Empirical evaluations revealed that the automated grading schemes may reliably identify domain concepts embedded in students` natural language responses with satisfactory inter-coder agreement against human coding in two sub-tasks of the test (Cohen`s Kappa = .65-.72). And when a single holistic score was computed for each student, machine-generated scores achieved high inter-rater reliability against human grading (Pearson`s r = .92). The reliable performance in automatic concept identification and numeric grading demon- strates the potential of using automated grading to support the use of open-ended questions in science assessments and enable new technologies for science learning.-
dc.format.extent 399032 bytes-
dc.format.mimetype application/pdf-
dc.relation (關聯) Computers & Education , vol. 51, no. 4, pp. 1450-1466-
dc.subject (關鍵詞) Computer-aided assessment; Automated grading; Creative problem-solving; Science learning assessment; Machine learning application-
dc.title (題名) Assessing creative problem-solving with automated text grading-
dc.type (資料類型) articleen
dc.identifier.doi (DOI) 10.1016/j.compedu.2008.01.006-
dc.doi.uri (DOI) http://dx.doi.org/10.1016/j.compedu.2008.01.006-