ANALYSIS OF TWO-TIER QUESTION SCORING METHODS: A CASE STUDY ON THE LAWSON’S CLASSROOM TEST OF SCIENTIFIC REASONING

TitleANALYSIS OF TWO-TIER QUESTION SCORING METHODS: A CASE STUDY ON THE LAWSON’S CLASSROOM TEST OF SCIENTIFIC REASONING
Publication TypeJournal Article
Year of Publication2021
AuthorsZhou, S-N, Liu, Q-Y, Koenig, K, Li, Q-ye, Xiao, Y, Bao, L
JournalJournal of Baltic Science Education
Volume20
Issue1
Start Page146-159
PaginationContinuous
Date PublishedFebruary/2021
Type of ArticleOriginal article
ISSN1648-3898
Other NumbersE-ISSN 2538-7138
Keywordscontrol-of-variable, grade level, pattern analysis, scientific reasoning
Abstract

The Lawson’s Classroom Test of Scientific Reasoning (LCTSR) is a popular instrument that measures the development of students’ scientific reasoning skills. The instrument has a two-tier question design, which has led to multiple ways of scoring and interpretation. In this research, a method of pattern analysis was proposed and applied to analyze two-tier item pairs on the subskill of Control-of-Variable (COV) of LCTSR. The data were collected from students in grade 4 through college in both the United States and China. Students’ response patterns to two combined item pairs were analyzed and compared against students at different grade levels and reasoning development levels. Six performance levels were established based on students’ response patterns, serving as indicators of COV reasoning development levels. With the new method, a relation was obtained between students’ level of COV skills and grade level, as well as their level of overall reasoning development. It can provide useful information on the possible developmental levels of students’ reasoning skills.

URLhttp://oaji.net/articles/2021/987-1611649216.pdf
DOI10.33225/jbse/21.20.146
Refereed DesignationRefereed
Full Text