ASSESSING THE VALIDITY AND RELIABILITY OF SCIENCE MULTIPLE CHOICE TEST USING RASCH DICHOTOMOUS MEASUREMENT MODEL

TitleASSESSING THE VALIDITY AND RELIABILITY OF SCIENCE MULTIPLE CHOICE TEST USING RASCH DICHOTOMOUS MEASUREMENT MODEL
Publication TypeJournal Article
Year of Publication2021
AuthorsDzin, NHM, Lay, YF
JournalJournal of Baltic Science Education
Volume20
Issue6
Start Page924-941
PaginationContinuous
Date PublishedDecember/2021
Type of ArticleOriginal article
ISSN1648-3898
Other NumbersE-ISSN 2538-7138
Keywordsmultiple-choice test, Rasch Measurement Model, reliability and validity, science subject, secondary school standard curriculum
Abstract

Multiple choice tests are widely applied to assess students’ knowledge in science education. This study aimed at assessing the validity and reliability of Science Multiple-choice Test in Malaysia. The items for this test were formulated by the researcher together with a panel of science teachers and the head of the science department with close reference to Secondary School Standard Curriculum (KSSM) syllabus. The test consists of 50 multiple-choice items with four options. Rasch measurement model was adopted to evaluate the quality of the Science Multiple-choice Test in terms of reliability analysis, item polarity analysis (PTMEA-CORR), item fit analysis and Principal Component Analysis of Residuals (PCAR). The reliability analysis was performed using Cronbach’s Alpha, and the results of reliability and separation index respectively indicated good reliability level of the test items. In order to improve the validity of the test, two negatively worded items (Q39 and Q40) were removed. Lastly, the PCAR analysis showed the unexplained variance in the 1st contrast (5.4%) was found to be well controlled and was below the ceiling value of one-third of the variance explained by the item (18.7%). However, the positive value of the disattenuated correlations indicate no evidence of the presence of secondary dimension.

URLhttp://oaji.net/articles/2021/987-1639222215.pdf
DOI10.33225/jbse/21.20.927
Refereed DesignationRefereed
Full Text