Quality Control for Scoring Tests Administered in Continuous Mode: An NCME Instructional Module

Avi Allalouf, Tony Gutentag, Michal Baumer

Research output: Contribution to journalArticlepeer-review

Abstract

Quality control (QC) in testing is paramount. QC procedures for tests can be divided into two types. The first type, one that has been well researched, is QC for tests administered to large population groups on few administration dates using a small set of test forms (e.g., large-scale assessment). The second type is QC for tests, usually computerized, that are administered to small population groups on many administration dates using a wide array of test forms (CMT—continuous mode tests). Since the world of testing is headed in this direction, developing QC for CMT is crucial. In the current ITEMS module we discuss errors that might occur at the different stages of the CMT process, as well as the recommended QC procedure to reduce the incidence of each error. Illustration from a recent study is provided, and a computerized system that applies these procedures is presented. Instructions on how to develop one's own QC procedure are also included.

Original languageEnglish
Pages (from-to)58-68
Number of pages11
JournalEducational Measurement: Issues and Practice
Volume36
Issue number1
DOIs
StatePublished - 1 Mar 2017
Externally publishedYes

Keywords

  • computer-based testing
  • continuous mode tests
  • quality control
  • scoring

All Science Journal Classification (ASJC) codes

  • Education

Cite this