A systematic review of research around Adaptive Comparative Judgment (ACJ) in K-16 education
adaptive comparative judgment, open-ended problems, assessment
While research into the effectiveness of open-ended problems has made strides in recent years, less has been done around the assessment of these problems. The large number of potentially-correct answers makes this assessment difficult. Adaptive Comparative Judgment (ACJ), an approach based on assessors/judges working through a series of paired comparisons and selecting the better of two items, has demonstrated high levels of reliability and effectiveness with these problems. Research into using ACJ, both formative and summative, has been conducted at all grade levels within K-16 education (ages 5-18), with a myriad of findings. This paper outlines a systematic review process used to identify articles and synthesizes the findings from the included research around ACJ in K-16 education settings. The intent of this systematic review is to inform decision-makers weighing the potential for ACJ integration in educational settings with researched-based findings around ACJ in K-16 educational settings. Further, this review will also uncover potential areas for future researchers to investigate further into ACJ and its’ implications in educational settings.
Original Publication Citation
Bartholomew, S. R., & Yoshikawa, E. (2018). A systematic review of research around Adaptive Comparative Judgment (ACJ) in K-16 education. Council for Technology & Engineering Teacher Education: Monograph Series, 1(1), 1–23.
BYU ScholarsArchive Citation
Bartholomew, Scott R. and Yoshikawa-Ruesch, Emily, "A systematic review of research around Adaptive Comparative Judgment (ACJ) in K-16 education" (2018). Faculty Publications. 5565.
Council for Technology & Engineering Teacher Education: Monograph Series
Ira A. Fulton College of Engineering and Technology
Copyright Use Information