Beyond Scores: Explainable Intelligent Assessment Strengthens Pre-service Teachers’ Assessment Literacy

Key findings from this study

This research indicates that:

• Explainable intelligent assessment platforms supported reflection and self-regulation in pre-service teachers, with preliminary evidence of reduced assessment errors.
• Participants shifted from score-centered reasoning toward evidence-based interpretation of student performance through exposure to visualized cognitive diagnostic explanations.
• Explanatory scaffolding bridged the persistent gap between assessment theory taught in teacher education and practical reasoning about classroom assessment.

Overview

Assessment literacy remains underdeveloped in pre-service teacher education due to reliance on theoretical instruction and opaque digital assessment tools. XIA, an eXplainable Intelligent Assessment platform, integrates statistics-informed support with visualized cognitive diagnostic reasoning, contrastive explanations, and counterfactual reasoning to scaffold reflection and evidence-based judgment.

Methods and approach

A controlled pre-post study enrolled 21 pre-service teachers. The research combined quantitative assessment tasks, questionnaires, and qualitative interviews to evaluate platform effects on assessment literacy, reflection capacity, self-regulation, and error reduction.

Results

XIA demonstrated preliminary efficacy in supporting reflection and self-regulation while reducing assessment errors among participants. Quantitative measures indicated improvements in assessment awareness. Qualitative interview data revealed a substantive shift in reasoning patterns: participants moved from score-dependent judgments toward evidence-based interpretations of student performance. The explanatory scaffolding embedded in the platform facilitated this transition by making cognitive diagnostic processes visible and actionable.

Implications

Explanatory scaffolding in intelligent assessment tools can effectively bridge the gap between assessment theory and classroom practice. Teacher preparation programs can leverage such platforms to cultivate assessment literacy more robustly than conventional theoretical instruction alone. The design approach of combining statistical support with visualized cognitive reasoning offers a replicable model for developing assessment competency in educator preparation contexts.

Future research should examine scalability across larger cohorts and longer intervention periods. Longitudinal studies tracking participants into classroom practice would clarify whether improved assessment awareness during preparation translates to sustained changes in teaching assessment behaviors.

Scope and limitations

This summary is based on the study abstract and available metadata. It does not include a full analysis of the complete paper, supplementary materials, or underlying datasets unless explicitly stated. Findings should be interpreted in the context of the original publication.