OpenResearchAlpha

Frontiers in Education · 18 Nov 2026

Improving AI-assisted grading reliability through explicit rubric and prompt engineering

Deepshikha Deepshikha, Navpreet Singh

0
Citations
no database records one yet
0
Citations in 2026
so far
–
Leading author's h-index
no author has a profile yet
25
References
works it cites, from open citation data

Citations by database

Each database indexes a different set of journals, preprints and books, so they are shown side by side rather than blended.

  • OpenCitations0
  • Crossref0

Citations per year

The current year is still counting.

  • 2026 so far0

Abstract

The use of artificial intelligence (AI) to support assessment and feedback in higher education has attracted growing interest, but concerns remain about the consistency and appropriateness of AI-generated grades in summative contexts. This study examined whether a combined calibration strategy involving a more explicit rubric and marking prompt could improve agreement between AI-assisted grading and educator judgement in a laboratory-based STEM assessment. We compared educator-assigned marks for 40 graduate Electrochemical Energy Storage Systems laboratory reports with marks generated by GPT-5 under pre- and post-calibration configurations, and examined agreement using complementary statistical and visual analyses. Following calibration, agreement with educator marks improved across measures of score correspondence and absolute agreement: the intraclass correlation coefficient increased from 0.818 to 0.928, the mean AI-educator difference decreased from +1.625 to +1.041 marks, and no post-calibration report differed from the educator mark by more than 10 marks. These findings suggest that the way assessment criteria, evidence requirements, and marking rules are specified can materially influence AI-human grading agreement. However, the revised rubric and prompt were introduced together, calibration drew on discrepancies observed in the same 40 reports used for post-calibration evaluation, and one educator's marks served as the reference. The results therefore support improved in-sample agreement under a human-supervised calibration strategy, rather than establishing grading validity or interchangeability for autonomous summative decisions.

What the data shows

  • No database records a citation yet, as is usual for a paper this new.

Graph

This paper in the middle, its authors and their most-cited papers below, the papers it cites to the left and the papers citing it to the right. The timeline lays every paper out by year.

Citing paper shares an authorAuthor without a profileSize shows citations, or h-index for authors

Select a node for its details. Drag to pan, scroll to zoom, drag a node to move it.

Start with

Authors (2)

Each author's standing in QAI's scholar index: the works their ORCID iD is attached to, and for anyone whose ORCID record names a lab OpenResearch follows, their arXiv preprints matched by name and a shared co-author. Names are as printed on the paper.

ProfileMost-cited paper

Cited by 0 papers

Who cites this paper, from open citation data, with Crossref's record of each; the 100 newest when there are more.

0 shown
No citing papers for this filter.

References (25)

What it cites, from open citation data, with Crossref's record of each.

Sign in to see 5 more references

A free account opens the rest of the citing papers and references on every paper’s page.