ConceptioArchivearXiv CS
arXiv CSopen access

Beyond Score Prediction: LLM-Based Essay Scoring and Feedback Generation via Reinforcement Learning with Rubric Rewards

Unknown · 2026 · arxiv_cs
arXiv CS · Papers · License: Open Access · 2026
Open Source ↗Direct PDF ↓
artificialintelligenceknowledgerepresentationreasoning
artificial intelligence, reasoning, knowledge representation

Beyond Score Prediction: LLM-Based Essay Scoring and Feedback Generation via Reinforcement Learning with Rubric Rewards Xuefeng Jin∗ , Jiashuo Zhang, Teng Cao, Bin Yang Alibaba Cloud Computing, Alibaba Group

arXiv:2607.19219v1 [cs.CL] 21 Jul 2026

Abstract Large language models (LLMs) have been widely applied to automated essay scoring (AES) and automated feedback generation (AFG). However, existing studies rely primarily on prompt engineering or supervised fine-tuning, while systematic research on reinforcement learning (RL) post-training and automated evaluation of feedback quality remains limited. We propose RLAES, a unified LLM framework that jointly optimizes essay scoring and feedback generation through RL. To make feedback quality measurable, interpretable, and usable for training, we introduce Rubric-based Feedback Evaluation (RFE), an essay-grounded feedback evaluation framework comprising 166 fine-grained binary rubric items and an LLM-as-judge. Building on RFE, we propose Adaptive Gated Feedback Optimization (AGFO), which activates rubric-based feedback rewards on demand during RL, reducing evaluation overhead while improving feedback quality. We also propose Adjacent Contrastive Reasoning (ACR) to improve ordinal score calibration by explicitly contrasting adjacent score levels. Experimental results show that the RFE framework captures essay-feedback consistency, exhibits strong pairwise discriminative power, and closely aligns with expert preferences. On the ASAP benchmark, RLAES-AGFO achieves the best scoring performance among LLM-based methods (QWK = 0.803), while maintaining feedback quality comparable to GPT-5.5 and avoiding the feedback degradation observed under score-only RL. Code and datasets are publicly available at https://github.com/hellomuyi/RLAES.

1

Introduction

Automated Essay Scoring (AES) and Automated Feedback Generation (AFG) are core applications of artificial intelligence in education (Abudalfa and Barrot 2026). These systems use natural language processing, machine learning, and large language models (LLMs) to automatically score student essays and generate constructive feedback. Together, AES and AFG can reduce educators’ grading workload while providing students with timely, personalized diagnostic feedback that helps them identify weaknesses and improve their writing over time (Li and Collins 2026). Research on AES dates back to the 1960s (Sun et al. 2025). Traditional AES approaches have evolved from regression models relying on hand-crafted features (Choi et al. 2026) to deep learning paradigms that formulate AES as ∗

Contact: [email protected]

numerical classification or regression with automatic representation learning. This evolution has progressed from convolutional neural networks (CNNs) and recurrent neural networks (RNNs) (Taghipour and Ng 2016) to more advanced Transformer-based pretrained language models, most notably the BERT family (Li and Pan 2025b; Xie et al. 2022). Recent LLM-based approaches to AES can be broadly divided into prompt engineering and fine-tuning. Prompt engineering studies have extensively explored zero-shot (Seßler et al. 2025; Su et al. 2025) and few-shot learning (Huang, Palermo, and Wilson 2026; Mansour et al. 2024), prompts augmented with scoring rubrics (Mansour et al. 2024), chain-of-thought (CoT) reasoning (Xiao et al. 2025), pairwise comparisons (Choi et al. 2026; Cai et al. 2025; Shibata and Miyamura 2025), and multi-agent frameworks (Wang et al. 2026). Finetuning studies focus mainly on supervised fine-tuning (SFT) (Xiao et al. 2025; Ormerod and Kwako 2024; Johnsi and Kumar 2025). These studies have shown that fine-tuned LLMs, even smaller open-source ones, substantially outperform their extremely large proprietary counterparts equipped with a range of enhanced prompting strategies. Beyond score prediction, less attention has been paid to AFG, including the evaluation and optimization of feedback, despite the pedagogical importance of formative feedback (Liu et al. 2024). Small models that perform competitively on AES typically use BERT-based encoder-only architectures and cannot generate feedback without an additional decoder. Existing LLM-based feedback generation methods either directly prompt an LLM (Sasaki, Conijn, and Willemsen 2026; Xiao et al. 2024; Ormerod and Kwako 2024) or perform SFT on feedback generated by strong reasoning models (Xiao et al. 2025; Li and Pan 2025a). For feedback evaluation, a widely accepted framework for automated evaluation is still lacking. Traditional feedback evaluation relies on annotated feedback datasets (Sasaki, Conijn, and Willemsen 2026; Liu et al. 2024). However, such annotations typically cover only a limited set of categories and are therefore ill-suited to evaluating the rich feedback generated by LLMs. LLM-generated feedback is generally evaluated manually (Xiao et al. 2025; Ormerod and Kwako 2024), but human evaluation is costly, difficult to scale, and difficult to convert into a reward signal for optimizing feedback quality. Li and Pan (2025a) propose an automated evaluation method that assesses feedback quality by computing the semantic similarity between the gener-

ated feedback and the scoring rubric descriptions associated with the gold score. Although LLMs have created new technical possibilities for AES and AFG, two challenges remain. On the one hand, reinforcement learning (RL) post-training remains underexplored in LLM-based AES and AFG. Current LLM approaches focus primarily on prompt engineering and SFT. Prompt engineering is flexible but sensitive to prompt design, whereas SFT directly imitates gold scores. RL may be better suited to score reasoning and alignment with scoring rubrics, but its effects on both scoring accuracy and feedback quality have not been systematically studied. On the other hand, AFG lacks effective and scalable methods for feedback evaluation and optimization. LLMgenerated feedback is often rich and structurally complex, leading existing work to rely heavily on human assessment (Xiao et al. 2025; Ormerod and Kwako 2024). Automated alternatives such as BERTScore measure the semantic similarity between generated feedback and scoring rubric descriptions associated with the gold score (Li and Pan 2025a). However, the gap between general, high-level scoring rubrics and essay-specific feedback limits the effectiveness of this evaluation strategy. The lack of an effective feedback evaluation method directly limits AFG optimization. To address these challenges, we propose RLAES, a unified LLM-based RL post-training framework for AES and AFG. First, to fill the gap in effective feedback evaluation, we introduce Rubric-based Feedback Evaluation (RFE), a prompt-specific, essay-grounded framework comprising 166 binary rubric items and an LLM-as-judge. RFE provides a fine-grained automated measure of feedback quality that can serve as an RL reward. Building on RFE, we propose Adaptive Gated Feedback Optimization (AGFO), which activates rubric-based feedback rewards on demand during RL. AGFO reduces LLM-as-judge overhead while jointly optimizing scoring accuracy and feedback quality, thereby preventing the feedback degradation caused by score-only RL. The resulting RLAES-AGFO model achieves the best performance among LLM-based AES methods. In addition, we propose Adjacent Contrastive Reasoning (ACR), a general strategy that explicitly guides the model to contrast adjacent score levels. ACR improves sensitivity to fine-grained quality differences and alleviates adjacent confusion in ordinal classification. Our main contributions are summarized as follows: • We extend LLM-based AES and AFG methodology beyond prompt engineering and SFT to RL post-training. The resulting RLAES-AGFO jointly optimizes scoring accuracy and feedback quality and achieves the best performance among LLM-based methods. • We introduce RFE, an essay-grounded framework that fills the gap in fine-grained feedback evaluation for AFG. • We propose ACR, a general strategy for ordinal classification tasks. ACR enables models to perceive and distinguish adjacent score levels, improving scoring accuracy.

2 2.1

Preliminaries

Task Definition

Let D = {(ei , si )}N i=1 denote a dataset, where ei represents the i-th essay together with its scoring context, such as the writing prompt, source text, and scoring rubric guidelines, and si is its corresponding holistic score. The objective is to train a model on D that generalizes well to unseen essays, enabling accurate score prediction for AES and reliable feedback generation for AFG. We focus on prompt-specific AES and AFG, where the writing prompts used for training and testing are drawn from the same set. We define feedback (or explanation) as all components of an AES system’s output other than the score prediction. We structure the output such that the model first generates feedback and then predicts a score. In this setting, the feedback can be viewed as a CoT-like intermediate rationale before the final score.

2.2

RL Post-Training

Reinforcement learning with verifiable rewards (RLVR) relies on explicit, verifiable binary rules as reward signals, such as output correctness. DeepSeek-R1 (Guo et al. 2025) demonstrated its effectiveness in improving reasoning capabilities. Related algorithms such as Group Relative Policy Optimization (GRPO) (Shao et al. 2024) have been widely applied to domains with checkable answers, including mathematics and code. For difficult-to-verify domains such as essay feedback evaluation, however, feedback quality cannot be determined by a single binary rule and instead requires multidimensional assessment. Directly applying RLVR in such settings would yield an overly coarse reward signal. Conversely, reinforcement learning from human feedback (RLHF) can use human preferences to handle open-ended outputs, but preference judgments are highly subjective and may induce reward hacking. Rubrics as Rewards (RaR) (Gunjal et al. 2025) decomposes evaluation criteria into individually assessable rubric items, bridging the gap between strictly verifiable rewards and subjective human preferences. It provides structured rewards for open-ended tasks and is directly compatible with on-policy RL algorithms such as GRPO. Specifically, given an input prompt x and a model response ŷ, the rubric reward is defined as Pk r(x, ŷ) =

j=1 wj cj (x, ŷ) , Pk j=1 wj

(1)

where k is the number of rubric items, wj > 0 is the weight of item j, and cj : (x, ŷ) 7→ {0, 1} indicates whether the response ŷ to the model input x satisfies that item. An LLM-asjudge assigns each indicator cj independently, and all items {(wj , cj )}kj=1 define the rubrics.

3 3.1

Approach

Rubric-Based Feedback Evaluation (RFE) Framework

Inspired by Deep Research Bench II (Li et al. 2026) and RaR (Gunjal et al. 2025), we propose the Rubric-based

3.2

Adaptive Gated Feedback Optimization (AGFO)

We use GRPO to jointly optimize AES and AFG. The reward function consists primarily of a score reward and a feedback reward. Given a student essay and its context e, the gold score s, the model-predicted score ŝ, the model-generated feedback fˆ, and the feedback rubrics Rfb , the total reward rtotal is defined as rtotal = rscore (s, ŝ) + λf · rfeedback (e, Rfb , fˆ),

(2)

where λf is a hyperparameter controlling the weight of the feedback reward. The score reward is defined as |s − ŝ| , (3) αM where M = smax − smin is the prompt-specific score range and α is a scaling factor. RFE supplies rfeedback by evaluating fˆ against Rfb . However, invoking an LLM-as-judge at every optimization step incurs prohibitive time and computational costs. We therefore propose Adaptive Gated Feedback Optimization (AGFO), which adaptively controls the activation of the feedback reward during training. Specifically, every n steps, the system invokes the LLM-as-judge to compute the current model’s feedback reward rfeedback on the batch and jointly optimizes scoring and feedback. If this reward is less than or equal to the predefined threshold τ , the gate remains open, and the judge is queried and the resulting feedback reward is included in the total reward at every subsequent step until rfeedback exceeds τ . Otherwise, the gate is closed between periodic checks, and the total reward contains only the score reward. Pseudocode for AGFO is provided in Algorithm 1. Notably, AGFO unifies two special cases via the threshold τ . When τ = 0, the feedback reward is activated only every n steps, reducing AGFO to periodic feedback optimization. When τ = 1, it is activated at every step, reducing AGFO to full feedback optimization. We denote the RL configuration using only the score reward as RLAES-Score and the configuration incorporating AGFO as RLAES-AGFO. rscore (s, ŝ) = −

Figure 1: Construction of the RFE rubrics.

Feedback Evaluation (RFE) framework, which supports automated feedback evaluation and converts feedback quality into a scalar reward for RL training. RFE comprises promptspecific, checklist-style rubrics and an LLM-as-judge. We will release these resources with the code. Figure 1 illustrates the construction pipeline. Reference Feedback Extraction. We use Claude-Opus4.7 to extract handwritten essays and teacher feedback from official ASAP materials (Hamner et al. 2012). Manual verification yields 92 essay–feedback pairs across eight writing prompts. We remove feedback that is overly brief, merely repeats scoring rubric guidelines without essay-specific evidence, or omits too many trait domains, retaining 50 highquality samples as pseudo-gold feedback. Because teacher feedback has practical limitations, such as omitting revision suggestions or providing only a single high-level assessment, we refine these samples through LLM rewriting, manual calibration, and expert validation, producing 50 gold feedback samples. To construct negative examples, we order the samples by prompt and score and pair each essay with feedback from an adjacent-scoring essay under the same prompt, yielding 88 perturbed feedback samples. Rubric Generation and Iteration. The Main Agent generates initial rubrics with manually adjusted top-level dimensions and fine-grained rubric items. It then evaluates the rubrics on the gold feedback and produces an analysis report. Five Rubric Refinement Agents—GPT-5.5, Gemini3.1-Pro, Claude-Opus-4.8, DeepSeek-V4-Pro, and GLM5.1—independently propose revisions. The Main Agent aggregates these proposals and updates the rubrics until the agents’ evaluations converge. After manual revision, the final rubrics, denoted by Rfb , contain 166 binary items across four dimensions: Coverage, Evidence, Faithfulness, and Safety. LLM-as-Judge Evaluation. Given an essay–feedback pair (ei , fi ), an LLM-as-judge independently determines whether each rubric item is satisfied. The RFE score is then computed using Equation 1. We assign equal weight to all items (wj = 1); thus, each dimension’s contribution is proportional to its number of items.

3.3

Adjacent Contrastive Reasoning (ACR)

Automated essay scoring can be formulated as an ordinal classification problem: score levels are ordered labels rather than independent classes. The main difficulty is determining whether an essay belongs to a given score level or an adjacent lower or higher level. Standard prompting methods ask an LLM to produce a holistic evaluation and score but do not explicitly require comparisons at score boundaries. This omission may make the model more prone to predicting a score level adjacent to the gold score—a phenomenon we call adjacent confusion. To alleviate this issue, we propose Adjacent Contrastive Reasoning (ACR), inspired by the anchoring-and-adjustment heuristic in human judgment (Tversky and Kahneman 1974). As illustrated in Figure 2, ACR treats the adjacent lower and higher scores around a predicted score as local hardnegative labels and requires the model to explicitly answer

Algorithm 1: Adaptive Gated Feedback Optimization (AGFO) Require: policy πθ ; dataset D; rubrics Rfb ; judge J ; period n; threshold τ ; weight λf ; total steps T Ensure: optimized policy πθ 1: r̄fb ← 0 2: for t ← 1 to T do 3: Sample mini-batch B ⊂ D 4: Generate responses {(fˆi , ŝi )} ∼ πθ (· | ei ), ei ∈ B 5: if t mod n ̸= 0 and r̄fb > τ then 6: rifb ← 0, ∀i {gate closed} 7: else 8: rifb ← rfeedback (ei , Rfb , fˆi ) {gate open, query J } 9: Update r̄fb with {rifb } 10: end if 11: for all i ∈ B do 12: ri ← riscore + λf rifb 13: end for 14: Update πθ via GRPO using {ri } 15: end for 16: return πθ

two contrastive questions before producing its final score: Why should the essay not receive the adjacent lower/higher score? This local counterfactual comparison encourages the model to identify evidence that distinguishes adjacent score levels instead of producing only a generic holistic assessment. ACR improves scoring in three ways. First, it transforms scoring from direct score mapping into local boundary discrimination, thereby focusing the model’s attention on fine-grained differences between adjacent scores. Second, treating adjacent levels as hard negatives directs attention toward more discriminative textual evidence. Third, considering both adjacent directions provides a bidirectional calibration signal, helping reduce systematic overestimation or underestimation in the ordinal score space. ACR differs from existing few-shot prompting and pairwise-comparison methods, which introduce external reference essays and assist scoring by comparing the relative quality of a target essay against the reference. In contrast, ACR requires no external reference samples and adds only local comparisons with adjacent score levels. We also evaluate ACR-Lower, a one-sided variant that retains only the question of why the essay should not receive the adjacent lower score. As a general strategy, ACR may be extended to other ordinal classification problems.

4 4.1

Experimental Setup

Dataset

We evaluate on the Automated Student Assessment Prize (ASAP) dataset (Hamner et al. 2012), a widely adopted benchmark for English AES. The dataset comprises 12,978 essays from three writing types and eight writing prompts (Table 1). Following Taghipour and Ng (2016), we conduct five-fold cross-validation using their standardized train-devtest splits. With one minor modification, we merge the train-

Figure 2: ACR for ordinal score calibration. Prompt Type Grade # Essays Avg. Len. Range 1 2 3 4 5 6 7 8

Arg. Arg. SD SD SD SD Narr. Narr.

8 10 10 10 8 10 7 10

1783 1800 1726 1772 1805 1800 1569 723

350 350 150 150 150 150 250 650

2–12 1–6 0–3 0–3 0–4 0–4 0–30 0–60

Table 1: Statistics of the ASAP dataset (Avg. Len.: average essay length; Arg.: argumentative; SD: source-dependent; Narr.: narrative).

ing data from all eight prompts within the same fold and perform a single joint training run across prompts, rather than training a separate model for each prompt. This design simplifies the experimental procedure, avoids model fragmentation, and aligns with efficient parameter sharing and unified model serving in the LLM era. We provide detailed results in Appendix A, showing that prompt joint training incurs negligible performance degradation across model families, with QWK decreasing by no more than 0.005.

4.2

Evaluation Metrics

We use quadratic weighted kappa (QWK), the most widely used metric in AES and the sole evaluation metric of the ASAP competition, to evaluate score prediction. QWK measures agreement between model predictions and humanassigned gold scores. For AFG evaluation, we employ our proposed RFE framework with GPT-5.5 as the LLM judge. Evaluating one essay– feedback pair against all 166 rubric items costs approximately $0.12. Due to budget constraints, the feedback evaluation is conducted on fold 0. Each fold covers the complete ASAP dataset, and folds differ only in how the dataset is split. Therefore, evaluation on a single fold remains sufficiently representative and valid.

4.3

Baseline Models

We group the baselines into two categories: LLM prompt engineering and LLM post-training. LLM Prompt Engineering. These methods directly prompt LLMs to perform scoring without updating model parameters. We include GPT-3.5 with rubric-guided oneshot prompting (Mansour et al. 2024), GPT-4 with rubric prompting (Li and Pan 2025a), GPT-4 with few-shot prompting (Xiao et al. 2025), and Llama-3-8B-Instruct (Ormerod and Kwako 2024). We also evaluate vanilla prompting with DeepSeek-V4-Pro (DeepSeek-AI 2026) and Qwen3.7-Max (Qwen Team 2026b), which serve as the base settings for our ACR variants.

below post-trained LLMs. This gap highlights the difficulty of directly prompting LLMs for AES. For DeepSeek-V4-Pro, average QWK increases from 0.430 with vanilla prompting to 0.462 with ACR and 0.471 with ACR-Lower. For Qwen3.7-Max, the corresponding values are 0.446, 0.473, and 0.506. As shown in Figure 3, both models systematically underestimate essay scores under vanilla prompting, whereas the one-sided ACR-Lower mitigates this bias by prompting them to identify the essay’s strengths. These results demonstrate that ACR improves the scoring accuracy of base models.

LLM Post-Training. These methods adapt LLMs to AES by updating model parameters. Existing baselines in this category are primarily based on SFT, including fine-tuned GPT-3.5 (Xiao et al. 2024), the Dual-Process Model (Xiao et al. 2025), fine-tuned Llama-3.2-1B-Instruct (Johnsi and Kumar 2025), fine-tuned Llama-3-8B-Instruct (Ormerod and Kwako 2024), and RTS (Cai et al. 2025). For AFG, prior work remains limited, and unavailable code and differing tasks hinder fair comparison. We therefore use GPT-5.5, prompted with role-playing instructions and scoring rubric guidelines, as a strong feedback-generation baseline.

Comparison between SFT and RLAES. SFTAES, our SFT baseline that outputs only the predicted score, achieves an average QWK of 0.784, outperforming all prompt engineering baselines and several LLM post-training baselines. With RL using only the score reward, RLAES-Score raises average QWK to 0.802, an improvement of 0.018 over SFTAES, and surpasses RTS (0.794), the strongest existing LLM post-training baseline. RLAES-AGFO achieves 0.803, indicating no observed reduction in scoring accuracy after adding AGFO. Moreover, RLAES-Score and RLAES-AGFO obtain the two highest average QWK values among the LLM post-training methods and come closest to the performance of a single human rater (0.805) (Uto 2026). Together with their improvements over SFTAES, these results further support the effectiveness of RL post-training for AES.

4.4

5.2

Implementation Details

In our post-training experiments, we use Qwen3.5-9B (Qwen Team 2026a) as the base model and adopt low-rank adaptation (LoRA) for parameter-efficient fine-tuning. RLAES is trained for 25 epochs with a learning rate of 2.0 × 10−5 and a warmup ratio of 0.1. We use a cosine learning-rate scheduler with a minimum learning-rate ratio of 0.1 and set the per-device training batch size to 8. For GRPO, we set the Kullback–Leibler (KL) regularization coefficient to 0 and apply a length penalty similar to DAPO (Yu et al. 2025). During rollout generation, we sample 8 responses for each query at a temperature of 0.9. All experiments are conducted on eight NVIDIA H20/A100 GPUs with DeepSpeed ZeRO-3. The feedback reward weight λf is set to 1, and the scoreinterval scaling factor α is set to 0.1. For AGFO, the gating period n is set to 30, and the feedback reward threshold τ is set to 0.8 based on an offline estimate. For the final feedback evaluation, we use GPT-5.5 (OpenAI 2026) as the LLM-as-judge. During RL training, feedback rewards are computed using DeepSeek-V4-Pro (DeepSeek-AI 2026) to reduce computational and financial costs. The temperature is set to 0 for all judge models. Unless otherwise noted, GPT-5.5 refers to gpt-5.5-0424-global.

5 5.1

Results and Analysis

Results on Score Prediction

LLM Prompt Engineering and ACR. Table 2 reports QWK for LLM prompt engineering and post-training methods. GPT-4 (w/ rubric) and GPT-4 (few-shot) achieve average QWK values of 0.415 and 0.474, respectively, substantially

Results on Feedback Generation

Using the RFE framework, we compare the feedback quality (RFE score) of four models: GPT-5.5 as a reference; RLAESStep 0 (the Qwen3.5-9B initialization before RLAES posttraining); RLAES-Score, trained solely with score rewards; and RLAES-AGFO, trained with AGFO. Overall Feedback Quality Comparison. As shown in Table 3, AGFO improves the model’s feedback-generation capability: the average RFE score of RLAES-AGFO reaches 0.8399, comparable to that of GPT-5.5 (0.8334). Meanwhile, RLAES-AGFO achieves a slightly higher QWK than RLAES-Score (0.8082 vs. 0.8043), suggesting that AGFO does not trade scoring accuracy for feedback quality. By contrast, the RFE score of RLAES-Score decreases from 0.6978 at Step 0 to 0.5608 after score-only RL, indicating that optimizing only the score reward may degrade feedback quality. We examine a possible explanation by analyzing the training dynamics below. In terms of training efficiency, we normalize the training time of RLAES-Score to 1×. Full feedback optimization (τ = 1) costs approximately 12×, whereas RLAES-AGFO costs 2× (about 160 hours per fold), representing a reduction of approximately 83%. RLAES-AGFO substantially reduces the overhead of frequent LLM-as-judge evaluations while achieving a favorable trade-off between training efficiency and model performance. Training Dynamics of Feedback Quality. Figure 4 tracks QWK and feedback quality (rubric reward, i.e., RFE score) on Prompt 1 test set at selected training checkpoints. For RLAES-Score, QWK rises from 0.052 to above 0.83,

Type

LLM Prompt Engineering

LLM Post-Training

Model

P1

P2

P3

P4

P5

P6

P7

P8

AVG

GPT-3.5 (rubric,1-shot) (2024) GPT-4 (w/ rubric) (2025a) GPT-4 (few-shot) (2025) Llama-3-8B-Instruct (2024) DeepSeek-V4-Pro (vanilla) + ACR + ACR-Lower Qwen3.7-Max (vanilla) + ACR + ACR-Lower

0.120 0.272 0.280 0.255 0.165 0.186 0.190 0.231 0.248 0.275

0.193 0.481 0.338 0.463 0.519 0.524 0.519 0.517 0.500 0.525

0.198 0.478 0.331 0.432 0.403 0.441 0.413 0.396 0.487 0.499

0.416 0.503 0.784 0.557 0.608 0.600 0.610 0.483 0.594 0.633

0.576 0.557 0.623 0.653 0.503 0.538 0.545 0.545 0.593 0.660

0.606 0.529 0.728 0.608 0.638 0.683 0.724 0.650 0.668 0.716

0.123 0.123 0.257 0.283 0.215 0.230 0.242 0.184 0.217 0.230

0.276 0.384 0.454 0.362 0.392 0.497 0.526 0.565 0.478 0.508

0.313 0.415 0.474 0.452 0.430 0.462 0.471 0.446 0.473 0.506

GPT-3.5 (2024) Dual-Process Model (2025) Llama-3.2-1B-Instruct (2025) Llama-3-8B-Instruct (2024) RTS (2025) SFTAES RLAES-Score RLAES-AGFO

0.741 0.761 0.711 0.821 0.835 0.824 0.840 0.839

0.618 0.652 0.778 0.727 0.710 0.702 0.739 0.734

0.704 0.724 0.682 0.717 0.730 0.707 0.732 0.735

0.859 0.809 0.723 0.824 0.840 0.819 0.829 0.829

0.796 0.812 0.769 0.815 0.821 0.800 0.821 0.820

0.848 0.776 0.692 0.829 0.839 0.820 0.839 0.837

0.727 0.707 0.776 0.837 0.838 0.827 0.846 0.853

0.614 0.489 0.631 0.752 0.740 0.770 0.770 0.775

0.738 0.716 0.720 0.789 0.794 0.784 0.802 0.803

Table 2: Scoring performance (QWK) across the eight ASAP prompts. Model GPT-5.5 RLAES-Step 0 RLAES-Score RLAES-AGFO

P1

P2

P3

P4

P5

P6

P7

P8

AVG

QWK

0.7650 0.6400 0.4508 0.8670

0.7843 0.6075 0.4590 0.7870

0.8654 0.8028 0.6546 0.9119

0.9064 0.8389 0.7042 0.9242

0.8767 0.7614 0.7108 0.9133

0.8904 0.7597 0.7126 0.8804

0.8217 0.6325 0.4096 0.7552

0.7576 0.5396 0.3846 0.6798

0.8334 0.6978 0.5608 0.8399

0.5615 0.3343 0.8043 0.8082

Table 3: Feedback performance (RFE score) across the eight ASAP prompts, with overall QWK. whereas rubric reward briefly increases from 0.640 to 0.702 before falling to 0.433. Thus, improvements in scoring accuracy do not necessarily translate into better feedback. A plausible explanation is that the model initially uses feedback as an intermediate reasoning path for score prediction, temporarily improving feedback quality. Once it learns to predict scores directly from input features, feedback no longer contributes to score optimization and, without direct optimization, begins to deteriorate. By contrast, at the final checkpoint, RLAES-AGFO achieves an RFE score of 0.866 versus 0.433 for RLAES-Score while maintaining comparable QWK, indicating that AGFO prevents feedback collapse without sacrificing scoring performance.

5.3

Evaluation of the RFE Framework

RFE Scores Across Feedback Types. Table 4 compares RFE scores for pseudo-gold, gold, and perturbed feedback. Gold feedback achieves an overall score of 0.969, whereas pseudo-gold feedback scores 0.694, with particularly low scores for Coverage (0.463) and Evidence (0.668). When each essay is paired with feedback from an adjacent-scoring essay, the overall score falls to 0.379, accompanied by sharp declines in Evidence (0.108) and Faithfulness (0.318). These results provide initial evidence that RFE detects essay– feedback inconsistency.

Type

Overall

Cov.

Evid.

Faith.

Safety

Pseudo-gold Gold Perturbed

0.694 0.969 0.379

0.463 0.974 0.507

0.668 0.939 0.108

0.849 0.994 0.318

0.880 0.947 0.667

Table 4: Overall and dimension-level RFE scores of different feedback types (Cov.: Coverage; Evid.: Evidence; Faith.: Faithfulness).

Pairwise Discriminative Power. We compare RFE with the BERTScore-based rubric-similarity method proposed by Li and Pan (2025a). As shown in Table 5, RFE ranks gold feedback above its perturbed counterpart for all 88 pairs (100.0%), whereas BERTScore does so for 40 of 78 applicable pairs (51.3%; Prompts 7 and 8 are excluded because their holistic scores cannot be uniquely mapped to trait-specific rubric descriptions). This contrast highlights a limitation of rubric-similarity evaluation: because BERTScore does not condition on the target essay, it cannot directly assess whether the feedback is faithful to that essay. RFE instead achieves stronger pairwise discrimination in this setting by using essay-grounded rubric items.

Figure 3: Mean predicted scores and one-standard-deviation ranges under different ACR configurations. Dashed markers show prompt-level gold means.

Method

Agree.

BERTScore 23/43 (53.5%) RFE Score 40/43 (93.0%)

Avg. Abs. ∆ Max. Abs. ∆ 0.0133 0.1163

0.0453 0.2857

Table 6: Agreement with expert preferences and score separation (Avg./Max. Abs. ∆: mean/maximum within-pair absolute score differences).

Figure 4: QWK and rubric reward during RLAES-Score and RLAES-AGFO training. Method

Pairs G > P G < P Tie

BERTScore RFE Score

78 88

40 88

38 0

0 0

Table 5: Pairwise discriminative performance on gold– perturbed feedback pairs.

Agreement with Expert Preferences. To assess agreement with expert preferences, we sample 43 essays and use an LLM to generate two feedback responses of comparable overall quality but with subtle differences for each essay. We limit the within-pair length difference to 10% to control for length bias. A senior evaluator familiar with ASAP and proficient in English identifies the preferred response in each pair. We score both responses with RFE and BERTScore and compare their rankings with the expert preferences. Table 6 reports expert agreement and score separation on the 43 challenging feedback pairs. RFE matches the expert preferences on 40 pairs (93.0%), whereas BERTScore

matches on 23 pairs (53.5%). RFE also yields larger score separation: its mean and maximum absolute within-pair differences are 0.1163 and 0.2857, versus 0.0133 and 0.0453 for BERTScore. These results indicate that RFE not only aligns more closely with expert preferences but also provides more discriminative feedback-quality scores.

6

Conclusion

We present RLAES-AGFO, an RL framework for jointly optimizing essay scoring and feedback generation. We introduce RFE for fine-grained feedback evaluation, yielding scores usable as RL rewards, and demonstrate that its rankings closely align with expert preferences. Building on RFE, AGFO adaptively activates feedback rewards during RL, reducing training time relative to full feedback optimization while avoiding the feedback degradation of score-only RL. We also introduce ACR to mitigate adjacent confusion in AES. Experiments show that RLAES-AGFO achieves the highest QWK among the LLM-based methods and an RFE score comparable to that of GPT-5.5, while ACR improves scoring performance across both evaluated base models. RLAES remains limited by its dependence on LLM judges, whose differing preferences can cause reward mismatch, particularly for complex scoring rubrics. Evaluation is also restricted to prompt-specific English essays from ASAP. Future work should examine cross-prompt, cross-domain, and multilingual settings, as well as alternative strategies for joint scoring and feedback optimization.

References Abudalfa, S. I.; and Barrot, J. S. 2026. Generative artificial intelligence for automated writing evaluation: A systematic review of trends, efficacy, and challenges. Assessing Writing, 68: 101041. Cai, Y.; Liang, K.; Lee, S.; Wang, Q.; and Wu, Y. 2025. Rank-Then-Score: Enhancing Large Language Models for Automated Essay Scoring. arXiv:2504.05736. Choi, H.; Kang, M.-C.; Seong, J.; and Huang, J.-X. 2026. Exploring zero-shot essay scoring: from feature-based to LLMbased approaches. Data Mining and Knowledge Discovery, 40(3): 35. DeepSeek-AI. 2026. DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence. Gunjal, A.; Wang, A.; Lau, E.; Nath, V.; He, Y.; Liu, B.; and Hendryx, S. 2025. Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domains. arXiv:2507.17746. Guo, D.; et al. 2025. DeepSeek-R1 incentivizes reasoning in LLMs through reinforcement learning. Nature, 645(8081): 633–638. Hamner, B.; Morgan, J.; lynnvandev; Shermis, M.; and Ark, T. V. 2012. The Hewlett Foundation: Automated Essay Scoring. https://kaggle.com/competitions/asap-aes. Kaggle. Huang, Y.; Palermo, C.; and Wilson, J. 2026. Accuracy and fairness of generative AI in automated essay scoring: Comparing GPT-4o, feature-based models, and human raters. Assessing Writing, 69: 101047. Johnsi, R.; and Kumar, G. B. 2025. Enhancing automated essay scoring by leveraging LSTM networks with hyperparameter tuned word embeddings and fine-tuned LLMs. Engineering Research Express, 7(2): 025272. Li, A. W.; and Collins, P. 2026. Formative feedback across sources: Student perceptions and writing outcomes with instructor, peer, and AI-generated feedback. Reading and Writing. Li, R.; Du, M.; Xu, B.; Zhu, C.; Wang, X.; and Mao, Z. 2026. DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Report. Li, X.; and Pan, W. 2025a. CEAES: Bidirectional Reinforcement Learning Optimization for Consistent and Explainable Essay Assessment. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 26267–26279. Vienna, Austria: Association for Computational Linguistics. Li, X.; and Pan, W. 2025b. KAES: Multi-aspect Shared Knowledge Finding and Aligning for Cross-prompt Automated Scoring of Essay Traits. Proceedings of the AAAI Conference on Artificial Intelligence, 39(23): 24476–24484. Liu, Y.; Han, J.; Sboev, A.; and Makarov, I. 2024. GEEF: A neural network model for automatic essay feedback generation by integrating writing skills assessment. Expert Systems with Applications, 245: 123043. Mansour, W. A.; Albatarni, S.; Eltanbouly, S.; and Elsayed, T. 2024. Can Large Language Models Automatically Score Proficiency of Written Essays? In Proceedings of the 2024

Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), 2777–2786. Torino, Italia: ELRA and ICCL. OpenAI. 2026. GPT-5.5 System Card. https://openai.com/ index/gpt-5-5-system-card/. Accessed: 2026-07-14. Ormerod, C. M.; and Kwako, A. 2024. Automated Text Scoring in the Age of Generative AI for the GPU-poor. arXiv:2407.01873. Qwen Team. 2026a. Qwen3.5: Towards Native Multimodal Agents. Qwen Team. 2026b. Qwen3.7: The Agent Frontier. Sasaki, T.; Conijn, R.; and Willemsen, M. C. 2026. The Blind Spots in Automated Feedback Generation for Academic Writing. In Proceedings of the LAK26: 16th International Learning Analytics and Knowledge Conference (LAK 2026), 610–620. ACM. Seßler, K.; Fürstenberg, M.; Bühler, B.; and Kasneci, E. 2025. Can AI grade your essays? A comparative analysis of large language models and teacher ratings in multidimensional essay scoring. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (LAK 2025), 462–472. ACM. Shao, Z.; Wang, P.; Zhu, Q.; Xu, R.; Song, J.; Bi, X.; Zhang, H.; Zhang, M.; Li, Y. K.; Wu, Y.; and Guo, D. 2024. DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models. arXiv:2402.03300. Shibata, T.; and Miyamura, Y. 2025. LCES: Zero-shot Automated Essay Scoring via Pairwise Comparisons Using Large Language Models. In Christodoulopoulos, C.; Chakraborty, T.; Rose, C.; and Peng, V., eds., Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 29988–30001. Suzhou, China: Association for Computational Linguistics. ISBN 979-8-89176-332-6. Su, J.; Yan, Y.; Fu, F.; Han, Z.; Ye, J.; Liu, X.; Huo, J.; Zhou, H.; and Hu, X. 2025. EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2025, 6363–6389. Vienna, Austria: Association for Computational Linguistics. Sun, J.; Song, T.; Peng, W.; and Song, J. 2025. A survey of automated essay scoring: Challenges, advances, and future. Neurocomputing, 650: 130916. Taghipour, K.; and Ng, H. T. 2016. A Neural Approach to Automated Essay Scoring. In Su, J.; Duh, K.; and Carreras, X., eds., Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1882–1891. Austin, Texas: Association for Computational Linguistics. Tversky, A.; and Kahneman, D. 1974. Judgment under Uncertainty: Heuristics and Biases. Science, 185(4157): 1124– 1131. Uto, M. 2026. Has Automated Essay Scoring Reached Sufficient Accuracy? Deriving Achievable QWK Ceilings from Classical Test Theory. In International Conference on Artificial Intelligence in Education, 555–570. Springer.

Wang, Y.; Ding, Z.; Wu, X.; Sun, S.; Liu, N.; and Zhai, X. 2026. AutoSCORE: Enhancing Automated Scoring with Multi-Agent Large Language Models via Structured Component Recognition. Proceedings of the AAAI Conference on Artificial Intelligence, 40(48): 40898–40906. Xiao, C.; Ma, W.; Song, Q.; Xu, S. X.; Zhang, K.; Wang, Y.; and Fu, Q. 2025. Human-AI Collaborative Essay Scoring: A Dual-Process Framework with LLMs. In Proceedings of the 15th International Learning Analytics and Knowledge Conference (LAK 2025), 293–305. ACM. Xiao, C.; Ma, W.; Xu, S. X.; Zhang, K.; Wang, Y.; and Fu, Q. 2024. From Automation to Augmentation: Large Language Models Elevating Essay Scoring Landscape. CoRR, abs/2401.06431. Xie, J.; Cai, K.; Kong, L.; Zhou, J.; and Qu, W. 2022. Automated Essay Scoring via Pairwise Contrastive Regression. In Proceedings of the 29th International Conference on Computational Linguistics, 2724–2733. Gyeongju, Republic of Korea: International Committee on Computational Linguistics. Yu, Q.; Zhang, Z.; Zhu, R.; Yuan, Y.; Zuo, X.; Yue, Y.; Dai, W.; Fan, T.; Liu, G.; Liu, J.; Liu, L.; Liu, X.; Lin, H.; Lin, Z.; Ma, B.; Sheng, G.; Tong, Y.; Zhang, C.; Zhang, M.; Zhang, R.; Zhang, W.; Zhu, H.; Zhu, J.; Chen, J.; Chen, J.; Wang, C.; Yu, H.; Song, Y.; Wei, X.; Zhou, H.; Liu, J.; Ma, W.-Y.; Zhang, Y.-Q.; Yan, L.; Wu, Y.; and Wang, M. 2025. DAPO: An Open-Source LLM Reinforcement Learning System at Scale. In Belgrave, D.; Zhang, C.; Lin, H.; Pascanu, R.; Koniusz, P.; Ghassemi, M.; and Chen, N., eds., Advances in Neural Information Processing Systems, volume 38, 113222– 113244. Curran Associates, Inc.

A

Joint Training Across Prompts

ASAP is commonly evaluated by performing five-fold crossvalidation independently for each of its eight prompts. Consequently, this “single-prompt, single-model” paradigm requires 8 × 5 = 40 training runs for a complete evaluation, complicating the experimental workflow and prolonging the evaluation cycle, particularly for computationally intensive LLM post-training. This model fragmentation also increases deployment and maintenance costs and conflicts with the efficient parameter sharing and unified model serving expected of LLM-based systems. We instead pool the training splits of all eight prompts within each fold and train a single model, which is evaluated on the corresponding test splits. Because each input includes prompt-specific scoring guidelines, the model can handle different score ranges without normalization. This protocol reduces a complete evaluation from 40 to 5 training runs while preserving the original data partitions: no test examples are included in the pooled training set, thereby eliminating the risk of data leakage from the test sets. Evaluation of Joint Training Across Prompts. We evaluate prompt joint training with NPCR, SFTAES, and RLAESScore, representing models spanning three method classes: the BERT-based AES model, LLM SFT, and LLM RL, respectively. NPCR is the most competitive open-source

BERT-based baseline. The evaluation is conducted on fold 0. As shown in Table 7, joint training changes average QWK by −0.0048, −0.0027, and −0.0041, respectively. All decreases are below 0.005 for any of the three model classes, indicating only a negligible loss in scoring performance. Overall, prompt joint training reduces the number of training runs from 40 to 5 with negligible performance loss, while simplifying the experimental workflow and enabling unified modeling and efficient deployment.

B

Additional Ablation Studies

Ablation on Feedback Output. We compare two RLAESScore configurations that use the same output format during training and inference: feedback-then-score and outputting only the score. As shown in Table 8, removing feedback from both training and inference decreases average QWK only marginally, from 0.8043 to 0.8036 (∆ = −0.0007). This negligible difference indicates that, when optimization uses only the score reward, including feedback in the model output has little effect on scoring accuracy. Ablation on ACR in RL Post-Training. We examine whether ACR remains beneficial during RL post-training by training RLAES-Score with the ACR response format. As shown in Table 9, ACR increases average QWK only marginally, from 0.802 to 0.805 (∆ = +0.003). This gain is substantially smaller than that observed in LLM prompt engineering, where ACR raises average QWK from 0.430 to 0.462 for DeepSeek-V4-Pro and from 0.446 to 0.473 for Qwen3.7-Max. One explanation is that ACR provides base models with an explicit inductive bias for adjacent-score discrimination, whereas RL post-training can internalize the same logic through direct optimization of the score reward, leaving limited additional benefit from ACR.

Model NPCR w/o joint NPCR SFTAES w/o joint SFTAES RLAES w/o joint RLAES

P1

P2

P3

P4

P5

P6

P7

P8

AVG QWK

∆QWK

0.8260 0.8334 0.8183 0.8240 0.8487 0.8331

0.7170 0.7301 0.7006 0.7044 0.7392 0.7529

0.7270 0.7328 0.7287 0.7158 0.7466 0.7620

0.8650 0.8170 0.8303 0.8244 0.8509 0.8355

0.8400 0.8267 0.8260 0.8014 0.8455 0.8332

0.8340 0.8462 0.8466 0.8319 0.8498 0.8462

0.7920 0.7880 0.8132 0.8139 0.8410 0.8333

0.7410 0.7292 0.7401 0.7663 0.7452 0.7386

0.7928 0.7879 0.7880 0.7853 0.8084 0.8043

– −0.0048 – −0.0027 – −0.0041

Table 7: Effect of prompt joint training on scoring performance (QWK). RLAES denotes RLAES-Score trained using only the score reward. Model RLAES-Score (w/ FB) RLAES-Score (w/o FB)

P1

P2

P3

P4

P5

P6

P7

P8

AVG QWK

0.8331 0.8282

0.7529 0.7348

0.7620 0.7485

0.8355 0.8573

0.8332 0.8291

0.8462 0.8366

0.8333 0.8354

0.7386 0.7590

0.8043 0.8036

Table 8: Effect of feedback output on scoring performance (QWK). “w/ FB” and “w/o FB” denote feedback-then-score and score-only outputs, respectively. Model

P1

P2

P3

P4

P5

P6

P7

P8

AVG QWK

RLAES-Score RLAES-Score (w/ ACR)

0.840 0.835

0.739 0.721

0.732 0.730

0.829 0.839

0.821 0.820

0.839 0.837

0.846 0.853

0.770 0.803

0.802 0.805

– +0.003

Table 9: Effect of ACR-formatted RL post-training on scoring performance (QWK). ∆ denotes the change in average QWK relative to RLAES-Score.

C

Experimental Prompts

Listing 1: LLM-as-judge prompt template for RFE. ### I. Role & Objective You are a senior educational assessment expert evaluating the quality of feedback produced by an Automated Essay Scoring (AES) system. You apply rigorous, high−standard evaluation criteria. Your task: For each rubric item below, judge whether the AES feedback satisfies that item (1 = yes, 0 = no). Base your judgment strictly on the provided materials. Apply strict standards − partial or borderline satisfaction should be scored 0. ### II. Guiding Principles − An AES system’s output consists of two parts: ∗∗Explanations∗∗ (textual feedback/commentary) and ∗∗Score∗∗ (numeric rating). In this evaluation, "feedback" refers exclusively to the Explanations portion. Evaluate ONLY the Explanations text; ignore the score the AES system assigned. − Each rubric item must be judged independently. Do not let one item’s judgment influence another. − ∗∗Anonymization placeholders∗∗: ‘@CAPS1‘, ‘@LOCATION1‘, ‘@PERCENT1‘, ‘@DATE1‘, ‘@ORGANIZATION1‘, ‘ @PERSON1‘, ‘@MONEY1‘, ‘@TIME1‘, etc., are de−identified placeholders inserted by Named Entity Recognition (NER) during data preprocessing. Assume they represent correct entities. The AES feedback should NOT interpret, comment on, or explain these placeholders. − ∗∗OCR / typo handling∗∗: Student essays may contain OCR errors. If the AES feedback quotes an OCR artifact as a student error, that is an incorrect citation. If the AES feedback quotes a genuine student spelling/grammar error, that is valid. − ∗∗Evidence Grounding∗∗: When judging whether the feedback provides "specific references," accept all of the following as valid evidence: (a) Direct quotation from the essay (verbatim text in quotes or clearly set off) (b) Specific paraphrase that points to identifiable, locatable content in the essay (c) Reference to a specific, identifiable detail (e.g., a particular argument, example, paragraph, or narrative event) Only reject vague generalizations that could apply to any essay (e.g., "the essay has good details" without specifying which). ∗∗Important∗∗: For items requiring "at least two" references, count each distinct quotation/paraphrase/detail reference separately. Two references to the same passage count as one. − ∗∗Reasoning chain∗∗: When an item asks whether the feedback "explains WHY" or provides a "reasoning chain," check that the feedback explicitly connects specific textual evidence to its evaluative conclusion (e.g., "The essay states X, which demonstrates Y because Z"). Merely juxtaposing a quote next to a judgment without explaining the connection does NOT satisfy this requirement. − ∗∗Conditional items∗∗: Some items have conditions (e.g., "If the feedback does not address conventions, score 1."). If the condition is not met, the item is automatically scored 1.

− ∗∗Reasoning−first∗∗: For each item, first cite specific evidence from the AES feedback or student essay, then derive your judgment (0 or 1). − ∗∗When uncertain, default to 0∗∗ (strict evaluation). ### III. Input Materials <essay_prompt> {essay_prompt} </essay_prompt> <student_essay> {student_essay} </student_essay> <rubric_guidelines> {rubric_guidelines} </rubric_guidelines> <AES_feedback_to_evaluate> {model_answer} </AES_feedback_to_evaluate> ### IV. Rubric Items to Evaluate {rubric_items_text} ### V. Output Requirements 1. Output ONLY a valid JSON array. No markdown code block markers. 2. No additional explanatory text outside the JSON. 3. Each object in the array corresponds to one rubric item above. <output_format> [ {{ "item_id": "<string>", "dimension": "<string>", "reason": "<evidence−driven explanation, cite specific content from the AES feedback or student essay>", "judgment": <0 or 1> }}, ... ] </output_format> Now, please begin your evaluation.

Listing 2: Prompt Template for AES and AFG # Role As a virtual evaluator with expertise in English composition, your role is to critically analyze and grade student essays according to a predetermined set of rubrics. You are to act as an impartial judge and evaluate the essays based on the quality of the writing and adherence to the essay prompt. # Sample Essay Prompt {essay_prompt} # Student’s Essay to Evaluate {{essay}} # Please carefully read the following rubric guidelines. The scoring range is from {min_score} to {max_score}: {scoring_rubric_guidelines} Note: The essay contains anonymized tags such as @CAPS1, @LOCATION1, etc. Please treat these as normal names, places, or capitalized words, and DO NOT penalize the student for their presence.

# Please strictly follow the format below when scoring. The explanations must be at least 100 words: − ∗∗Explanations∗∗: xxx − ∗∗Score∗∗: xx/{max_score}

Listing 3: Prompt Template for ACR # Please strictly follow the format below when scoring. − ∗∗Explanations∗∗: [Provide detailed analysis according to the rubric guidelines.] − ∗∗Why not the adjacent lower score∗∗: [If your Score xx is the minimum score {min_score}, simply state "This is the lowest possible score" and summarize why it falls into the lowest tier. Otherwise, explicitly identify the adjacent lower score xx−1, and explain why this essay is scored xx instead of xx−1.] − ∗∗Why not the adjacent higher score∗∗: [If your Score xx is the maximum score {max_score}, simply state "This is the highest possible score" and summarize why it falls into the top tier. Otherwise, explicitly identify the adjacent higher score xx+1, and explain why this essay is scored xx instead of xx+1.] − ∗∗Score∗∗: xx/{max_score}

Listing 4: Prompt Template for ACR-Lower # Please strictly follow the format below when scoring. − ∗∗Explanations∗∗: [Provide detailed analysis according to the rubric guidelines.] − ∗∗Why not the adjacent lower score∗∗: [If your Score xx is the minimum score {min_score}, simply state "This is the lowest possible score" and summarize why it falls into the lowest tier. Otherwise, identify the adjacent lower score xx−1, briefly recall the rubric description for xx−1, and explain why this essay clearly exceeds that description.] − ∗∗Score∗∗: xx/{max_score}

Record · ID 386913 · SHA-256 7f22ae3dd7894398
Retrieved via Conceptio — every document is proof-bundled with source, license, and retrieval metadata.