Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
Aixiu An * 1 Michael Jungo * 2 Eloi Eynard 3 Mark Drenhaus 4 Andreas Fischer 2 Jean Hennebert 1 Sébastien Rumley 1
1. Introduction
arXiv:2607.19181v1 [cs.CL] 21 Jul 2026
Abstract Neural machine translation (NMT) in the legal domain is a linguistically and conceptually demanding task, primarily due to the complexity of legal language and the high level of precision it requires. The recent emergence of reasoningcapable language models opens new possibilities for tackling such challenges. They add to a set of other previously proposed techniques to enhance the translation quality, which includes supervised fine-tuning and reinforcement learning.
Neural Machine Translation (NMT) has progressed rapidly alongside the development of large language models (LLMs), achieving substantial improvements in translation quality across many domains and language pairs (Kocmi & Federmann, 2023; Finkelstein et al., 2026). These advancements are particularly relevant in the context of multilingual legal translation, where precision, consistency, and preservation of legal meaning are critical. In Switzerland, the coexistence of German, French, Italian and Romansh as official languages, together with the multilingual nature of the Swiss legal system, creates a particularly challenging environment for NMT systems (Martı́nez-Domı́nguez et al., 2020; Canavese & Cadwell, 2024; Niklaus et al., 2025).
In this work, we perform a comparison between these various approaches. More particularly, we evaluate small language models such as Qwen3.5 4B, Qwen3.5 9B, and Gemma 3 12B enhanced with various re-training paradigms and compare their performances against frontier reasoning models. We focus on the Swiss legal system, which—with its unique multilingual statutes—offers a particularly challenging testbed for reasoning-augmented models. Our results show that the quality of small “base” models can be greatly enhanced, and that reinforcement learning with verifiable rewards can be applied to NMT in the legal domain and surpasses the translation quality of supervised fine-tuning. The performance of enhanced small models is close to the one of state-of-the-art reasoning models yet remains inferior. We also note that re-training paradigms yield diminishing returns as model size increase. The code and models are publicly available at https://github.com/aixiuxiuxiu/LegalMT-SFT-RL.
Beyond multilingualism, legal texts themselves introduce additional challenges. They are characterized by specialized terminology, complex syntactic structures, and the formal register of legalese—a style of legal writing often marked by highly technical vocabulary, long and syntactically complex sentences, and precise but rigid formulations (Mattila, 2016; Tiersma, 2008; Martı́nez et al., 2023). These linguistic features—combined with the need to preserve legal accuracy, nuance, and internal consistency—pose significant difficulties not only for human translators, but also for machine translation systems (e.g., Koehn & Knowles, 2017; Wiesmann, 2019), and continue to push the limits of even the most advanced NMT models. Recent work has demonstrated that LLMs, such as GPT, exhibit strong general-purpose translation capabilities with zero- and few-shot prompting (Hendy et al., 2023; Jiao et al., 2023). Building on these capabilities, some approaches have attempted to adapt small language models (SLMs) to the legal domain by fine-tuning them on domain-specific corpora (Niklaus et al., 2025). Such approaches are particularly relevant in legal and institutional contexts, where computational efficiency, deployment cost, data privacy, and on-premise inference constraints may limit the practical use of large proprietary models. While these methods yield improved performance over non-fine-tuned models, they often fall short of state-of-the-art LLMs in capturing the full linguistic complexity and precision required for high-quality legal
* Equal contribution 1 iCoSys, University of Applied Sciences and Arts Western Switzerland, Fribourg, Switzerland 2 AIBEX, University of Fribourg, Fribourg, Switzerland 3 Neur.on, Fribourg, Switzerland 4 Human-IST, University of Fribourg, Fribourg, Switzerland. Correspondence to: Aixiu An <[email protected]>, Michael Jungo <[email protected]>.
Proceedings of the 43 rd International Conference on Machine Learning, Seoul, South Korea. PMLR 306, 2026. Copyright 2026 by the author(s).
1
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
translation.
model. This dataset aims to support future research on reasoning-augmented translation in legal domains.
More recently, advances in NMT have been significantly influenced by the emergence of Large Reasoning Models (LRMs), such as the GPT-O series and DeepSeek-R1 (Guo et al., 2025), which have opened new opportunities for addressing complex translation tasks (Liu et al., 2025). These models have demonstrated impressive performance on reasoning-intensive tasks such as mathematics (Ahn et al., 2024; Xia et al., 2025) and programming (El-Kishky et al., 2025; Zhao et al., 2025), highlighting their capacity to reflect, reason, and iteratively refine their outputs. In the context of translation, LRMs extend their reasoning capabilities by treating translation as a dynamic inference process—enabling more accurate handling of context, cultural nuances, and syntactic complexity. For instance, their selfreflective mechanisms can be leveraged for error detection and correction during inference, allowing them to better handle ambiguous and linguistically demanding translation scenarios (Wang et al., 2024; Chen et al., 2025; Wu et al., 2025).
3. We propose a GRPO training recipe, accompanied by a simple yet effective reward formulation tailored to legal translation tasks, which can serve as a blueprint for future work on domain-specific reinforcement learning in NMT. Our main findings are as follows: (a) While both SFT and RL improve translation quality, these effects are particularly pronounced for smaller models; (b) RL yields more substantial performance gains than SFT; (c) Reasoningaugmented SFT does not consistently outperform simple SFT; (d) Model size plays an important role, and among the evaluated smaller-scale models, GRPO-trained Gemma 3 12B achieves the best performance for Swiss legal translation. 1
2. Related Work: Reasoning in Neural Machine Translation
In light of these developments, this paper explores how reasoning can be leveraged to improve translation quality, with a particular focus on Swiss legal translation. We investigate both the impact of different training paradigms and the role of model scale in reasoning-based legal translation. In particular, we compare supervised fine-tuning (SFT) and reinforcement learning (RL) approaches across models of different sizes, ranging from 4B to 12B parameters, to better understand how reasoning capabilities interact with model capacity.
Recent studies have begun to leverage reasoning capabilities of language models to enhance NMT, with approaches ranging from multi-agent systems to reinforcement learning. For example, Wang et al. (2024) propose a multi-agent framework for translating figurative language, where a translator agent iteratively improves translations based on feedback from advisor and evaluator agents. Similarly, Wu et al. (2025) investigate reasoning-based prompting for MT and find that simple self-refinement strategies, such as asking the model to “translate again,” can outperform explicit chain-ofthought decomposition.
In the SFT setting, we investigate two variants: Reasoning SFT, where models are fine-tuned on translation pairs accompanied by intermediate reasoning steps; and Simple SFT, where models are trained solely on direct sentencelevel translation pairs. We then compare these approaches with an RL setup based on Group Relative Policy Optimization (GRPO) (Shao et al., 2024) to evaluate the effectiveness of reasoning-augmented training strategies for legal translation across different model scales.
Reinforcement learning for deep reasoning in MT is a relatively new area, but emerging studies reflect growing interest in its potential. A notable example is R1-T1 (He et al., 2025), which uses COMET scores (Rei et al., 2020) as reward signals and trains models via a modified REINFORCE++ algorithm (Hu et al., 2025). Building on this work, Wang et al. (2025) enhance reasoning-capable LLMs using RL, adopting the Group Relative Policy Optimization (GRPO) (Shao et al., 2024) as the training foundation. Rather than relying on predefined heuristic metrics, they employ an advanced LLM as a reward model, which evaluates both the translation output and the reasoning process using carefully designed prompt-based scoring criteria. More recently, Finkelstein et al. (2026) introduced the TranslateGemma model, which combines supervised fine-tuning with reinforcement learning, where the latter stage optimizes translation quality using an ensemble of reward models, including MetricX-QE (Juraska et al., 2024) and AutoMQM
Specifically, we make the following three contributions: 1. We conduct a systematic and detailed comparison of three approaches for integrating reasoning into translation across different model families: (1) prompting large reasoning models, (2) Fine-tuning of small language models using intermediate reasoning steps, and (3) applying RL techniques to optimize model’s translation. 2. We release a new dataset of 40 000 legal translation pairs enriched with automatically generated intermediate reasoning steps, produced using the DeepSeek-R1
1 The code is available in the GitHub repository https:// github.com/aixiuxiuxiu/Legal-MT-SFT-RL
2
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
(Fernandes et al., 2023).
by the translation models under consideration. After filtering, the final evaluation dataset consists of 18.1k sentence pairs.
3. Experiments Setup 3.1. Datasets
3.2. Evaluation Metrics
Our experiments build upon the SwiLTra-Bench dataset (Niklaus et al., 2025), which is currently the largest publicly available dataset for legal translation in Switzerland. The dataset spans five languages: the four official Swiss languages (German, French, Italian, and Romansh) as well as English. For this study, we focus on the SwissLawTranslations (CH-Law-Trans) subset, which includes approximately 631k aligned translation pairs for training and 22.7k sentence pairs for evaluation.
For evaluation, we use a combination of commonly used machine translation evaluation metrics, including both lexical and model-based approaches: ChrF (Popović, 2015), METEOR (Banerjee & Lavie, 2005), COMET (Rei et al., 2020), and MetricX (Juraska et al., 2024). In contrast to ChrF, which measures character n-gram similarity between the generated translation and the reference, METEOR extends lexical matching by incorporating stemming and synonymy, allowing for a more flexible comparison between translations and references. COMET is a neural evaluation metric that leverages pretrained multilingual language models to assess semantic adequacy and fluency by comparing the source, hypothesis, and reference translation. MetricX is a large language model-based evaluation metric designed to provide fine-grained assessments of translation quality, with a stronger focus on semantic correctness and factual consistency.
Training Dataset To construct a training dataset suitable for Reasoning SFT, we use the DeepSeek-R1 model to generate intermediate reasoning steps for each translation example. Specifically, we select the first 40 000 sentence pairs from the training split of SwissLegalTranslations and prompt DeepSeek-R1 to produce both the reasoning steps and the final translation using prompt format:
While GEMBA-MQM (Kocmi & Federmann, 2023) has demonstrated strong correlation with human judgments, we did not prioritize it because it relies on GPT-based evaluation and would incur a high estimated evaluation cost exceeding $3 000. In addition to automatic metrics, we also perform human evaluation on a representative sample of translations to further assess translation quality and validate the automatic evaluation results.
Translate the following sentence to target language while respecting Swiss legal parlance. Give the final translation starting with “Final translation:” Here’s the sentence to translate: Source sentence: source sentence To ensure that the reasoning steps meaningfully contribute to correct translations, we evaluate the final outputs using the ChrF (Popović, 2015) score, a character n-gram overlap metric commonly used for machine translation evaluation 2 . We retain only samples with a ChrF score above the median value (64.19), thereby filtering out lower-quality translations while preserving approximately half of the generated data. This filtering step helps isolate reasoning sequences that are more likely to support high-quality translation. The resulting dataset contains 19 979 sentence pairs, which are split into 90% for training and 10% for validation. The distribution of language pairs in this filtered dataset is illustrated in Table 4.
4. Experiments 4.1. Experiment I: Reasoning via Prompting To assess the capabilities of current state-of-the-art large reasoning models in legal translation, we evaluate a diverse set of model families, including DeepSeek-R1, OpenAI’s o4-mini, o4, o3, and o3-mini. For comparison, we also include a smaller model: Mistral-Small. All experiments are conducted on the Azure AI Foundry platform3 . We do not aim to benchmark all existing frontier models—for instance, we do not test the Claude family despite its strong reported performance in Niklaus et al. (2025). Instead, this experiment is intended to establish a representative baseline for large reasoning models, which serves as a point of comparison for the SFT and RL experiments using small language models 4 presented in later sections.
Evaluation Dataset For the evaluation across the three experiments described in the following section, we use the 22.7k sentence pairs from the test split of SwissLegalTranslations. To ensure comparability, we exclude Romansh from the dataset, as it is not supported
3 https://azure.microsoft.com/en-us/ products/ai-foundry 4 We define small language models as models with between 1 billion and 12 billion parameters.
2
We use the ChrF score here because of its effectiveness in capturing lexical and terminological accuracy, which is particularly important in the legal domain.
3
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
All models are evaluated using the same prompt described in subsection 3.1, which directly instructs the model to produce the final translation. This prompt format has been shown to be effective in eliciting accurate outputs in the Swiss legal context.
mainder truncated). We deliberately avoid using the maximum allowable sequence length—particularly for Reasoning SFT—as we observed that very long inputs can cause models such as those in the Qwen family to produce repetitive outputs. Limiting the input length also encourages the models to generate more concise and focused reasoning steps.
4.2. Experiment II: Reasoning via SFT
We adopt a training setup similar to that of Niklaus et al. (2025). All models are trained on the full training set to maximize data coverage. We apply sequence packing, use a weight decay of 0.01, and set the batch size between 40 and 64 depending on model capacity. Training is conducted for 10 epochs with early stopping based on validation performance (patience set to 3 epochs). We use a cosine learning rate schedule (Loshchilov & Hutter, 2017a) with a warmup ratio of 0.1 and a base learning rate of 1e−4, which we manually tune within the range of [2e−5, 1e−4].
Experiment II investigates whether supervised fine-tuning of small language models with intermediate reasoning steps can enhance legal translation quality. To this end, we explore two SFT approaches. The first, Simple SFT, involves fine-tuning the SLMs solely on the correct translations. The second, Reasoning SFT, fine-tunes the SLMs using both the final translations and the intermediate reasoning steps that lead to them. The goal is to encourage the SLMs to think more like a large reasoning model, potentially enabling it to produce more accurate and contextually grounded translations.
Generation We use vLLM7 (Kwon et al., 2023) for sentence generation during evaluation. After experimenting with temperature values in the range [0, 0.7], we found that a temperature of 0 consistently produced the most reliable and coherent outputs across all settings. All generations were performed on an NVIDIA A40 48GB GPU. Generation over the full evaluation dataset typically takes around 30 minutes for the Simple SFT models, while the Reasoning SFT models require 3–6 hours due to longer output sequences.
Training Setup We fine-tune three SLMs on our dataset: Qwen3.5 4B, Qwen3.5 9B, and Gemma 3 12B. These models were selected for their comparable parameter scales and for representing two distinct model families. Fine-tuning is performed using the Hugging Face transformers5 and unsloth6 libraries, with 4-bit quantization and 8-bit AdamW optimization (Loshchilov & Hutter, 2017b; Dettmers et al., 2021). Training is conducted on two NVIDIA A40 48GB GPUs. We employ Low-Rank Adaptation (LoRA) (Hu et al., 2022; Kalajdzievski, 2023) with a rank of 16 and an alpha value of 32.
4.3. Experiment III: Reasoning via Reinforcement Learning We use the same training and validation datasets as in Experiment II.
Instruction Format We adopt the Alpaca-style instruction tuning format, which has been shown to improve generalization to new tasks (Taori et al., 2023). The instruction template is presented in Appendix B.
The reinforcement learning employs GRPO with simple verifiable rewards in order to promote the reasoning alongside a high quality translation. Similar to DeepSeek-R1, two rule-based rewards have been used:
The key distinction in the Reasoning SFT setting lies in incorporating intermediate reasoning steps generated by DeepSeek-R1 into the model’s training responses. Specifically, we extract the content enclosed between the <think> and </think> tags and pair it with the corresponding ground truth target sentence as the final translation. This setup aims to expose the model to structured reasoning patterns that precede accurate translations.
• Format: To make the translation easily extractable while also enforcing the presence of the reasoning, the model must put its thinking process inside the <think></think> tag and its final translation inside the <translation></translation> tag. The presence of each tag gives a reward of 0.5, with an additional 0.5 if they occur in the correct order. This is to ensure that the thinking is done before given the final translation, such that it can potentially improve the translation rather than given an explanation after the fact.
We train the models using a maximum sequence length of 512 tokens for Simple SFT, which covers approximately 99% of the sentences, and 1024 tokens for Reasoning SFT, which captures over 95% of the training set (with the re5
https://github.com/huggingface/ transformers 6 https://github.com/unslothai/unsloth
• Translation quality: A reward for the quality of the 7
4
https://github.com/vllm-project/vllm
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning Table 1. Performance of frontier models for legal translation using prompting (Experiment I).
Model
Output Pricing per 1M tokens
ChrF ↑
COMET ↑
METEOR ↑
MetricX ↓
OpenAI o3 OpenAI 4o DeepSeek-R1 OpenAI o4-mini OpenAI o3-mini Mistral-Small-2503
$8.00 $8.00 $5.40 $4.40 $4.40 $0.15
64.87 ± 0.10 62.40 ± 0.10 61.04 ± 0.10 60.53 ± 0.10 58.88 ± 0.10 61.22 ± 0.10
85.92 ± 0.05 85.35 ± 0.05 84.35 ± 0.05 84.35 ± 0.05 84.21 ± 0.05 84.41 ± 0.05
64.82 ± 0.12 61.57 ± 0.13 59.27 ± 0.12 58.91 ± 0.12 56.88 ± 0.12 60.19 ± 0.12
2.54 ± 0.01 2.87 ± 0.01 3.13 ± 0.01 2.84 ± 0.01 3.09 ± 0.01 3.12 ± 0.01
o3
4o
DeepSeek-R1
o4-mini
o3-mini
Mistral-Small-2503
Mean COMET Score
90 88 86 84 82 80 de → en
de → f r
de → it
f r → en
f r → it
it → en
Figure 1. Comparison of translation quality (mean of COMET score) across language pairs for different frontier models evaluated on the test dataset.
sure8 . Among the evaluated models, the o3 model achieves the highest performance across all metrics but is also the most expensive. In contrast, the Mistral-Small-2503 model is approximately ten times cheaper while delivering comparable results, making it the most cost-effective option.
translation is paramount to guide the model to produce better responses. The final translation is extracted from the response, which is then compared to the ground truth. We chose the ChrF score to assess the quality of the translation and used it directly as a reward, since the values are in the range [0, 1]. This results in a continuous scale for the reward, which gives extra nuance to the differences in responses, allowing a more fine-grained adaptation.
When examining performance across language pairs (Figure 1), we find that the relative ranking of models remains largely consistent across pairs. All models achieve their best results on the f r → it pairs, likely due to the close linguistic relationship between these two Romance languages. The o4-mini model shows particularly strong performance when translating into English, whereas the mistral-small-2503 model performs better on translations into French or Italian.
A group size of G = 4 is used, meaning that for each input sentence four different responses are sampled which are then compared to each other based on the rewards. Due to the increased computational demands for these generations, only a single epoch was performed compared to the 10 epochs for the SFT. The training parameters remain unchanged, with the exception of the learning rate, which needed to be reduced to 2e−5 as the higher learning rate led to training instabilities.
Performance of SFT vs. RL Table 2 reports the overall results for SFT and RL using four evaluation metrics: ChrF, COMET, METEOR and MetricX. We find that RL consistently improves translation quality across all models and achieves the best overall performance. In particular, RL with Gemma 3 12B delivers the strongest results among the smaller models, performing just below the frontier model o4-mini. This demonstrates that reasoning-augmented training can substantially narrow the performance gap be-
5. Results Performance of State-of-the-Art Reasoning Models We report the performance of large reasoning models in Table 1. As the exact model sizes are not publicly disclosed, we use the output cost per million tokens as a proxy mea-
8
5
Experiments and pricing estimates correspond to July 2025.
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning Table 2. Comparison of performance of SFT and RL in legal translation (Experiments II and III).
Method
ChrF ↑
COMET ↑
METEOR ↑
MetricX ↓
Base Model Simple SFT Reasoning SFT RL Base Model Simple SFT Reasoning SFT RL Base Model Simple SFT Reasoning SFT RL
50.53 ± 0.18 50.03 ± 0.12 42.84 ± 0.16 54.64 ± 0.10 51.76 ± 0.19 51.38 ± 0.12 49.42 ± 0.12 56.02 ± 0.10 56.73 ± 0.10 55.86 ± 0.11 53.29 ± 0.14 57.32 ± 0.10
77.05 ± 0.15 76.47 ± 0.09 69.88 ± 0.14 79.47 ± 0.07 77.99 ± 0.16 77.25 ± 0.10 76.88 ± 0.10 81.52 ± 0.06 82.49 ± 0.05 82.45 ± 0.06 79.02 ± 0.12 83.08 ± 0.05
47.21 ± 0.19 47.96 ± 0.13 39.99 ± 0.16 50.98 ± 0.12 49.08 ± 0.20 49.36 ± 0.14 47.59 ± 0.14 53.66 ± 0.12 53.20 ± 0.12 54.29 ± 0.12 51.74 ± 0.16 54.92 ± 0.12
5.13 ± 0.04 6.07 ± 0.03 7.56 ± 0.03 4.95 ± 0.02 4.66 ± 0.04 5.61 ± 0.03 5.69 ± 0.03 4.07 ± 0.02 3.70 ± 0.02 3.71 ± 0.02 4.53 ± 0.03 3.32 ± 0.01
Qwen3.5 9B
70
70 → de
fr
→ de
en
it it →
→
en
fr
→ fr
→ de
→ de
fr
→ de
en
75
→
75
it
80
it
80
→
85
fr
85
Gemma 3 12B
en
90
it
90
en
Mean COMET Score
RL
Reasoning SFT
en
Simple SFT
→
Base
it
Gemma 3 12B
fr
Qwen3.5 9B
→
Qwen3.5 4B
de
Model
Figure 2. Comparison of translation quality (mean of COMET score) for Qwen3.5 9B (left) and Gemma 3 12B (right) across different language pairs and training procedures.
the best performance, followed by Simple SFT and the base model which outperform each other in different categories, and lastly Reasoning SFT. For Gemma 3 12B, the base model is much closer to RL, and technically surpasses it for it → en by the tiniest margin, although that would be considered to be on par. The strongest overall results for Qwen3.5 9B and Gemma 3 12B can be observed in the language pairs de → en, whereas the f r → it pairs exhibit the largest difference compared to the frontier models, which are their best performing language pairs.
tween small models and state-of-the-art LLMs. When comparing RL to SFT, we observe that RL consistently outperforms both SFT variants across all models. Examining the two SFT approaches more closely, we find that Reasoning SFT degrades the quality of the translation in comparison to Simple SFT. This is especially noticeable on the smallest model Qwen3.5 4B, where the gap of every metric is much larger than in the larger models. Although Simple SFT outperforms the Reasoning SFT, it performs marginally worse than the base model. This means that it is more beneficial to use the pretrained models unaltered than training them with SFT.
Comparison Across Metrics Comparing the different evaluation metrics, we observe that while each captures a different aspect of translation quality—lexical overlap (ChrF), semantic similarity (COMET / MetricX), and linguistic fluency (METEOR)—the overall ranking of methods remains consistent across all metrics. Although absolute scores vary, RL consistently outperforms other approaches.
In terms of performance differences across language pairs, as illustrated in Figure 2 for Qwen3.5 9B and Gemma 3 12B, we observe that RL performs on par with or slightly better than the baselines for most language pairs. For Qwen3.5 9B, all language pairs exhibit a consistent pattern: RL achieves 6
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
This trend aligns with the results from Experiment I, where the strongest models also achieve top performance across all evaluation criteria.
little added value. Another concern is that current reasoning models, while demonstrating emergent reasoning abilities (Wei et al., 2022; Webb et al., 2023), often fail to provide genuine explanatory depth. In particular, these capacities are often considered superficial, and models are unlikely to generate “how-actually” explanations that reflect true causal or conceptual understanding (Musker et al., 2024). Providing explicit reasoning steps during training or prompting does not necessarily incentivize models to engage in authentic reasoning. Instead, they may simply learn to reproduce reasoning-like patterns without acquiring the underlying cognitive mechanisms such steps are meant to encourage.
Table 3. Pearson correlation between human evaluation scores and automatic evaluation metrics. COMET shows the strongest correlation with expert judgments on the legal translation dataset. Metric
Pearson Correlation (r)
p-value
ChrF METEOR COMET MetricX
0.05 0.07 0.24 -0.13
0.54 0.40 0.00 0.11
Human Evaluation We sampled 240 translation pairs covering all language combinations present in the dataset. A legal expert manually assessed the translation quality on a scale from 1 to 10, considering factors such as accuracy, fluency, and preservation of legal meaning. We then computed the Pearson correlation between the human annotation scores and the automatic evaluation metrics to assess their alignment with expert judgments. As shown in Table 3, COMET achieves the highest correlation with human evaluations, indicating a stronger alignment with expert judgments on the legal translation dataset.
6.2. Reinforcement Learning vs. Supervised Fine-Tuning We observe that reinforcement learning consistently outperforms supervised fine-tuning in our experiments. This suggests that RL may provide a more effective mechanism for enabling models to internalize reasoning strategies through the reward optimization process. In the broader literature, the differences between SFT and RL have been explored across a range of tasks, with RL predominantly showing improved generalization capabilities. Chu et al. (2025) compared them in an arithmetic reasoning card game and a real-world navigation scenario, which require text-based and visual reasoning, and came to the conclusion that SFT tends to memorize the training data and therefore struggles to generalize to out-of-distribution data, while RL exhibits more generalized reasoning capabilities. Similarly, Jungo & Fischer (2025) showed that RL generalizes better to previously unseen classes and out-ofdistribution samples on the task of document classification. In the medical domain, Med-RLVR (Zhang et al., 2025) observed a similar trend for medical multiple-choice questions where RL improves the accuracy on out-of-distribution data by 8 points compared to SFT, indicating that it also applies to domain specific language. For general machine translation, MT-R1-Zero (Feng et al., 2025) successfully applied RL with competitive performance to other models trained with SFT, while observing stronger generalization to out-of-distribution tasks, including languages the model was not trained on.
6. Discussions 6.1. Leveraging Reasoning in Translation Translation often requires careful refinement and review to ensure alignment with normative language (Ordudari, 2007; Nida, 1964). This is particularly important in technical domains such as the legal field, where precision in terminology and strict adherence to legal conventions are essential. These requirements extend beyond surface-level semantic equivalence. This motivates the integration of reasoning into the translation process, as prior studies have shown that adding self-reaffine improve translation (Chen et al., 2023; Wang et al., 2024). In our training dataset for the Reasoning SFT setup, we examined the reasoning steps generated by DeepSeek. We found that the model produces coherent, multi-step reasoning sequences that often resemble the workflow of a human translator. These typically include decomposing the sentence, translating individual components, recomposing the full output, and conducting a final review and refinement.
6.3. Global Quality and Cost-Quality Comparisons Pure Quality Figure 3 shows that commercial frontier models reach COMET scores in the 84.21 to 85.94 range, whereas small models enhanced with the reinforcement learning method fall in the 79.47 to 83.08 range. There is nearly an overlap, as the gap keeps narrowing.
While the objective of Reasoning SFT is to encourage a more structured and deliberate translation process, our results indicate that fine-tuning with explicit reasoning steps degrades the performance rather than improving it. These models may already possess strong intrinsic reasoning abilities that were obtained during their pre-training, therefore, the addition of shallow or formulaic reasoning steps offers
Considering quality exclusively (that is, not considering cost 7
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
88
Mean COMET Score
86
85.92
85.35 84.35
84.35
84.41
84.21
84
83.08 81.52
82 79.47
80 78
RL
a3 G em m
3.
5
12
B
9B
+
+
+ 4B Q w en
.5 en 3 Q w
ist r M
RL
RL
3 50
i al -S
m al l-2
3m in
nA Io O
pe
Io nA O pe
D
ee
pS
ee
4m in i
kR1
o I4 pe nA O
O pe
nA
Io
3
76
Figure 3. Performance comparison of RL enhanced small models with frontier models, using the COMET score as a benchmark.
of model for the moment), performance of small enhanced models could potentially be raised by fine-tuning parameters such as the value of the reward, the group size, etc. Hence, enhanced small models might be competitive for NMT.
complex setting for NMT systems. We design and evaluate three complementary approaches to reasoning integration: prompting frontier models, SFT with intermediate reasoning steps, and RL using reward-based feedback.
It might be tempting to try to fill the performance gap by using slightly larger RL-enhanced models. However, referring to Table 2, one can remark that the relative enhancement provided by RL shows diminishing returns as the language model gets larger. The quality of Qwen3.5 4B evolves from 77.05 to 79.47 (+2.47) in terms of COMET score, while Gemma3 12B only improves by +0.59 (from 82.49 to 83.08). We plan to investigate this further.
Our results show that although frontier models still achieve the strongest overall translation quality, reasoningaugmented training methods—especially RL—substantially narrow the performance gap. Across all evaluated model architectures, RL consistently surpasses SFT, demonstrating that reinforcement learning with verifiable rewards is a highly effective approach for improving legal translation quality and enabling smaller open-source models to acquire stronger reasoning capabilities. Notably, our bestperforming open-source models use more than 100× fewer parameters than frontier models while achieving competitive translation quality. These findings provide strong empirical evidence that explicit reasoning and RL-based optimization can significantly advance domain-specific neural machine translation.
Cost-Quality Trade-off In contrast to commercial models, whose usage costs are known (see Table 1), the costs associated with the enhanced models evaluated in this study remain unknown. Nevertheless, assuming that reinforcement learning (RL) enhancement has only a marginal impact on computational complexity, these costs are expected to represent only a fraction of those incurred by frontier models comprising several hundred billion parameters. Therefore, once the focus shifts from a quality-at-any-cost perspective to a cost–quality trade-off, our results indicate that RLenhanced models emerge as a compelling and viable design option.
Future work will focus on improving reinforcement learning methods for legal machine translation, as well as optimizing the trade-off between training and inference costs and translation quality. This includes investigating more effective reward designs, more efficient training strategies, and approaches that improve translation quality while reducing computational requirements.
7. Conclusion In this work, we investigate multiple strategies of leveraging reasoning to enhance translation quality, with a specific focus on the Swiss legal domain—a high-stakes, linguistically 8
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
Limitations
Conference of the European Association for Machine Translation (Volume 1), pp. 347–359, 2024.
We rely on four cost-efficient evaluation metrics to assess translation quality: ChrF, METEOR, COMET, and MetricX. Although more fine-grained evaluation methods—such as using LLMs as judges—may provide deeper insights, they are resource-intensive and less scalable. Additionally, we fine-tune only a handful of commonly used models. Future work could explore models of varying sizes and architectures to gain a broader understanding of performance trends. Finally, our RL experiments use simple, rule-based rewards; more complex or adaptive reward functions may offer additional gains and warrant further investigation.
Chen, A., Song, Y., Zhu, W., Chen, K., Yang, M., Zhao, T., et al. Evaluating o1-like llms: Unlocking reasoning for translation through comprehensive analysis. arXiv preprint arXiv:2502.11544, 2025. Chen, P., Guo, Z., Haddow, B., and Heafield, K. Iterative translation refinement with large language models. arXiv preprint arXiv:2306.03856, 2023. Chu, T., Zhai, Y., Yang, J., Tong, S., Xie, S., Levine, S., and Ma, Y. SFT memorizes, RL generalizes: A comparative study of foundation model post-training. In The Second Conference on Parsimony and Learning (Recent Spotlight Track), 2025. URL https://openreview.net/ forum?id=d3E3LWmTar.
Impact Statement This work advances legal machine translation by demonstrating that reinforcement learning with verifiable rewards can improve translation quality beyond supervised finetuning. By focusing on open-source models, our approach contributes to making high-quality legal translation systems more accessible, transparent, and reproducible for researchers, institutions, and practitioners who rely on open technologies.
Dettmers, T., Lewis, M., Shleifer, S., and Zettlemoyer, L. 8bit optimizers via block-wise quantization. arXiv preprint arXiv:2110.02861, 2021. El-Kishky, A., Wei, A., Saraiva, A., Minaiev, B., Selsam, D., Dohan, D., Song, F., Lightman, H., Clavera, I., Pachocki, J., et al. Competitive programming with large reasoning models. arXiv preprint arXiv:2502.06807, 2025.
Acknowledgements
Feng, Z., Cao, S., Ren, J., Su, J., Chen, R., Zhang, Y., Xu, Z., Hu, Y., Wu, J., and Liu, Z. Mt-r1-zero: Advancing llmbased machine translation via r1-zero-like reinforcement learning. arXiv preprint arXiv:2504.10160, 2025.
The authors would like to thank the Hasler Foundation and the Mercator Foundation Switzerland for their generous financial support.
References
Fernandes, P., Deutsch, D., Finkelstein, M., Riley, P., Martins, A. F., Neubig, G., Garg, A., Clark, J. H., Freitag, M., and Firat, O. The devil is in the errors: Leveraging large language models for fine-grained machine translation evaluation. In Proceedings of the Eighth Conference on Machine Translation, pp. 1066–1083, 2023.
Ahn, J., Verma, R., Lou, R., Liu, D., Zhang, R., and Yin, W. Large language models for mathematical reasoning: Progresses and challenges. In Falk, N., Papi, S., and Zhang, M. (eds.), Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, pp. 225–237, St. Julian’s, Malta, March 2024. Association for Computational Linguistics. doi: 10.18653/v1/2024. eacl-srw.17. URL https://aclanthology.org/ 2024.eacl-srw.17/.
Finkelstein, M., Caswell, I., Domhan, T., Peter, J.-T., Juraska, J., Riley, P., Deutsch, D., Kovacs, G., Dilanni, C., Cherry, C., et al. Translategemma technical report. arXiv preprint arXiv:2601.09012, 2026. Guo, D., Yang, D., Zhang, H., Song, J., Zhang, R., Xu, R., Zhu, Q., Ma, S., Wang, P., Bi, X., et al. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025.
Banerjee, S. and Lavie, A. Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, pp. 65–72, 2005.
He, M., Liu, Y., Tao, S., Luo, Y., Zeng, H., Su, C., Zhang, L., Ma, H., Wei, D., Meng, W., et al. R1-t1: Fully incentivizing translation capability in llms via reasoning learning. arXiv preprint arXiv:2502.19735, 2025.
Canavese, P. and Cadwell, P. Translators’ perspectives on machine translation uses and impacts in the Swiss Confederation: Navigating technological change in an institutional setting. In Proceedings of the 25th Annual
Hendy, A., Abdelrehim, M., Sharaf, A., Raunak, V., Gabr, M., Matsushita, H., Kim, Y. J., Afify, M., and Awadalla, 9
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
H. H. How good are gpt models at machine translation? a comprehensive evaluation. arXiv preprint arXiv:2302.09210, 2023.
Loshchilov, I. and Hutter, F. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017b. Martı́nez, E., Mollica, F., and Gibson, E. Even lawyers do not like legalese. Proceedings of the national academy of sciences, 120(23):e2302672120, 2023.
Hu, E. J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., Chen, W., et al. Lora: Low-rank adaptation of large language models. ICLR, 1(2):3, 2022.
Martı́nez-Domı́nguez, R., Rikters, M., Vasiļevskis, A., Pinnis, M., and Reichenberg, P. Customized neural machine translation systems for the Swiss legal domain. In Proceedings of the 14th Conference of the Association for Machine Translation in the Americas (Volume 2: User Track), pp. 217–223, 2020.
Hu, J., Liu, J. K., and Shen, W. Reinforce++: An efficient rlhf algorithm with robustness to both prompt and reward models. arXiv preprint arXiv:2501.03262, 2025. Jiao, W., Wang, W., Huang, J.-t., Wang, X., Shi, S., and Tu, Z. Is chatgpt a good translator? yes with gpt-4 as the engine. arXiv preprint arXiv:2301.08745, 2023.
Mattila, H. E. Comparative legal linguistics: Language of law, Latin and modern lingua francas. Routledge, 2016.
Jungo, M. and Fischer, A. Rule-based reinforcement learning for document image classification with vision language models. In International Conference on Document Analysis and Recognition, pp. 292–309. Springer, 2025.
Musker, S., Duchnowski, A., Millière, R., and Pavlick, E. Llms as models for analogical reasoning. arXiv preprint arXiv:2406.13803, 2024.
Juraska, J., Deutsch, D., Finkelstein, M., and Freitag, M. MetricX-24: The Google submission to the WMT 2024 metrics shared task. In Haddow, B., Kocmi, T., Koehn, P., and Monz, C. (eds.), Proceedings of the Ninth Conference on Machine Translation, pp. 492–504, Miami, Florida, USA, November 2024. Association for Computational Linguistics. URL https://aclanthology.org/ 2024.wmt-1.35.
Nida, E. A. Toward a science of translating: with special reference to principles and procedures involved in Bible translating. Brill Archive, 1964.
Kalajdzievski, D. A rank stabilization scaling factor for fine-tuning with lora. arXiv preprint arXiv:2312.03732, 2023.
Ordudari, M. Translation procedures, strategies and methods. Translation journal, 11(3):8, 2007.
Niklaus, J., Merane, J., Nenadic, L., Ahmadi, S., Gao, Y., Chevalley, C. A., Humbel, C., Gösken, C., Tanzi, L., Lüthi, T., et al. Swiltra-bench: The swiss legal translation benchmark. arXiv preprint arXiv:2503.01372, 2025.
Popović, M. chrf: character n-gram f-score for automatic mt evaluation. In Proceedings of the tenth workshop on statistical machine translation, pp. 392–395, 2015.
Kocmi, T. and Federmann, C. Gemba-mqm: Detecting translation quality error spans with gpt-4. arXiv preprint arXiv:2310.13988, 2023.
Rei, R., Stewart, C., Farinha, A. C., and Lavie, A. Comet: A neural framework for mt evaluation. arXiv preprint arXiv:2009.09025, 2020.
Koehn, P. and Knowles, R. Six challenges for neural machine translation. arXiv preprint arXiv:1706.03872, 2017. Kwon, W., Li, Z., Zhuang, S., Sheng, Y., Zheng, L., Yu, C. H., Gonzalez, J., Zhang, H., and Stoica, I. Efficient memory management for large language model serving with pagedattention. In Proceedings of the 29th Symposium on Operating Systems Principles, SOSP ’23, pp. 611–626, New York, NY, USA, 2023. Association for Computing Machinery. ISBN 9798400702297. doi: 10.1145/3600006.3613165. URL https://doi. org/10.1145/3600006.3613165. Liu, S., Lyu, C., Wu, M., Wang, L., Luo, W., Zhang, K., and Shang, Z. New trends for modern machine translation with large reasoning models. arXiv preprint arXiv:2503.10351, 2025.
Shao, Z., Wang, P., Zhu, Q., Xu, R., Song, J., Bi, X., Zhang, H., Zhang, M., Li, Y., Wu, Y., et al. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300, 2024. Taori, R., Gulrajani, I., Zhang, T., Dubois, Y., Li, X., Guestrin, C., Liang, P., and Hashimoto, T. B. Stanford alpaca: An instruction-following llama model. https://github.com/tatsu-lab/ stanford_alpaca, 2023. Tiersma, P. The nature of legal language. In Dimensions of forensic linguistics, pp. 7–25. John Benjamins Publishing Company, 2008.
Loshchilov, I. and Hutter, F. Sgdr: Stochastic gradient descent with warm restarts. In International Conference on Learning Representations, 2017a.
Wang, J., Meng, F., Liang, Y., and Zhou, J. Drt-o1: Optimized deep reasoning translation via long chain-ofthought. arXiv e-prints, pp. arXiv–2412, 2024. 10
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
Wang, J., Meng, F., and Zhou, J. Deep reasoning translation via reinforcement learning. arXiv preprint arXiv:2504.10187, 2025. Webb, T., Holyoak, K. J., and Lu, H. Emergent analogical reasoning in large language models. Nature Human Behaviour, 7(9):1526–1541, 2023. Wei, J., Tay, Y., Bommasani, R., Raffel, C., Zoph, B., Borgeaud, S., Yogatama, D., Bosma, M., Zhou, D., Metzler, D., et al. Emergent abilities of large language models. arXiv preprint arXiv:2206.07682, 2022. Wiesmann, E. Machine translation in the field of law: A study of the translation of italian legal texts into german. Comparative Legilinguistics, 37(1):117–153, 2019. Wu, D., Aycock, S., and Monz, C. Please translate again: Two simple experiments on whether humanlike reasoning helps translation. In Christodoulopoulos, C., Chakraborty, T., Rose, C., and Peng, V. (eds.), Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pp. 20424–20440, Suzhou, China, November 2025. Association for Computational Linguistics. ISBN 9798-89176-332-6. doi: 10.18653/v1/2025.emnlp-main. 1031. URL https://aclanthology.org/2025. emnlp-main.1031/. Xia, S., Li, X., Liu, Y., Wu, T., and Liu, P. Evaluating mathematical reasoning beyond accuracy. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pp. 27723–27730, 2025. Zhang, S., Liu, Q., Qin, G., Naumann, T., and Poon, H. Med-rlvr: Emerging medical reasoning from a 3b base model via reinforcement learning. arXiv preprint arXiv:2502.19655, 2025. Zhao, Y., Ji, T., Feng, W., Huang, Z., Liu, Q., Liu, Z., Ma, Y., Zhang, K., and Chen, E. Unveiling the magic of code reasoning through hypothesis decomposition and amendment. In The Thirteenth International Conference on Learning Representations, 2025. URL https:// openreview.net/forum?id=kN25ggeq1J.
11
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
A. Training Set Language Pair Distribution Statistics Table 4. Statistics of language pair distribution in the training set used for the experiments.
Language Pair
Count
fr → it de → fr de → it de → en fr → en it → en Total
8 152 5 384 4 252 65 65 63 18 981
B. Prompt ### Instruction Translate the following sentence from {lang_source} to {lang_target} while respecting Swiss legal parlance. Respond in the following format: <think> ... </think> <translation>...</translation> Explain your reasoning inside the <think> tag and give your final translation in the <translation> tag. ### Input {source}
12