CORAL: Adaptive Retrieval Loop for Culturally-Aligned Multilingual RAG Nayeon Lee♣ * † , Jiwoo Song⋄∗ , Byeongcheol Kang⋄∗ ♣
Naver, ⋄ Samsung Research
[email protected], {jiwoooo.song, bc1.kang}@samsung.com
arXiv:2604.25676v1 [cs.CL] 28 Apr 2026
Abstract Multilingual retrieval-augmented generation (mRAG) is often implemented within a fixed retrieval space, typically via query or document translation or multilingual embedding vector representations. However, this approach may be inadequate for culturally grounded queries, in which retrieval-condition misalignment may occur. Even strong retrievers and generators may struggle to produce culturally relevant answers when sourcing evidence from inappropriate linguistic or regional contexts. To this end, we introduce CORAL (COntext-aware Retrieval with Agentic Loop, an adaptive retrieval methodology for mRAG that enables iterative refinement of both the retrieval space (corpora) and the retrieval probe (query) based on the quality of the evidence. The overall process includes: (1) selecting corpora, (2) retrieving documents, (3) critiquing evidence for relevance and cultural alignment, and (4) checking sufficiency. If the retrieved documents are insufficient to answer the query correctly, the system (5) reselects corpora and rewrites the query. Across two cultural QA benchmarks, CORAL achieves up to a 3.58%p accuracy improvement on low-resource languages relative to the strongest baselines.
1
Introduction
Retrieval-augmented generation (RAG) improves factual grounding by incorporating external knowledge at inference time, without retraining the language model (Lewis et al., 2020; Ovadia et al., 2024). Multilingual RAG (mRAG) extends this paradigm to support linguistically diverse queries, commonly through query translation or multilingual dense retrieval in shared embedding spaces (Liu et al., 2025b; Zhang et al., 2023; Chirkova et al., 2024). These approaches improve linguistic coverage, but typically assume fixed retrieval conditions. * Equal contribution. †
Work done at Samsung Research.
Query
Q) 다음은 한국의 문화와 전통에 대한 문제이다. 명절이 되면 어디로 가는 사람들이 많은가?
(The following is a question about Korean culture and traditions. Where do many people go during the traditional holidays?) A: 해외
(abroad)
B: 대도시
C: 고향
D: 산골
(a major city) (hometown) (rural village)
1) Initial Corpus Selection
Corpus
en
ko
zh
bn …
Planner
5) Corpus Reselection & Query Rewrite
3) Document Validation
Critic
Retrieved Docs
… Relevance: 4, Usefulness: 2, Specificity: 2, Compatibility: 3
Total Sore: 9
4) Sufficiency Check
Enough ✅ Critique
2) Document Retrieval
Enough ❌
7.5
4
8
2.5
Filtered Docs Query + Docs
Generator Answer: C
… discusses Korean tourism, which is loosely related …
Figure 1: Overview of CORAL. At test time, CORAL performs feedback-driven retrieval control: (1) a planner selects culturally/linguistically relevant corpora, (2) retrieves top-K documents, (3) a critic scores and filters them, (4) checks evidence sufficiency, and if insufficient, (5) revises corpus selection and rewrites the retrieval query based on the critique before iterating and generating.
However, mRAG systems often struggle with culturally or regionally grounded queries, where factual correctness depends on local institutions, conventions, or culturally specific terminology. In such cases, systems retrieve evidence that is semantically relevant yet culturally misaligned, yielding answers that are formally correct but pragmatically inaccurate (Longpre et al., 2021; Li et al., 2024; Cruz Blandón et al., 2025). This failure mode is commonly driven by globally aggregated
corpora that underrepresent locale-specific knowledge (Park and Lee, 2025; Qi et al., 2025; Li et al., 2025a). As a result, errors often stem not from generation itself, but from retrieval that is misaligned with the cultural context of the query. Existing agentic mRAG methods primarily focus on how to search—e.g., iterative query reformulation or reasoning-driven retrieval—while operating under fixed retrieval conditions (Asai et al., 2024; Trivedi et al., 2023; Yao et al., 2023). As a result, query-only adaptation is often insufficient for culturally grounded queries, repeatedly sufacing culturally dominant but locale-mismatched evidence. We argue that effective multicultural mRAG requires retrieval-condition adaptation, where both retrieval scope and query formulation are dynamically revised based on feedback from retrieved evidence. To this end, we propose CORAL (COntextaware Retrieval with Agentic Loop), a multilingual and multicultural agentic RAG framework. CORAL iteratively adapts retrieval conditions at test time by (i) selecting query-conditioned corpora, (ii) rewriting retrieval queries via evidence critique, and (iii) explicitly checking evidence sufficiency before generation. This enables more reliable grounding for culturally specific questions. We evaluate CORAL on two culturally grounded multiple-choice QA benchmarks spanning high-, mid-, and low-resource languages, covering a total of 13 languages. CORAL consistently outperforms multilingual RAG baselines, achieving up to 3.58%p accuracy improvement on low-resource languages relative to the strongest baselines. These results demonstrate that feedback-guided adaptation of retrieval conditions is critical for reliably grounding culturally specific answers. Our contributions are threefold: • We identify retrieval condition misalignment as a primary failure mode of mRAG on culturally grounded queries, and reframe multilingual retrieval as feedback-driven retrieval control. • We propose CORAL, an agentic framework that jointly adapts retrieval corpora and performs planner-guided query rewriting, with an explicit evidence sufficiency check. • We demonstrate consistent gains on culturally grounded QA benchmarks, showing that
CORAL reliably identifies target cultures across diverse languages.
2
Background and Related Work
2.1
Multilingual and Cross-lingual RAG
Prior work on multilingual RAG mainly focuses on extending English-centric RAG pipelines to multiple languages through shared multilingual retrievers, translation-based methods, and cross-lingual benchmarks (Chirkova et al., 2024; Moon et al., 2025; Liu et al., 2025b). These approaches aim to improve linguistic coverage and robustness by preserving semantic equivalence across languages, typically operating over a fixed multilingual corpus that pools documents from all languages together. While effective for many general cross-lingual tasks, this paradigm treats multilinguality as a representation or preprocessing problem and leaves corpus selection implicit. As a result, retrieval is performed without explicit consideration of cultural or regional relevance, which can lead to semantically relevant but culturally mismatched evidence for queries grounded in local institutions or conventions (Qi et al., 2025; Ranaldi et al., 2026). 2.2
Iterative and Agentic Retrieval for RAG
Recent work has explored iterative and agent-based retrieval strategies to improve retrieval-augmented generation (Asai et al., 2024; Trivedi et al., 2023; Yao et al., 2023; Wang et al., 2024; Yuan et al., 2024; Li et al., 2025c; Liu et al., 2025a; Besrour et al., 2025). These approaches introduce multiple retrieval steps, planning mechanisms, or specialized agents such as planners, critics, or verifiers. Common techniques include query reformulation, multi-hop retrieval, and retrieval planning, where the system refines its queries based on intermediate results (Lee et al., 2024; Chen et al., 2025; Cong et al., 2025). The main goal of these methods is to improve retrieval quality by increasing coverage, recall, or reasoning depth. Iteration is typically used to retrieve more relevant documents, reduce noise, or better support complex reasoning tasks (Asai et al., 2024; Zhang et al., 2025a). In this setting, agentic components help decide how to search, such as which query to issue next or when to stop retrieving (Yao et al., 2023). Some approaches further enhance these decision-making processes through additional training, such as reinforcement learning or supervised fine-tuning, enabling the model to
learn when and how to retrieve more effectively (Asai et al., 2024; Huang et al., 2025; Yao et al., 2025). However, such approaches introduce additional training cost and may suffer from limited adaptability when the retrieval conditions themselves, such as the underlying corpus or language setting, are misaligned, as they do not explicitly reconsider or update the retrieval environment. Despite these improvements, existing approaches usually assume that the retrieval space itself is fixed. While queries may be refined over multiple steps, the underlying corpus or knowledge source remains unchanged (Jang et al., 2024; Cong et al., 2025). As a result, iteration focuses on improving document ranking or query formulation, rather than reconsidering whether retrieval is being performed over the most appropriate linguistic, regional, or cultural sources. In contrast, our work treats iteration as a mechanism for correcting retrieval condition misalignment. Instead of only refining queries, the system evaluates whether the current retrieval setting is suitable and updates corpus selection decisions when necessary.
2.3
Cultural Grounding and Context Sensitivity in RAG
Prior studies have shown that retrieval and question answering systems often fail on queries that depend on cultural or regional context, producing answers that are plausible but inappropriate for the user’s setting, particularly in low-resource languages and regions (Li et al., 2025b; Park and Lee, 2025; Lertvittayakumjorn et al., 2025). Most existing work addresses cultural grounding through dataset construction or output analysis, while leaving the retrieval process unchanged (Blodgett et al., 2020; Liu et al., 2025b; Thakur et al., 2025). While some approaches rely on query rewriting or translation (Chan et al., 2024; Wang et al., 2025), such strategies operate within a fixed retrieval space and cannot correct cultural misalignment when relevant evidence is absent or dominated by globally prevalent sources. As a result, cultural relevance is treated as a post-hoc generation issue rather than a retrieval-time decision, even though semantically relevant documents may lack the contextual grounding required for culturally specific queries (Amirshahi et al., 2025; Cruz Blandón et al., 2025).
3
Agentic Multicultural RAG
3.1
Overview
We propose CORAL, a test-time framework for culturally grounded mRAG. CORAL comprises two LLM-based agents: a planner that controls corpus selection and query reformulation, and a critic that evaluates retrieved documents and controls sufficiency. Together, they form a feedback loop that iteratively refines retrieval conditions based on evidence quality (Figure 1). Given an input query, CORAL executes a fivestep retrieval-control loop. (1) Query-conditioned corpus selection: the planner selects a small set of culturally and linguistically relevant corpora, rather than retrieving from a fixed pooled multilingual space. (2) Evidence retrieval: the retriever retrieves top-K documents from the selected corpora. (3) Critique-guided evidence validation: the critic scores each document along multiple dimensions (relevance, usefulness, clarity/specificity, and contextual compatibility) and filters lowquality evidence. (4) Sufficiency checking: the critic determines whether the retained evidence is sufficient to answer the query reliably. (5) Retrieval condition refinement: if evidence is insufficient or misaligned, the critique is fed back to the planner, which revises the retrieval conditions by re-selecting corpora and reformulating the retrieval query, and repeats the loop. 3.2
Planner: Retrieval Condition Selection and Query Reformulation
Given the query (and, in later rounds, feedback from the critic), the planner outputs (i) a set of target corpora and (ii) an optional rewritten retrieval query (from the second round). Corpus selection is explicitly query-conditioned: the planner mainly includes corpora matching the query language and may add additional corpora when the query contains cultural or regional cues (e.g., local institutions, conventions, or region-specific entities). This scoping reduces noise from unrelated corpora and increases the likelihood of retrieving culturally grounded evidence. When the critic indicates that retrieved evidence is insufficient or misaligned, the planner updates its decisions using the critique given. It may revise the corpus scope (e.g., expand to culturally adjacent corpora to recover missing local evidence, or narrow the scope to reduce irrelevant retrieval) or reformulate the query to address failures identified by
the critique. Note that query reformulation goes beyond translation: it can clarify implicit constraints, disambiguate context-dependent terms, and introduce missing local cues surfaced during critique. This iterative planning progressively corrects retrieval condition misalignment across rounds. 3.3
Critic: Evidence Validation and Sufficiency Control
Following LeVine and Varjavand (2025), which demonstrated that reranking documents beyond simple relevance can improve RAG systems, we introduce a multi-dimensional scoring scheme tailored to our framework. The critic model evaluates each retrieved document and outputs (i) scores on four criteria—relevance, usefulness, clarity/specificity, and contextual compatibility—and (ii) a concise textual critique. Documents that fall below a predefined quality threshold are discarded, while those that satisfy all criteria are retained and accumulated across iterations as validated evidence for generation. Detailed definitions of the four criteria are given in Appendix A, and the specifics of our scoring and filtering procedures are described in Section 4.3. After scoring, the critic determines whether the current validated evidence set is adequate to answer the query reliably. If key constraints are missing, evidence is contradictory, or alignment remains weak, the system triggers another iteration and passes the critique back to the planner. Otherwise, the loop terminates and the generator produces the final answer using only validated evidence. By coupling per-document validation with an explicit overall sufficiency decision, CORAL performs feedback-driven retrieval control entirely at test time, without fine-tuning and with minimal assumptions about the underlying retriever or generator.
4
Experiments
4.1
Datasets
To evaluate the effectiveness of our framework, we curate multilingual QA benchmarks that require culturally grounded knowledge and commonsense reasoning without paired evidence documents. BLEnD (Myung et al., 2024) evaluates everyday cultural knowledge for 16 countries, including under-represented regions and low-resource language communities (e.g., Assam, West Java). We use its multiple-choice (MCQ) subset, where
each question is written in English but is associated with a specific target country/culture and one of 13 source-language communities. Because the same underlying prompt can appear with multiple country-specific option sets, we sample one instance per underlying question to avoid overweighting duplicated prompts; full details are provided in Appendix B.1. CLIcK (Kim et al., 2024) consists of Korean MCQs gathered from official exams in addition to those generated through GPT-4 (OpenAI et al., 2024) based on official educational materials provided by the Korean Ministry of Justice. As our focus is on cultural QAs, we use the Culture category from CLIcK. This category includes 8 subcategories including Korean Tradition, Korean Society, and Korean Popular Culture, including 1,345 queries in total. A detailed statistics of the number of questions for each subcategory can be found in Appendix B.2. 4.2
Baselines
To evaluate CORAL, we compare against one nonretrieval baseline and four multilingual RAG configurations adapted from Ranaldi et al. (2026). These baselines vary the retrieval scope and translation strategy, allowing us to isolate the effects of corpus/language selection under a fixed generator. Non-RAG answers the question directly without external retrieval, relying solely on the generator’s internal knowledge. tRAG (translate-then-retrieve) translates the query into English and retrieves only from the English corpus. As the MCQ subset of BLEnD is already in English, we present only the results on CLIcK for this baseline methodology. monoRAG retrieves from the corpus that matches the query language. multiRAG retrieves from the entire existing multilingual corpus without any corpus restriction. crossRAG retrieves from the same corpus pool as multiRAG, but translates the retrieved documents into English prior to answer generation. For query and document translation in tRAG and crossRAG, we use Q WEN 3-235B-A22BI NSTRUCT-2507 (Qwen Team, 2025) (hereafter, Q WEN 3-235B). 4.3
Experimental Setup
Retrieval. For all RAG-based methods, we embed documents with Q WEN 3-E MBEDDING 8B (Zhang et al., 2025b) and retrieve the top-5
Method
BLEnD mid
low
high
all
CLIcK
su
avg
fa
avg
es
avg
avg
Non-RAG
58.04
55.65
62.09
63.06
68.59
69.29
62.13
48.10
monoRAG tRAG multiRAG crossRAG
57.69 61.89 62.59
56.80 56.48 57.83
65.03 67.97 67.32
65.47 65.92 66.83
68.44 67.98 68.29
71.31 69.84 69.76
63.93 63.49 64.27
53.53 56.06 50.78 53.75
CORAL (GPT- OSS -120 B) CORAL (Q WEN 3-235B)
68.18 66.78
60.47 61.83
70.92 72.22
69.10 70.41
74.36 71.93
73.51 72.76
67.14 67.84
58.66 58.88
Table 1: Accuracy on cultural QA benchmarks with L LAMA -3.2-3B-I NSTRUCT. For CORAL, we use GPTOSS -120 B or Q WEN 3-235B-A22B-I NSTRUCT as the planner/critic. Best results are in bold, and second best results are underlined. CORAL improves performance by enabling dynamic corpus selection and query rewriting compared to other RAG methods that use a fixed set of target corpora.
documents by cosine-similarity nearest-neighbor search using FAISS (Douze et al., 2025). Retrieval is performed over the target corpus scope specified by each method. In CORAL, the planner selects a queryconditioned set of target corpora. Then, we retrieve the top-5 documents from each selected corpus and pass them to the critic, which assigns integer scores in [0, 5] for four dimensions: relevance (srel ), usefulness (suse ), clarity/specificity (sspec ), and contextual compatibility (scomp ). A document is considered valid if (i) each score is at least 2 and (ii) the aggregated score stot is at least 6, where stot is calculated based on the following equation: stot = srel + 0.5 (suse + sspec + scomp )
(1)
Validated documents are accumulated across iterations of the feedback loop. After the loop terminates, we select the top-5 validated documents by stot and provide them to the generator as evidence, controlling context length while retaining the highest-quality support. Inference Settings. In principle, any language model can serve as the planner or the critique agent. However, for our experiments, we use the same model for both planner and critique agents in our experiments. We use Q WEN 3-235B (Qwen Team, 2025) and GPT- OSS -120 B (OpenAI, 2025) as our main planner/critic model, and L LAMA -3.2-3BI NSTRUCT (Grattafiori et al., 2024) as our main generator model. All prompts and specific configuration details are provided in Appendix C.1 and C.2.
Retrieval Corpus Selection. Due to limited computational resources, we limit our retrieval language corpus to languages that appear as source languages in the BLEnD MCQ set. This whole language set also covers the CLIcK dataset, which is constructed in Korean. BLEnD is created by collecting everyday-life questions from 16 countries in 13 languages, and the MCQ subset is based on the English versions of those questions. To ensure that every required source language is represented, we extract the Wikipedia dumps 1 for the same 13 languages and treat them as our overall corpus. This multilingual corpus is used for the multiRAG and crossRAG approaches as the overall target corpus. The language list is provided to the planner model for query-conditioned corpus selection.
5
Results and Analysis
5.1
Overall Performance on Cultural Benchmarks
Table 1 reports end-to-end accuracy on two culturally grounded QA benchmarks. For BLEnD, we evaluate the MCQ subset in which all questions are written in English while the underlying cultural target varies across countries (Appendix B.1). Following the language-resource taxonomy of Joshi et al. (2020), we group BLEnD source-language communities into three resource tiers based on the five-level ranking: low-resource (ranks 1–2), mid-resource (ranks 3–4), and high-resource (rank 5). We report both the tier-wise averages and representative languages from each tier (Sundanese 1
We use the Wikipedia dump as of October 20, 2025.
BLEnD
CLIcK
70 60
Score
50 40 30 20 10 0
Llama-3.2-3B-Instruct
Ministral-3-8B-Instruct-2512
Qwen3-1.7B
Llama-3.2-3B-Instruct
Ministral-3-8B-Instruct-2512
Qwen3-1.7B
Method non-rag
monoRAG
multiRAG
crossRAG
Ours
Figure 2: Accuracy across three language models on cultural QA benchmarks. Performance gaps between RAG baselines highlight the adverse impact of indiscriminate corpus expansion, whereas our method consistently outperforms the other baselines across diverse model families and parameter sizes.
(su) 2 , Persian (fa), and Spanish (es) for low-, mid, and high-resource, respectively), together with per-language results. Results for all 13 source languages in BLEnD can be found in Appendix D. Across both benchmarks, CORAL achieves the best accuracy across the two planner/critic backbones and for all resource tiers. This indicates that the gains are not tied to a specific agent model family or to a particular language group. To quantify improvements, we compare CORAL against the strongest non-CORAL baseline for each setting (i.e., the highest-scoring method among the baselines in the same column). On BLEnD, when using the Q WEN 3-235B planner/critic model, CORAL gains up to 3.58% accuracy on low-resource languages on average, especially improving the performance up to 5.59%p for su. On CLIcK, the maximum gain reaches 3.91%p. Compared with Self-RAG (Asai et al., 2024), another agentic RAG approach, our method achieves consistently better performance, with gains up to 12.14%p. Detailed comparison is provided in Table 13. Importantly, these improvements are not explained by just using more language corpora, or by a single retrieval heuristic. Baselines relying on a fixed retrieval scope (monoRAG/multiRAG), or with additional one-shot translation pipeline (tRAG/crossRAG) remain substantially behind, suggesting that indiscriminate corpus expansion or direct translation alone is insufficient for culturally grounded QA. In contrast, CORAL couples query-conditioned corpus scoping with critiqueguided query rewriting in a feedback loop. When 2
A language spoken in West Java, Indonesia.
the current evidence document set is incomplete or culturally misaligned, the planner revises both where to retrieve (the corpus scope) and what to retrieve (the retrieval query). For example, the planner reformulates the query to match the selected corpus language, or narrows down the focus in order to retrieve a better result. This joint, iterative adaptation improves evidence quality and provides consistent end-to-end improvement across cultural benchmarks. 5.2
Robustness Across Model Families and Size of the Generators
Figure 2 shows the accuracy scores for each of the methods from Table 1 across different generator models with varying model family and size. We report the average performance over all languages from BLEnD in this section. 3 Across diverse model architectures and sizes, CORAL consistently improves accuracy on the two benchmarks. This suggests that the observed improvements primarily originate from our feedback-driven agentic loop with minimal dependence on the generator’s ability. 5.3
Analysis on Dynamic Corpus Selection
Figure 3 visualizes the language compositions of (i) the planner-selected corpus set and (ii) the final top-K evidence after critique-guided scoring, for both datasets. A key observation is that the planner’s choices go beyond query-language de3 Figure 2 reports results for three representative generators; comprehensive evaluations across all 6 generators are provided in Appendix D.
BLEnD
Method BLEnD-su
BLEnD-fa
BLEnD-es
CLIcK
0.0
su
0.2
0.4 0.6 Ratio in top-k
0.8
Planner-selected
Top-k documents
id
zh
fa
ar
ko
es
en
1.0
other
Figure 3: Language distribution of documents selected for RAG. Hatched bars indicate the language proportions of documents selected by the planner for each benchmark, while solid bars represent the language distribution of documents actually used for RAG after critique-based scoring.
tection. This is most evident on BLEnD, where all queries are written in English. The planner selects the culture-associated languages and their regional high-resource neighbors, along with English. For instance, in BLEnD-su it frequently selects Sundanese (su) together with Indonesian (id), and in BLEnD-fa it additionally considers Arabic (ar). This indicates that it infers the likely cultural target from the query content and routes retrieval accordingly. The two language distributions from (i) and (ii) are broadly consistent but not identical, reflecting the role of critique-based filtering. After scoring, the retained top-K evidence shifts toward documents that actually contain useful evidence and away from weakly related documents. In lowresource settings, this can increase the share of a regional high-resource language when the targeted corpus is sparse (e.g., more id for BLEnD-su), while still maintaining culturally aligned sources. On CLIcK, the final evidence document set remains dominated by Korean (ko), with additional support from English (en) and nearby languages. Overall, Figure 3 suggests that our planner-critic loop proposes a culturally plausible candidate pool and then enforces evidence quality and cultural alignment through critique-guided filtering. Fixed-Scope Retrieval Ablation. Figure 3 shows that English often appears alongside cul-
CLIcK
low
mid
high
Non-RAG RAGCown RAGCall RAGCown ∪ Cen
55.65 51.89 56.55 56.06
63.06 60.77 65.92 65.94
69.29 67.43 69.84 71.22
48.10 53.53 50.78 54.20
CORAL
61.83
70.41
72.78
58.88
Table 2: Static corpus ablation on cultural QA benchmarks. We compare fixed retrieval scopes: Cown (the culture-associated corpus; for BLEnD we use the source language), Call (overall multilingual corpora), and Cown ∪ Cen (adding English). Fixed corpus scopes show inconsistent gains across benchmarks and resource groups, while CORAL (GPT- OSS -120 B planner/critic) remains consistently stronger.
turally aligned corpora, which motivates a natural baseline: can the planner-critique loop simply be replaced with a fixed retrieval scope that always includes English? Table 2 evaluates this hypothesis by comparing three fixed-scope variants: retrieving only from an oracle own-corpus (Cown ), retrieving from the union of all corpora (Call ), and retrieving from Cown ∪ Cen , where Cen denotes the English corpus. For CLIcK, Cown corresponds to Korean. For BLEnD, while the questions are written in English, Cown is defined as the source community/culture language associated with each evaluation split (e.g., su for BLEnD-su). We emphasize that this BLEnD definition is oracle: it presumes access to a target-culture label that is not provided at test time in realistic deployments. Table 2 shows that fixed-scope retrieval remains consistently below CORAL, even when granted oracle access to Cown . Adding English to Cown is not uniformly sufficient across BLEnD resource groups, and pooling all corpora (Call ) can saturate when culturally or content-wise mismatched documents are included.4 Moreover, on BLEnD, even the oracle-fixed Cown setting can underperform Non-RAG, consistent with the fact that culturally grounded QA often relies on proxy evidence and that sparse or weak retrieval can introduce misleading context. In contrast, CORAL consistently outperforms all fixed-scope variants, indicating that the gains are not explained by simply including English, but by query-conditioned scope 4
Figure 8 illustrates a representative failure mode of Call , where retrieval returns superficially related but not decisioncritical evidence. Additional qualitative examples are provided in Appendix D.2.1.
BLEnD
Method multiRAG
CLIcK
low
mid
high
56.55
65.92
69.84
50.78
58.11 60.47
70.06 69.10
72.76 73.51
57.25 58.66
59.64 61.83
69.70 70.41
71.64 72.78
57.40 58.88
w/ GPT- OSS -120 B Planner/Critic + Dynamic Corpus Selection + Query Rewriting (CORAL) w/ Q WEN 3-235B Planner/Critic + Dynamic Corpus Selection + Query Rewriting (CORAL)
Table 3: Ablation of dynamic corpus selection and query rewriting. Accuracy on five cultural QA benchmarks with a fixed generator. Starting from multiRAG (a fixed-pooled multilingual retrieval system with the original query), we add dynamic corpus selection and then query rewriting. Results are shown for two planner/critic backbones.
decisions coupled with feedback-driven filtering (and, as shown later, critique-guided query rewriting). 5.4
Dynamic Corpus Selection & Query Rewriting Ablation Study
Dynamic Corpus Selection Only. To quantify the contributions of the two key components of CORAL—dynamic corpus selection and critiqueguided query rewriting—we report the ablation results in Table 3. We use multiRAG as the baseline, which retrieves with the original query from a fixed pooled multilingual corpus, and then progressively add (i) dynamic corpus selection and (ii) query rewriting. The results show that adding dynamic corpus selection alone improves accuracy on all benchmarks for both planner/critic backbones. With Q WEN 3235B, dynamic selection yields gains of 5.78%p (BLEnD-mid) and 3.21%p (CLIcK) over MULTI RAG. These results support our claim that selecting culturally appropriate retrieval conditions substantially reduces noise from mismatched corpora and improves evidence alignment. Additional Query Rewriting. On top of dynamic corpus selection, enabling query rewriting further improves performance. With the GPT- OSS 120 B planner/critic, query rewriting achieves additional gains of 2.36%p on BLEnD-low and 2.21%p on CLIcK. To better understand the contribution of query rewriting, we analyze how the planner modifies the retrieval query during rewriting. We categorize each rewrite into one of three types: (i) Paraphrase, which reformulates the query into a more retrieval-friendly wording while preserving its intent; (ii) Narrow, which adds constraints or dis-
ambiguating details to focus retrieval; and (iii) Expand, which broadens the query to retrieve additional evidence when the current retrieval is judged insufficient. We randomly sample 100 questions from CLIcK and collect all rewritten retrieval queries produced across planner-critic iterations, resulting in 158 rewritten queries. After a norming session to align category definitions, two authors independently annotate all rewrites. The initial inter-annotator agreement is Cohen’s κ = 0.624. Remaining disagreements are then resolved through discussion, and final labels are determined by unanimous agreement. Overall, 53.8% of rewrites narrow the query, and 32.9% paraphrase it. 5 Qualitative analysis reveals that narrowing rewrites often introduce missing contextual cues, as highlighted by the critic, when the initially retrieved documents are topically related but insufficiently informative to answer the question. This leads to subsequent retrievals that are more directly aligned with the query’s informational needs. Taken together, these results suggest that query rewriting complements dynamic corpus selection by systematically improving retrieval quality through critique-guided refinement.
6
Conclusion
We introduce CORAL, a test-time agentic framework that closes the loop between retrieval outcomes and retrieval decisions. CORAL iteratively (i) selects culturally and linguistically appropriate corpora, (ii) retrieves candidate evidence, (iii) critiques documents for relevance and cultural align5 An example of query rewrite within a planner-critic loop is provided in Figure 9. Additional qualitative analysis on query rewriting can be found in Appendix D.2.2.
ment, and (iv) checks sufficiency to decide whether to stop or to refine retrieval conditions by reselecting corpora and rewriting the query. Across five culturally grounded QA benchmarks spanning high- and low-resource languages, CORAL consistently outperformed strong multilingual RAG baselines, with the largest improvements appearing in low-resource settings where indiscriminate corpus expansion tends to introduce noise or amplify generalized evidence. Our findings suggest that scaling multilingual coverage alone is insufficient for culturally grounded generation, and that robust multilingual RAG systems should treat corpus scope and query formulation as first-class, revisable decisions rather than fixed configuration choices. More broadly, the retrieval condition selection viewpoint provides a principled way to integrate cultural and regional constraints into retrieval-augmented generation, complementary to advances in multilingual representations and agentic reasoning.
Limitations While CORAL consistently improves performance and supports culturally grounded retrieval control, it has several limitations. First, some benchmark questions may require knowledge that is sparse or entirely absent from Wikipedia-based corpora. In such cases, retrieval failures are unavoidable regardless of the control strategy. More broadly, culturally relevant information is often procedural, experiential, or locally disseminated (e.g., informal norms or recent policy details), and may be underrepresented in encyclopedic resources. Moreover, our corpora are restricted to languagespecific Wikipedia subsets. This choice improves reproducibility, but it limits domain diversity and may bias retrieval toward perspectives that are well covered in the selected languages. Extending the corpus collection and retrieval framework to heterogeneous web-scale sources (e.g., official portals, local news, and community resources) would better reflect real-world cultural information needs. Our evaluation focuses on multiple-choice question answering to enable controlled comparisons in the study of dynamic corpus selection and query rewriting. This setting may not capture additional failure modes that arise in open-ended or interactive scenarios, such as partially correct responses, culturally inappropriate framing, or user-dependent ambiguity. Evaluating CORAL in open-ended gen-
eration and multi-turn information-seeking settings is an important direction for future work.
Ethical Considerations Our approach operates during the test phase by using retrieved documents and does not require collecting user-level data or fine-tuning models. However, when deployed in real-world retrieval contexts, systems may inadvertently access or disclose personal or sensitive information contained in documents. It is imperative that deployments comply with applicable privacy regulations, implement access controls, refrain from retrieving private data without proper authorization, and accommodate data deletion requests when appropriate. We acknowledge that agentic retrieval incurs additional inference costs due to the requirements of iterative planning and critique. While we restrict the number of iterations and permit early termination when sufficient evidence is available, practitioners should carefully weigh the efficiency tradeoffs and carbon footprint associated with these processes. Future research should investigate the potential for lightweight critics, caching mechanisms, and cost-aware stopping policies to mitigate computational overhead.
References Shakiba Amirshahi, Amin Bigdeli, Charles L. A. Clarke, and Amira Ghenai. 2025. Evaluating the robustness of retrieval-augmented generation to adversarial evidence in the health domain. Preprint, arXiv:2509.03787. Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2024. Self-RAG: Learning to retrieve, generate, and critique through self-reflection. In The Twelfth International Conference on Learning Representations. Ines Besrour, Jingbo He, Tobias Schreieder, and Michael Färber. 2025. Ragenta: Multi-agent retrieval-augmented generation for attributed question answering. In Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), volume abs/2506.16988. Su Lin Blodgett, Solon Barocas, Hal Daumé III, and Hanna Wallach. 2020. Language (technology) is power: A critical survey of “bias” in NLP. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5454– 5476, Online. Association for Computational Linguistics.
Chi-Min Chan, Chunpu Xu, Ruibin Yuan, Hongyin Luo, Wei Xue, Yike Guo, and Jie Fu. 2024. RQ-RAG: Learning to refine queries for retrieval augmented generation. In First Conference on Language Modeling.
North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 8121–8138, Mexico City, Mexico. Association for Computational Linguistics.
Yiqun Chen, Erhan Zhang, Lingyong Yan, Shuaiqiang Wang, Jizhou Huang, Dawei Yin, and Jiaxin Mao. 2025. Mao-arag: Multi-agent orchestration for adaptive retrieval-augmented generation. Preprint, arXiv:2508.01005.
Pratik Joshi, Sebastin Santy, Amar Budhiraja, Kalika Bali, and Monojit Choudhury. 2020. The state and fate of linguistic diversity and inclusion in the NLP world. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6282–6293, Online. Association for Computational Linguistics.
Nadezhda Chirkova, David Rau, Hervé Déjean, Thibault Formal, Stéphane Clinchant, and Vassilina Nikoulina. 2024. Retrieval-augmented generation in multilingual settings. In Proceedings of the 1st Workshop on Towards Knowledgeable Language Models (KnowLLM 2024), pages 177–188, Bangkok, Thailand. Association for Computational Linguistics. Youan Cong, Pritom Saha Akash, Cheng Wang, and Kevin Chen-Chuan Chang. 2025. Query optimization for parametric knowledge refinement in retrievalaugmented large language models. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 3615–3625, Suzhou, China. Association for Computational Linguistics. María Andrea Cruz Blandón, Jayasimha Talur, Bruno Charron, Dong Liu, Saab Mansour, and Marcello Federico. 2025. MEMERAG: A multilingual end-to-end meta-evaluation benchmark for retrieval augmented generation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 22577–22595, Vienna, Austria. Association for Computational Linguistics. Matthijs Douze, Alexandr Guzhva, Chengqi Deng, Jeff Johnson, Gergely Szilvasy, Pierre-Emmanuel Mazaré, Maria Lomeli, Lucas Hosseini, and Hervé Jégou. 2025. The faiss library. Preprint, arXiv:2401.08281. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad AlDahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, and 542 others. 2024. The llama 3 herd of models. Preprint, arXiv:2407.21783. Yuqing Huang, Rongyang Zhang, Qimeng Wang, Chengqiang Lu, Yan Gao, Yiwu, Yao Hu, Xuyang Zhi, Guiquan Liu, Xin Li, Hao Wang, and Enhong Chen. 2025. SelfAug: Mitigating catastrophic forgetting in retrieval-augmented generation via distribution self-alignment. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 14175–14190, Suzhou, China. Association for Computational Linguistics. Yunah Jang, Kang-il Lee, Hyunkyung Bae, Hwanhee Lee, and Kyomin Jung. 2024. IterCQR: Iterative conversational query reformulation with retrieval guidance. In Proceedings of the 2024 Conference of the
Eunsu Kim, Juyoung Suk, Philhoon Oh, Haneul Yoo, James Thorne, and Alice Oh. 2024. CLIcK: A benchmark dataset of cultural and linguistic intelligence in Korean. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LRECCOLING 2024), pages 3335–3346, Torino, Italia. ELRA and ICCL. Myeonghwa Lee, Seonho An, and Min-Soo Kim. 2024. PlanRAG: A plan-then-retrieval augmented generation for generative large language models as decision makers. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6537–6555, Mexico City, Mexico. Association for Computational Linguistics. Piyawat Lertvittayakumjorn, David Kinney, Vinodkumar Prabhakaran, Donald Martin Jr., and Sunipa Dev. 2025. Towards geo-culturally grounded LLM generations. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 313–330, Vienna, Austria. Association for Computational Linguistics. Will LeVine and Bijan Varjavand. 2025. Relevance isn’t all you need: Scaling RAG systems with inferencetime compute via multi-criteria reranking. In First Workshop on Scalable Optimization for Efficient and Adaptive Foundation Models. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020. Retrieval-augmented generation for knowledgeintensive nlp tasks. In Proceedings of the 34th International Conference on Neural Information Processing Systems, NIPS ’20, Red Hook, NY, USA. Curran Associates Inc. Bo Li, Zhenghua Xu, and Rui Xie. 2025a. Language drift in multilingual retrieval-augmented generation: Characterization and decoding-time mitigation. Preprint, arXiv:2511.09984. Bryan Li, Samar Haider, Fiona Luo, Adwait Agashe, and Chris Callison-Burch. 2024. BordIRlines: A
dataset for evaluating cross-lingual retrieval augmented generation. In Proceedings of the First Workshop on Advancing Natural Language Processing for Wikipedia, pages 1–13, Miami, Florida, USA. Association for Computational Linguistics. Bryan Li, Fiona Luo, Samar Haider, Adwait Agashe, Siyu Li, Runqi Liu, Miranda Muqing Miao, Shriya Ramakrishnan, Yuan Yuan, and Chris Callison-Burch. 2025b. Multilingual retrieval augmented generation for culturally-sensitive tasks: A benchmark for crosslingual robustness. In Findings of the Association for Computational Linguistics: ACL 2025, pages 4215–4241, Vienna, Austria. Association for Computational Linguistics. Yuankai Li, Jia-Chen Gu, Di Wu, Kai-Wei Chang, and Nanyun Peng. 2025c. BRIEF: Bridging retrieval and inference for multi-hop reasoning via compression. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 5449–5470, Albuquerque, New Mexico. Association for Computational Linguistics. Pei Liu, Xin Liu, Ruoyu Yao, Junming Liu, Siyuan Meng, Ding Wang, and Jun Ma. 2025a. Hm-rag: Hierarchical multi-agent multimodal retrieval augmented generation. Preprint, arXiv:2504.12330. Wei Liu, Sony Trenous, Leonardo F. R. Ribeiro, Bill Byrne, and Felix Hieber. 2025b. XRAG: Crosslingual retrieval-augmented generation. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 15669–15690, Suzhou, China. Association for Computational Linguistics. Shayne Longpre, Yi Lu, and Joachim Daiber. 2021. MKQA: A linguistically diverse benchmark for multilingual open domain question answering. Transactions of the Association for Computational Linguistics, 9:1389–1406. Hoyeon Moon, Byeolhee Kim, and Nikhil Verma. 2025. Quality-aware translation tagging in multilingual RAG system. In Proceedings of the 5th Workshop on Multilingual Representation Learning (MRL 2025), pages 161–177, Suzhuo, China. Association for Computational Linguistics. Junho Myung, Nayeon Lee, Yi Zhou, Jiho Jin, Rifki Afina Putri, Dimosthenis Antypas, Hsuvas Borkakoty, Eunsu Kim, Carla Perez-Almendros, Abinew Ali Ayele, Víctor Gutiérrez-Basulto, Yazmín Ibáñez García, Hwaran Lee, Shamsuddeen Hassan Muhammad, Kiwoong Park, Anar Sabuhi Rzayev, Nina White, Seid Muhie Yimam, Mohammad Taher Pilehvar, and 3 others. 2024. Blend: A benchmark for llms on everyday knowledge in diverse cultures and languages. In Advances in Neural Information Processing Systems, volume 37, pages 78104–78146. Curran Associates, Inc. OpenAI. 2025. gpt-oss-120b & gpt-oss-20b model card. Preprint, arXiv:2508.10925.
OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, and 262 others. 2024. Gpt-4 technical report. Preprint, arXiv:2303.08774. Oded Ovadia, Menachem Brief, Moshik Mishaeli, and Oren Elisha. 2024. Fine-tuning or retrieval? comparing knowledge injection in LLMs. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 237–250, Miami, Florida, USA. Association for Computational Linguistics. Jeonghyun Park and Hwanhee Lee. 2025. Investigating language preference of multilingual RAG systems. In Findings of the Association for Computational Linguistics: ACL 2025, pages 5647–5675, Vienna, Austria. Association for Computational Linguistics. Jirui Qi, Raquel Fernández, and Arianna Bisazza. 2025. On the consistency of multilingual context utilization in retrieval-augmented generation. In Proceedings of the 5th Workshop on Multilingual Representation Learning (MRL 2025), pages 199–225, Suzhuo, China. Association for Computational Linguistics. Qwen Team. 2025. Qwen3 technical report. Preprint, arXiv:2505.09388. Leonardo Ranaldi, Barry Haddow, and Alexandra Birch. 2026. Multilingual retrieval-augmented generation for knowledge-intensive question answering task. In Findings of the Association for Computational Linguistics: EACL 2026, pages 697–716, Rabat, Morocco. Association for Computational Linguistics. Nandan Thakur, Suleman Kazi, Ge Luo, Jimmy Lin, and Amin Ahmad. 2025. MIRAGE-bench: Automatic multilingual benchmark arena for retrievalaugmented generation systems. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 274–298, Albuquerque, New Mexico. Association for Computational Linguistics. Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2023. Interleaving retrieval with chain-of-thought reasoning for knowledgeintensive multi-step questions. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10014–10037, Toronto, Canada. Association for Computational Linguistics. Yujing Wang, Hainan Zhang, Liang Pang, Binghui Guo, Hongwei Zheng, and Zhiming Zheng. 2025. Maferw: query rewriting with multi-aspect feedbacks for retrieval-augmented large language models. In Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence and Thirty-Seventh Conference on
Innovative Applications of Artificial Intelligence and Fifteenth Symposium on Educational Advances in Artificial Intelligence, AAAI’25/IAAI’25/EAAI’25. AAAI Press. Zihao Wang, Anji Liu, Haowei Lin, Jiaqi Li, Xiaojian Ma, and Yitao Liang. 2024. RAT: Retrieval augmented thoughts elicit context-aware reasoning and verification in long-horizon generation. In NeurIPS 2024 Workshop on Open-World Agents. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023. React: Synergizing reasoning and acting in language models. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. Zijun Yao, Weijian Qi, Liangming Pan, Shulin Cao, Linmei Hu, Liu Weichuan, Lei Hou, and Juanzi Li. 2025. SeaKR: Self-aware knowledge retrieval for adaptive retrieval augmented generation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 27022–27043, Vienna, Austria. Association for Computational Linguistics. Ye Yuan, Chengwu Liu, Jingyang Yuan, Gongbo Sun, Siqi Li, and Ming Zhang. 2024. A hybrid rag system with comprehensive enhancement on complex reasoning. Preprint, arXiv:2408.05141. Jinghan Zhang, Xiting Wang, Weijieying Ren, Lu Jiang, Dongjie Wang, and Kunpeng Liu. 2025a. Ratt: A thought structure for coherent and correct llm reasoning. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 26733–26741.
Usefulness. Usefulness measures how much a document helps the system construct a correct, complete, and actionable answer. Higher scores indicate that the document contributes substantial, high-impact information needed for solving the query, whereas lower scores indicate little to no helpful content for answering. Clarity and Specificity. Clarity and Specificity measures how clearly, precisely, and unambiguously a document presents information that is relevant to the query. Higher scores correspond to well-structured, specific, and easy-to-interpret statements, while lower scores correspond to content that is vague, overly general, or difficult to apply. Compatibility. Compatibility measures linguistic, cultural, and domain alignment between the query and the document. Higher scores indicate strong language match or faithful cross-lingual equivalence, along with contextual appropriateness for the query’s cultural and domain assumptions. Lower scores indicate mismatched language, cultural context, or domain framing that makes the evidence less applicable.
B
Detailed Description of the Datasets
B.1
BLEnD
Yanzhao Zhang, Mingxin Li, Dingkun Long, Xin Zhang, Huan Lin, Baosong Yang, Pengjun Xie, An Yang, Dayiheng Liu, Junyang Lin, Fei Huang, and Jingren Zhou. 2025b. Qwen3 embedding: Advancing text embedding and reranking through foundation models. Preprint, arXiv:2506.05176.
In this paper, we use a subset of the multiple-choice-question (MCQ) data provided by BLEnD. The MCQ portion of BLEnD contains every possible option combination for each question across all countries, which leads to varying numbers of items for the same underlying question. Because we aim for a fair comparison and have limited resources, we randomly select a single version of each question (i.e., one country-specific option set per question). Table 4 summarizes the statistics of the selected MCQs.
Appendix
B.2
A
In order to focus on cultural queries, we only use the Culture category from CLIcK. Table 5 shows the statistics of the number of MCQs within each of the subcategories.
Xinyu Zhang, Nandan Thakur, Odunayo Ogundepo, Ehsan Kamalloo, David Alfonso-Hermelo, Xiaoguang Li, Qun Liu, Mehdi Rezagholizadeh, and Jimmy Lin. 2023. MIRACL: A multilingual retrieval dataset covering 18 diverse languages. Transactions of the Association for Computational Linguistics, 11:1114–1131.
Critic Scoring Criteria Definitions
For each criterion, the critic assigns an integer score from 0 to 5. We define each criterion as follows. Relevance. Relevance measures how strongly a document aligns with the key concepts, entities, and intent of the query. Higher scores indicate close conceptual alignment and direct topical relevance, while lower scores reflect only weak or incidental connections to the query.
CLIcK
C
Detailed Experimental Settings
C.1
Prompts
C.1.1
Multiple Choice Question Generator Prompt
Source Lang. English (en) Spanish (es) Korean (ko) Indonesian (id) Chinese (zh) Arabic (ar) Greek (el) Persian (fa) Azerbaijani (az) Sundanese (su) Assamese (as) Hausa (ha) Amharic (am)
Country United States United Kingdom Spain Mexico South Korea North Korea Indonesia China Algeria Greece Iran Azerbaijan West Java Assam Northern Nigeria Ethiopia
Total
# of MCQs
Category
# of MCQs
310 304 325 334 366 290 334 335 304 320 306 325 286 358 249 335
Society Tradition History Law Politics Economy Geography Pop culture
309 222 280 219 84 59 131 41
Total
1,345
5,081
Table 4: Number of MCQs per country and source language. For countries that share the same source language(en, es, ko), the MCQs are combined and reported as a single aggregated result elsewhere in the paper.
Answer the following multiple choice question as clearly as possible, using the provided **Reference Evidence**. The last line of your response should be in the following format: ‘Answer: A/B/C/D/E’ (e.g. ‘Answer: A’). # Reference Evidence {Docs} # Question {Query}
C.1.2
Short Answer Question Generator Prompt
Answer the following short answer question as clearly as possible, using the provided **Reference Evidence**. The last line of your response should be in the following format: ‘Answer: [YOUR ANSWER HERE]’ (e.g. ‘Answer: cat’).
Table 5: Number of MCQs from CLIcK within the Culture Category.
C.1.3
Planner Prompt
Figures 4 and 5 present the prompts used for the planner. Figure 4 is used to perform corpus selection upon receiving the initial user query. Figure 5 is used when the critique module determines that the retrieved documents are insufficient: the planner performs corpus selection and query reformulation for the next retrieval step. C.1.4
Critique Prompt
Figure 6 and 7 present the prompts used for the critique. Figure 6 is used to evaluate the retrieved documents against predefined criteria. Figure 7 is used to determine whether the retrieval evidence is insufficient; based on this decision, the retrieval process is set to proceed iteratively. C.2
Model Configurations
For planner and critique models, we set the temperature as 0.6, with reasoning effort ‘high’ for the GPT- OSS models and enable thinking for the hybrid Q WEN models. For the generator models, we set the temperature as 0 and top_p as 1, with reasoning effort ‘low’ for the GPT- OSS models and disable thinking for the hybrid Q WEN models. We set the max token of each of the planner/critic models to 32768, with dynamic adaptation of the max token value if needed. We set the max token of the generator models to 4096.
# Reference Evidence {Docs}
D
Detailed Results
D.1
Experimental Results in Detail
# Question {Query}
We evaluate all configurations using 13 open and instruction-tuned LLMs, ranging from small to large language models: Qwen3-{1.7B,
8B} (Qwen Team, 2025), LLaMA-3.2-{1B, 3B}Instruct (Grattafiori et al., 2024), Ministral-3-{8B, 14B}-Instruct-2512 6 . This diverse model suite enables robust comparison across a wide range of capacity and instruction tuning settings. As shown in Table 6-12, our method yields consistently strong and robust performance across a wide range of languages, covering diverse model sizes and model families. We also compare CORAL with Self-RAG (Asai et al., 2024) in Table 13 to evaluate another agentic RAG method on BLEnD. We do not include CLIcK for comparison, as the input query required by CLIcK exceeds Self-RAG’s maximum token limit. The results show that CORAL outperforms SelfRAG by a significant margin of up to 12.14%p. D.2 Planner Critique Examples for Document Selection and Query Rewriting D.2.1
Noise Comparison between Global and Locale-Specific Corpora
We present a qualitative comparison illustrating the difference in evidence quality when retrieval is performed over a global corpus versus a localespecific corpus. Shown in Figure 8, the given query concerns a culturally grounded practice in Korea, specifically the ritual behavior performed during ancestral rites (jesa), where participants bow twice to honor their ancestors. Comparing the documents retrieved by the Call and CORAL reveals a clear qualitative difference in evidence relevance. Retrieval over the unified corpus yields mostly superficial or tangential information: some documents mention jesa only at a high level without describing the ritual procedure, while others are entirely unrelated despite sharing cultural keywords, covering topics such as first-birthday celebrations (doljanchi), Confucianism in general, or Chuseok rituals. In contrast, our agent successfully identifies a Koreanlanguage document that explicitly explains the procedural steps of jesa, including the correct bowing practice. This example illustrates how indiscriminate corpus expansion introduces substantial noise for culturally specific queries, whereas our method effectively routes retrieval toward linguistically and culturally aligned sources, enabling the model to access precise procedural knowledge that is essential for answering the question correctly. 6
https://huggingface.co/collections/mistralai/ministral-3
D.2.2
Query Rewriting for Improved Evidence Relevance We further provide a qualitative example illustrating how the planner-guided process improves evidence relevance across retrieval trials. The critic evaluates the initially retrieved documents—identifying those that are semantically related but lack sufficient grounding in the target context—while the planner utilizes these insights to rewrite the query, incorporating the missing contextual signals. Full details are shown in Figure 9. D.3
Efficiency and Token Cost Analysis
We analyze the computational overhead of CORAL in terms of iteration count and token usage. Although CORAL employs an iterative planner–critic loop, the number of iterations is bounded and further reduced by a sufficiency-based early stopping mechanism. Empirically, CORAL converges in a small number of iterations. The average number of planner– critic iterations is 1.34 on BLEnD and 1.52 on CLIcK. Moreover, the final retrieval evidence is typically selected early in the process, at 1.56 and 1.82 iterations on average for BLEnD and CLIcK, respectively. In terms of token consumption, the average agent-side token usage per instance is 1,807 tokens on BLEnD and 21,548 tokens on CLIcK. These results provide a quantitative characterization of the computational overhead of CORAL, alongside the iteration statistics reported above.
E
Use Of AI Assistants
The authors used AI assistants for the language of the paper and codes for the experiments.
Llama-3.2
Method Non-RAG monoRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
Ministral-3
Qwen-3
1B
3B
8B
14B
1.7B
8B
53.00 56.83 57.24 58.89 61.08 60.12
62.13 63.93 63.52 63.83 67.14 67.84
60.54 61.77 61.56 61.79 66.18 64.09
64.84 64.43 64.33 64.44 68.20 66.22
55.99 59.45 59.75 60.06 64.56 64.40
66.10 64.16 65.43 65.55 68.42 68.59
Table 6: Average Accuracy on BLEnD with various generators.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
39.40 46.27 – 45.67 43.88 46.27 47.16
49.01 60.20 – 57.89 61.84 60.86 60.20
45.25 52.23 – 51.96 53.35 49.72 48.88
52.92 55.38 – 57.54 56.92 55.08 56.00
60.00 59.06 – 59.06 62.50 62.50 62.50
71.17 66.78 – 67.26 66.94 73.94 69.22
60.55 63.28 – 62.67 63.88 68.89 65.40
53.92 59.80 – 59.48 60.46 68.95 66.67
48.59 47.39 – 50.20 48.59 49.80 49.80
52.10 57.49 – 61.08 62.28 66.17 68.26
52.59 56.40 – 57.16 58.38 61.13 62.65
47.90 52.45 – 53.85 56.99 61.19 57.69
55.52 62.09 – 60.30 69.55 69.55 67.16
34.05 52.12 52.12 41.56 44.16 48.25 47.29
Table 7: Accuracy on cultural QA benchmarks with Llama-3.2-1B for a generator.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
46.87 53.73 – 52.54 51.64 53.73 55.82
59.54 67.76 – 63.82 63.82 64.47 66.78
58.66 56.15 – 55.31 56.15 56.70 60.34
63.69 65.85 – 62.46 67.38 69.54 68.00
64.69 68.44 – 66.56 68.75 68.75 69.69
79.48 77.69 – 77.69 77.36 79.97 78.66
68.59 68.44 – 67.98 68.29 74.36 71.93
62.09 65.03 – 67.97 67.32 70.92 72.22
51.00 50.60 – 50.20 51.41 54.22 58.23
66.77 64.07 – 65.57 66.77 67.66 70.96
58.69 64.33 – 63.57 64.48 69.05 68.75
58.04 57.69 – 62.24 62.59 68.18 66.78
69.55 71.34 – 69.85 0.00 75.22 73.73
48.10 56.06 56.06 50.78 53.75 58.66 58.88
Table 8: Accuracy on cultural QA benchmarks with Llama-3.2-3B for a generator.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
50.45 48.06 – 49.85 48.66 55.82 57.01
58.22 66.12 – 61.51 64.14 69.74 67.76
50.00 53.63 – 51.68 51.68 55.31 51.96
60.92 64.31 – 65.23 61.85 66.77 62.46
61.88 66.25 – 64.38 64.38 66.88 65.31
77.85 74.76 – 75.41 76.06 78.66 76.22
68.44 62.37 – 66.62 67.07 72.84 68.59
62.09 67.97 – 68.30 66.34 72.88 66.01
49.80 47.79 – 44.58 45.78 51.41 46.59
65.87 63.17 – 66.17 65.87 69.16 70.96
59.91 63.57 – 63.72 62.96 66.01 67.07
54.20 56.99 – 56.29 60.14 63.29 60.14
67.46 68.06 – 66.57 68.36 71.64 73.13
60.37 61.41 61.41 68.40 66.32 72.42 71.75
Table 9: Accuracy on cultural QA benchmarks with Ministral-3-8B-Instruct-2512 for a generator.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
53.13 54.33 – 52.84 54.63 54.33 53.13
61.84 62.83 – 66.12 66.12 70.07 69.08
57.82 56.98 – 53.63 55.31 57.82 58.66
67.08 67.38 – 70.15 70.15 72.31 68.62
64.69 67.81 – 67.19 69.38 68.13 68.44
81.92 78.01 – 77.52 78.50 80.46 78.18
68.44 67.37 – 68.89 68.13 72.08 70.41
66.01 67.97 – 67.32 69.61 72.55 71.24
56.63 51.81 – 52.21 46.18 53.82 51.41
64.97 68.26 – 67.96 66.77 68.86 68.56
63.57 65.70 – 66.46 64.18 69.05 67.84
60.14 58.39 – 59.44 62.24 70.98 61.54
76.72 70.75 – 66.57 66.57 76.12 73.73
64.31 63.20 63.20 70.86 68.03 75.84 73.09
Table 10: Accuracy on cultural QA benchmarks with Ministral-3-8B-Instruct-2512 for a generator.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
45.67 51.34 – 50.75 48.36 49.55 51.64
53.62 61.51 – 61.51 58.88 64.14 64.14
50.84 48.88 – 53.35 50.00 59.78 54.75
54.77 58.77 – 57.23 60.92 64.62 61.23
58.13 63.44 – 60.00 63.13 65.31 64.69
74.10 68.89 – 68.73 70.03 74.76 76.22
59.64 64.04 – 64.34 63.43 67.37 67.37
52.29 60.78 – 61.44 64.71 66.67 65.69
47.39 50.60 – 47.79 49.40 53.01 59.44
58.38 63.17 – 64.37 68.56 66.17 68.56
52.90 60.67 – 61.28 60.37 67.38 66.31
52.10 55.94 – 59.09 59.09 68.53 63.99
68.06 64.78 – 66.87 63.88 71.94 73.13
50.26 58.88 58.88 57.03 57.32 62.08 61.86
Table 11: Accuracy on cultural QA benchmarks with Qwen3-1.7B for a generator.
BLEnD
Method Non-RAG monoRAG tRAG multiRAG crossRAG CORAL (GPT-OSS-120B) CORAL (Qwen3-235B)
CLIcK
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
55.82 55.22 – 55.52 55.52 55.22 56.72
63.82 65.46 – 66.45 66.12 70.39 72.04
59.50 53.91 – 54.19 56.70 60.89 58.38
67.69 66.46 – 67.08 65.54 67.69 70.15
65.63 67.81 – 69.38 66.56 70.00 68.44
82.41 77.69 – 75.73 78.18 79.97 80.94
71.02 67.98 – 71.02 69.35 72.53 71.02
66.99 67.97 – 70.59 71.24 71.90 74.51
53.01 51.41 – 52.21 53.01 51.81 53.01
67.07 65.57 – 69.16 68.86 72.16 71.56
65.85 64.02 – 63.72 64.18 69.97 69.36
62.59 58.39 – 63.29 64.34 71.68 68.53
77.91 72.24 – 72.24 72.54 75.22 77.01
58.96 62.68 62.68 70.11 69.07 73.90 72.94
Table 12: Accuracy on cultural QA benchmarks with Qwen3-8B for a generator.
Method Self-RAG (Asai et al., 2024) CORAL (Qwen3-235B) CORAL (Qwen3-235B)
BLEnD
Model Llama-2-7B† Llama-2-7B-chat Llama-3.2-3B
am
ar
as
az
el
en
es
fa
ha
id
ko
su
zh
44.61 46.87 55.22
51.64 60.86 66.45
45.81 43.58 60.03
54.15 60.92 68.31
55.94 58.13 69.69
67.05 72.31 79.32
54.02 66.16 71.32
54.58 65.03 72.55
44.98 53.01 58.23
58.38 67.07 71.26
54.57 56.71 68.60
57.69 60.49 64.69
52.99 59.10 74.04
Table 13: Comparison of agentic approaches on BLEnD. For all methods, the maximum token budget was set to 1024. To comply with the model’s context length, the number of retrieved documents (top-k) was limited to 1. † indicates that the model was trained by the authors separately. Queries exceeding the model’s context length were excluded from evaluation.
SYSTEM PROMPT: You are a helpful AI Assistant with expertise in cultural and linguistic content classification, acting as the **search orchestrator** of a multi-corpus Retrieval-Augmented Generation (RAG) system. [Your Task] Given an input query (which may include a passage, a question, and optionally, multiple-choice options), you must **Select language corpora** to search. [Corpus selection rules] 1. Always include the corpus whose language code matches the primary language of the query. 2. If some corpora are **content-wise** relevant (country, region, culture, institution, person, etc.), you may additionally select them. - The query explicitly contains terms in another language or the user’s intent clearly benefits from cross-language retrieval (e.g., looking for translations, comparative cultural information). - Example: A topic about Japan → select "ja". 3. Do not select corpora that are almost unrelated to the query. 4. **Never** add a corpus "just in case". Choose only a small, realistically useful set. 5. Use only language codes that appear in the following langauge pools. **Never invent new names**. Language Pools: ["id", "am", "su", "ar", "ha", "en", "zh", "ko", "as", "el", "fa", "es", "az"] [Output format] Return **exactly** the following JSON object **as a single continuous line with no surrounding whitespace, line breaks, or markdown formatting**: {"language_names": ["<lang_code>", ... ]} • language_names must be a list of **valid** language codes from the pool, containing **at most three** entries and **always** including the primary language of the query. USER PROMPT: [USER QUERY] {USER_QUERY} Figure 4: Planner Prompt template.
SYSTEM PROMPT: You are a helpful AI Assistant with expertise in cultural and linguistic content classification, acting as the "second-stage search orchestrator" of a multi-corpus Retrieval-Augmented Generation (RAG) system. [Your Task] You are given: - the original input query (which may include a passage, a question, and optionally, multiple-choice options), - the previously used rewritten query for retrieval, - the previously chosen language codes for retrieval, - the system’s reasoning explaining why the former retrieval attempt was not sufficient. Your job is to: 1. **Select language corpora** for the next retrieval round. 2. **Rewrite the query** to improve retrieval quality, grounded in the system’s reasoning. You MUST NOT simply repeat the previous decision. At least one of the following must change: - the set of language codes (‘language_names‘), OR - the rewritten query (focus, structure, or keywords). [Corpus selection rules] 1. Always include the corpus whose language code matches the **primary language** of the original query, unless the system’s reasoning explicitly shows it is consistently low-relevance. 2. If some corpora are **content-wise** relevant (country, region, culture, institution, person, event, etc.), you may additionally select them. - Example: a topic about Japan → include "ja". 3. If the system’s reasoning indicates that many documents from a language were off-topic, shallow, or irrelevant, you may lower its priority or remove it, and instead consider other content-relevant languages. 4. Do not select corpora that are almost unrelated to the query. 5. **Never** add corpora "just in case." Choose only a small, realistically useful set. 6. Use only language codes that appear in the following language pools. **Never invent new names.** Language Pools: ["id", "am", "su", "ar", "ha", "en", "zh", "ko", "as", "el", "fa", "es", "az"]
Figure 5: Planner Prompt Template w/ critique.
[Query rewriting rules] 1. **Preserve the original meaning and intent**, while making the query clearer and more retrieval-friendly: - Remove colloquial or filler phrases. - Explicitly mention time, location, and named entities ONLY when given. Do not add unnecessary details. - **Do not delete any complete sentences in the original query that convey substantive information** (given passage, main question, etc.). - Remember that the rewritten query is the only source of information for the retriever. 2. Adjust the rewritten query using the system’s reasoning: - If results were too broad → make the query more specific. - If important aspects were missing → add them explicitly. - If results were off-topic → clarify the main topic and disambiguate the concepts. - If the structure was unclear → reorganize for better retrieval. 3. The new rewritten query must **meaningfully differ** from the previous rewritten query (e.g., emphasize a different aspect, add missing constraints, reorganize structure, clarify ambiguous elements). [Output format] Return **exactly** the following JSON object **as a single continuous line with no surrounding whitespace, line breaks, or markdown formatting**: { "language_names": ["<lang_code>", ... ], "rewritten_query": "<cleaned, rewritten query>" } - ‘language_names‘ must be a list of **valid** language codes from the pool, containing **at most three** entries and always including the primary language of the original query unless the system’s reasoning indicates otherwise. - ‘rewritten_query‘ must be a single string (may be empty). USER PROMPT: [ORIGINAL USER QUERY] {USER_QUERY} [PREVIOUS QUERY FOR RETRIEVAL] {REWRITTEN_QUERY} [PREVIOUS LANGUAGE CORPORA FOR RETRIEVAL] {PREV_LANGS} [REASON FOR ADDITIONAL RETRIEVAL] {REASEON} Figure 5: Planner Prompt template w/ critique. (continued)
SYSTEM PROMPT: You are a document re-ranking system. Your role is to evaluate a user query and a set of retrieved candidate documents. For each document, you must infer several properties, assign numerical scores based on the rubric, and provide a final evaluation. Your evaluation focuses on how well each document contributes to answering the user’s query—especially in multilingual or cross-domain scenarios. [Inferred Properties] Relevance (0-5) - Measures how strongly the document aligns with the key concepts, entities, and intent of the query. - Higher scores correspond to closer conceptual alignment and direct topical relevance. - Lower scores correspond to weak or minimal connection to the query. Usefulness (0-5) - Measures how much the document helps the system construct a correct, complete, and actionable answer. - Higher scores indicate substantial, high-impact contributions. - Lower scores indicate little to no helpful information. Clarity and Specificity (0-5) - Measures how clearly, precisely, and unambiguously the document presents information relevant to the query. - Higher scores reflect well-structured, specific, and easy-to-interpret content. - Lower scores reflect vague, overly general, or confusing content. Compatibility (0-5) - Measures linguistic, cultural, and domain compatibility between the query and the document. - Higher scores correspond to strong language alignment, faithful cross-lingual equivalence, and contextual appropriateness. - Lower scores correspond to mismatched languages, cultural contexts, or domain assumptions. [Output Format] You must output **ONLY ONE** JSON dictionary corresponding to the evaluation of a **single document**, with **no additional text, no explanations, no Markdown, and no commentary**. The JSON must follow **exactly** this structure: {"scores": {"relevance": RELEVANCE_SCORE(0-5), "usefulness": USEFULNESS_SCORE(05), "clarity_specificity": CLARITY_SPECIFICITY_SCORE(0-5), "compatibility": COMPATIBILITY_SCORE(0-5)}, "critique": "CRITIQUE_TEXT"} Strict requirements: - All scores must be integers from 0 to 5. - "critique" must be based on the content of the given document without any hallucinations and be a single string describing the reasoning. - **No other hierarchies, nested structures, arrays, multiple document keys, or additional fields are allowed.** - Do NOT wrap the output in other objects. - Do NOT output multiple dictionaries. - Do NOT include the document ID, name, or any other label as a key. - Do NOT output anything before or after the JSON dictionary. Figure 6: Critique Prompt Template for Scoring.
SYSTEM PROMPT: You are a retrieval controller for a RAG system. [Your job] Given a user query and a set of retrieved documents, decide whether these documents are sufficient to answer the query reliably, and which documents are actually useful. ## Inputs [Query] - content: text [Retrieved Documents] Each document has: - content: text - scores: a numeric score (higher means more relevant) - critique: natural language explanation of why this document may be appropriate or sufficient for answering the query. ## Decision Guidelines Only consider the information available in the documents, and do not use external knowledge. When making your decision, consider: 1. Coverage - Do the given documents collectively cover the main aspects and requirements of the query? - Are there important sub-questions or constraints in the query that are not addressed? - Are all information and details of the documents considered to solve the problem? 2. Depth & Specificity - Are the documents detailed and specific enough to support a precise and reliable answer? - If the query requires factual accuracy, step-by-step reasoning, or up-to-date information, be conservative: if you are not confident, prefer requesting more documents. 3. Consistency - Do the documents agree on key facts? - If there are major contradictions that you cannot resolve with the current documents, you may need more documents. ## Output Format Respond in **valid JSON** with the following fields: - "enough_documents": boolean - true = the given documents are sufficient to answer the query reliably - false = you believe we should retrieve more documents - "reason": text - reason why you think the documents are sufficient or not. If they are insufficient, additiional feedback for next search will be needed. { "enough_documents": true/false, "reason": "reason for your decision" } USER PROMPT: [USER QUERY] {QUERY} [RETRIEVED DOCUMENTS] {DOCUMENTS}
Figure 7: Critique Prompt Template for evaluating sufficiency.
Original Query: 다음은 한국의 문화와 전통에 대한 문제이다. 제사에서 가족이 하는 행동은 무엇인가? A: 조상에게 절을 두 번 한다 B: 조상에게 절을 세 번 한다 C: 조상에게 절을 한 번 한다 D: 조상에게 절을 네 번 한다 The following is a question about Korean culture and traditions. What do family members do during Jesa A: Bow twice to the ancestors B: Bow three times to the ancestors C: Bow once times to the ancestors D: Bow four times to the ancestors
Answer: A Retrieved Documents from Call Document 1: 한국의 제사(韓國의 祭祀)는 크게 천지신명을 비롯한 자연물에 드리는 제사와 조상에게 드리는 제사로 나뉜다. ... Korean Jesa (ancestral rites) is broadly categorized into rites performed for nature, including the gods of heaven and earth, and rites performed for ancestors. ...
Document 2: La première partie de la célébration du dol est la prière. ... The first part of the Dol celebration is prayer. ...
Document 3: ... ## 한국의 제사 ... ## 힌두교의 제사 ... ... ## Korean Jesa ... ## Hindu rites ...
Document 4: ### Social folk customs in daily life ... Document 5: ... Charye is one of the ancestral memorial rites celebrated during Chuseok, ... Retrieved Documents form CORAL Document 1: ... 제주가 두 번 절한다. ... ... The chief mourner bows twice. ...
··· Figure 8: Planner Critique Example for Retrieved Documents. Qualitative comparison of retrieved evidence for a culturally grounded Korean query (jesa bowing practice). Retrieval over the unified corpus Call produces mostly superficial or tangential documents, reflecting substantial noise from indiscriminate corpus expansion. In contrast, CORAL routes retrieval to a linguistically and culturally aligned Korean document that explicitly describes the jesa procedure, including the correct two-bow ritual, enabling access to precise procedural knowledge needed to answer correctly.
Original Query: What region in the US is usually associated with oil? Documents (1st Trial) Document 1: Hassi Messaoud () is a town in Ouargla Province, eastern Algeria, locatedsoutheast of Ouargla. As of 2008 it had a population of 45,147 people, ... Document 2: The above north-south Algerian road from Constantine passes through other oases. North of Wargla [Ouargla] lies Touggourt [Tuggurt, Taghit] (pop: 153,000), ... Document 3: Andalus may refer to: ## PlacesAl-Andalus, a historical region in Europe around the Iberian PeninsulaAndalusia, ... Document 4:## Economy The economy of Patos is mainly based on oil companies such as Bankers Petroleum, and Albpetrol. Patos is on the Patos-Marinza Oil Field ... Document 5:Hassi Messaoud Oil Field is an oil field located in Ouargla Province. It was discovered in 1956 by S.N. REPAL and developed by Sonatrach. ... Critique Decision enough_documents: False reason: No documents were retrieved, so there is no information available to determine which region in the US is associated with oil. Additional documents are needed to answer the question reliably. Rewritten Query: Which region in the United States is most commonly associated with oil production or the oil industry? Documents (2nd Trial) Document 1: ... The leading crude oil-producing areas in the United States in 2023 were Texas, followed by the offshore federal zone of the Gulf of Mexico, North Dakota and New Mexico. ... Document 2: ... The Glenn Pool strike near Tulsa, Oklahoma in 1905 established Tulsa as the leading U.S. oil production center until the 1930s. Though Texas soon lagged behind Oklahoma and California, it was still a major producer. ... Document 3: Oil is a major part of the Texas economy. Texas has consistently been the leading oil producing state ... Document 4: ... La principal zona productora de petróleo de Estados Unidos en 2019 fue Texas ... ... The main oil-producing region in the United States in 2019 was Texas ...
Document 5: ... 自在石油以,能源一直是德克斯政治和上的主力量,如果德州家,成世界第 六大石油生。德州已知的石油量,占--美已知量的四分之一。... ... Since the discovery of oil at Spindletop, energy has been a dominant force in Texas’s politics and economy. If Texas were considered a nation, it would be the world’s sixth-largest oil producer. Texas’s known oil reserves are approximately [amount missing], representing about a quarter of the total known oil reserves in the United States. ...
Critique Decision enough_documents: True reason: The retrieved documents collectively provide strong and consistent evidence that the southwestern region of the United States—particularly Texas, New Mexico, and the Gulf Coast—is most commonly associated with oil production. ... Therefore, no further documents are needed.
Figure 9: Planner Critique Example for Query Rewriting and Evidence Refinement. The critic identifies insufficient information in the initial retrieval and rejects the evidence. Following a planner-led query rewrite to include missing signals, the second retrieval provides specific details on the U.S. oil industry, enabling an accurate response.