Conceptio › Archive › arXiv CS
arXiv CS open access

GEO-Flag: Detecting and Measuring GEO-Optimized Web Content

2026 · arxiv_cs
arXiv CS · Papers · 2026
Open Source ↗Direct PDF ↓
cryptographycybersecurityprivacysecurity
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

GEO-Flag: Detecting and Measuring GEO-Optimized Web Content Junjie Chu1 Ye Leng1 Mingjie Li1 Yun Shen2 Xinyue Shen1,3 Yang Zhang1♣ 1 CISPA Helmholtz Center for Information Security

arXiv:2608.16824v1 [cs.LG] 17 Aug 2026

Abstract

3 University of Waterloo

answer with inline citations, they make information access more convenient and efficient. Their growing adoption has also given rise to Generative Engine Optimization (GEO), which modifies web content to increase its likelihood of being selected and cited by generative search engines [1]. GEO has already developed into a growing commercial optimization practice. However, GEO also introduces new risks. Highly optimized pages may receive visibility disproportionate to their actual authority or relevance, potentially displacing more reliable sources. Worse, GEO techniques can be misused to make weak or false information appear well supported. For example, an operator can publish a false claim on one website and then cite that page from another [8, 14]; the citation is real, but the underlying source was strategically created to support the claim itself. Generative search can amplify these risks. Unlike conventional search, it presents users with a synthesized answer rather than a list of competing sources, making the provenance and authority of the underlying information less immediately visible. As a result, GEO-optimized or strategically constructed content can be propagated into a coherent and seemingly well-supported answer. Despite these risks, we still lack systematic tools for identifying GEO-optimized content. Existing work primarily studies how to improve visibility in generative engines [1, 29,33,34,45], while considerably less attention has been paid to the inverse problem: determining whether a webpage has been deliberately optimized for generative search. Measuring Current Detection Methods. To fill this gap, we first propose GEOFlagBench, a benchmark for detecting GEO-optimized webpages across diverse domains and optimization strategies. It contains 3,200 documents derived from 400 queries across four domains and spans eight GEO optimizer families. We use GEOFlagBench to evaluate finetuned classifiers, zero-shot LLMs, feature-based models, and repurposed AI-text detectors. Although the strongest baseline reaches an aggregate F1 of 0.880, method-level and authorship-conditioned evaluation reveals substantial weaknesses. For example, Word TF-IDF has a worst-group accuracy of only 0.375 and a false-positive-rate gap of 0.558 between AI- and human-authored non-GEO pages. These results suggest that high aggregate performance can conceal reliance on original-authorship or general LLM-writing cues instead of GEO-specific interventions. Improved GEO Detection. Motivated by these limitations,

Generative Engine Optimization (GEO) modifies web content to increase its likelihood of being selected and cited by generative search engines. This can give strategically optimized pages visibility disproportionate to their authority or relevance and even make weak or false information appear well supported. Unlike conventional search, generative search synthesizes information into direct answers rather than presenting competing sources, which can further amplify these risks, as assessing source provenance and authority requires additional user interaction. Despite these concerns, systematic methods for detecting GEOoptimized webpages remain underexplored. We introduce GEOFlagBench, a benchmark of 3,200 webpages spanning 400 queries, four domains, and eight GEO optimizer families, and use it to systematically evaluate existing GEO detection methods. Although the strongest baseline achieves an aggregate F1 of 0.880, method-level and authorshipconditioned evaluations reveal substantial weaknesses and potential reliance on authorship-related shortcuts. We therefore propose Intervention-Paired Training (IPT), which supervises detector responses to GEO interventions and nonGEO AI polishing; on ModernBERT, IPT improves F1 from 0.862 to 0.944 and worst-group accuracy from 0.725 to 0.883. Beyond page-level detection, we develop a GEOgated Agent system for auditing the Source Tier and verifiability of Citation URLs used by detected GEO pages. Finally, we deploy the complete pipeline on released Google Search and Gemini-grounded retrieval results for 1,000 realuser queries. Across 10,095 available pages, we estimate an overall GEO prevalence of 8.90%, reaching 16.36% among pages modified in 2026, while 69.34% of Citation occurrences on detected GEO pages receive LOW verifiability labels. Our results establish a foundation for systematically detecting, auditing, and measuring GEO in real-world search ecosystems.

1

2 HPE

Introduction

Generative search engines, such as Perplexity, ChatGPT Search, and Google Gemini-Grounded Search, are emerging as a new way to access information on the web. By retrieving multiple pages and synthesizing them into a single ♣ Corresponding author.

1

• We propose Intervention-Paired Training (IPT), which improves GEO detection while reducing reliance on authorship and generic AI-writing cues.

we propose Intervention-Paired Training (IPT), which directly supervises how a detector should respond to documented content transformations. IPT uses positive pairs to require a higher GEO score after a GEO intervention and zero pairs to preserve the score after non-GEO AI polishing. This design encourages the detector to capture optimizationspecific changes while reducing its reliance on static authorship and generic LLM-editing signals. On ModernBERT, IPT improves F1 from 0.862 to 0.944 and worst-group accuracy from 0.725 to 0.883, while reducing the authorshipconditioned false-positive-rate gap from 0.263 to 0.108. IPT also improves Qwen’s F1 from 0.833 to 0.883 and its worstgroup accuracy from 0.325 to 0.775. Beyond page-level detection, we develop a GEO-gated Agent system for assessing the verifiability of Citation URLs used by detected GEO pages. The system first applies the GEO detector and then uses deterministic parsing and retrieval tools to extract Citation URLs and collect their accessibility evidence. A constrained Agent assigns each Citation URL a publisher Source Tier, after which deterministic rules derive Citation URL Verifiability. We evaluate the system on an independent zero-shot benchmark containing 562 webpages organized into 281 non-GEO/GEO pairs. Among correctly detected GEO pages, the strongest Agent, GLM 5.2, achieves 84.75% accuracy for URL Source Tier and 83.00% for Citation URL Verifiability. Empirical GEO Prevalence Estimation. We then deploy the complete GEO detection and Citation URL audit pipeline to estimate GEO prevalence in real-world search results. We analyze pages associated with 1,000 real-user ORCAS queries in released conventional Google Search and Geminigrounded retrieval results. After multi-stage page collection and recovery, the audit contains 10,095 usable pages from 13,985 unique URLs. The detector flags 898 pages as GEO, corresponding to an estimated prevalence of 8.90%. The channel-specific estimates are 8.14% for Google Search and 9.09% for Gemini, while the paired-query macro estimates are 7.91% and 9.34%, respectively. Among pages with a parseable declared dateModified value, the estimated GEO prevalence in the unique union increases from 7.02% in 2024 to 12.80% in 2025 and 16.36% in 2026. Among 6,663 Citation occurrences extracted from the detected GEO pages, 69.34% receive LOW verifiability labels. The LOW share reaches 74.15% for Gemini, compared with 45.88% for Google Search, indicating substantial differences in the Citation URL composition of GEO pages exposed through the two channels.1 Contributions. Our contributions are summarized as follows:

• We develop a GEO-gated Agent system for auditing the Source Tier and verifiability of Citation URLs used by detected GEO pages. • We provide an empirical estimate of GEO prevalence in released Google Search and Gemini-grounded retrieval results, finding an overall estimated prevalence of 8.90% and a clear increase among more recently modified pages, reaching 16.36% among pages modified in 2026.

2

GEO Flagging with Existing Detectors

We begin by measuring how well existing approaches distinguish GEO-optimized pages from non-GEO pages. This serves two goals. First, we measure how current approaches perform in a controlled, query-disjoint evaluation. Second, we examine whether detectors perform consistently across different GEO methods and on pages derived from humanand AI-authored content. The insights subsequently motivate the intervention-paired training method later introduced in Section 3.

2.1

Task Definition and Evaluation Scope

We define GEO detection as the binary task of determining whether a webpage has been modified with GEO techniques. Given a webpage x, a detector predicts ŷ ∈ {0, 1}, where ŷ = 1 means that the page was GEO-optimized to improve its visibility, ranking, or selection by a generative search system, and ŷ = 0 means that it was not. It is important to bear in mind that our goal is to detect the presence of the GEO-specific modification, not authorship or writing style. A GEO page may be derived from either human-written or AI-generated source content, while a non-GEO page may likewise be human-written, AI-polished, or AI-generated. A useful detector must distinguish GEO-specific signals from general effects of AI generation, editing, query, and source provenance. In this paper, we consider a document-only setting. The detector sees the resulting page but not its original version, construction prompt, or provenance metadata. When the detector is applied to a webpage with an unknown editing history, a positive prediction means only that the page resembles pages modified using the GEO techniques studied here. It does not indicate malicious intent, factual inaccuracy, or successful manipulation of a deployed generative search engine.

• We introduce GEOFlagBench and use it to systematically evaluate current detection methods, revealing substantial method-level weaknesses and potential reliance on authorship-related shortcuts despite strong aggregate performance.

2.2

GEOFlagBench

Overview. GEOFlagBench contains 3,200 documents constructed from 400 queries across Health, Finance, Technology, and Travel. Here, we use document to refer to one data instance corresponding to the textual content of a webpage. For each query, we construct three non-GEO controls: a human-written source document, an AI-polished version of

1 As the live pages lack GEO ground-truth labels and the pipeline is imper-

fect, we report these findings as empirical estimates rather than definitive measurements.

2

that document, and an AI-generated document derived from a structured summary of the source document. This process yields 1,200 non-GEO controls. We then select humanwritten and AI-generated controls as seeds for eight GEO optimizer families. Each application of an optimizer produces a separate GEO document, yielding 2,000 GEO documents in total. Note that AI-polished controls are never used as GEO seeds. The full details are reported in Table 13. Domain Selection and Query Collection. We construct the benchmark across four domains: Health, Finance, Technology, and Travel. These domains represent heterogeneous information environments in which GEO effectiveness may vary [1]. Health and Finance cover consequential settings in which inaccurate information may affect users’ health or financial well-being, while Technology captures rapidly evolving technical content and Travel captures practical consumer information [17, 39]. We include exactly 100 queries per domain to maintain a balanced domain distribution and prevent domain frequency from becoming a shortcut for classification. We focus on general informational queries that seek factual or explanatory content without targeting a specific website, platform, or other destination. Destination-specific queries are excluded because they strongly constrain the expected source and page format, whereas general informational queries allow the same topic to be represented by content from different publishers. We first collect candidate queries from the GEO-Bench test split using its released annotations [1]. We use the test split for two reasons. First, its fine-grained annotations allow us to exclude sensitive queries and systematically map the remaining candidates to our four domains. Second, the GEO-Bench training split has been used to develop or train downstream GEO optimization methods [1,45]. Using held-out test queries therefore reduces direct query-level overlap with the data used to develop the optimization methods evaluated in our benchmark. Sonnet 4.6 then screens the mapped queries for domain mismatch and semantic duplication, leaving 164 GEO-Bench queries. To obtain 100 queries per domain, we use Sonnet 4.6 to generate 236 additional informational queries under fixed domain and quality constraints. Finally, two authors independently review all 400 queries for domain correctness and semantic duplication. Both confirm that every query belongs to its assigned domain and that no semantic duplicates remain. Further details on the domain definitions, tag-todomain mapping, filtering criteria, and query generation process are provided in Appendix A.1. Non-GEO Data Construction. For each of the above 400 queries, we construct three non-GEO groups: humanwritten, AI-polished, and AI-generated content.

updates after this cutoff. This yields 400 human-written non-GEO seed pages. • AI-Polished. For each human-written seed, we create a version in which an LLM improves grammar, spelling, punctuation, and phrasing while preserving the original semantics and content. We distribute the pages across eight different LLMs to reduce model-specific artifacts from becoming classification shortcuts. The prompts contain no GEO-related instructions, allowing this group to isolate the effect of AI-assisted editing. • AI-Generated. For each query, we first extract a structured summary from the corresponding human-written page and then ask an LLM to write a new article from that summary while preserving its main factual content and targeting a similar length. The 400 queries are again distributed across the same eight LLMs. Because the generation prompts contain no GEO objectives, this group serves as a control for fully AI-generated content without deliberate GEO optimization. The detailed construction process for each non-GEO group is described in Appendix A.2. GEO Data Construction. We construct 2,000 GEO documents by applying explicit optimization interventions to human-written or AI-generated non-GEO seeds. The benchmark includes eight optimizer families that cover different GEO mechanisms and levels of intervention: GEO Strategy Pool [1], AutoGEO [45], PMA [29], RAID GSEO [10], Meta-Optimization [5], Stealthy GEO Strategy Pool, Stealthy AutoGEO, and Human GEO. The first four families cover strategy-based rewriting, learned optimization preferences, preference manipulation, and intent-aware optimization, respectively. Meta-Optimization adds iterative self-evaluation and revision. We further construct stealthy variants of GEO Strategy Pool and AutoGEO that retain the same GEO objectives while reducing obvious optimization patterns in the resulting text. Finally, we conduct Human GEO, which combines various GEO strategies and is applied by human annotators. Where applicable, we use multiple executor LLMs to reduce the risk that a detector learns model-specific generation artifacts instead of features associated with GEO interventions. The complete construction process for each GEO family is described in Table 12 of Appendix A.3.

2.3

Existing Detectors

Fine-Tuned Models. We fine-tune ModernBERT (Modern BERT-base [42]) as binary GEO classifiers. For ModernBERT, we evaluate both its default context setting (1024token context) and an extended 8,192-token context. These encoder-based baselines test whether task-specific representations learned directly from webpage text can capture GEOrelated signals. We also perform supervised fine-tuning of Qwen3-0.6B [35]. For Qwen, we use a structured generation format in which the model produces an intermediate analysis followed by a binary decision (Answer:Yes/No). Only the final decision is used for evaluation. We fine-tune all

• Human-Written. We retrieve one webpage per query from English Wikipedia or relatively reliable publishers returned by the Brave Search API. To reduce the possibility of prior GEO intervention, we restrict all sources to content available before October 1, 2022, which predates both the formal introduction of GEO [1] and the public release of ChatGPT. We further verify modification metadata and retain only pages with no recorded 3

Table 1: Overall GEO flagging results on the fixed test set of 360 non-GEO and 602 GEO documents. The last block calibrates each native score with one-dimensional logistic regression on the training split.

ModernBERT models for 5 epochs, and Qwen models for 10 epochs with standard SFT (supervised fine-tuning) [13, 26]. Feature Engineering and Classical Classifiers. We evaluate several feature-based baselines using classical classifiers. For lexical features, we train logistic regression on character TF-IDF features with 2–4 character grams and word TF-IDF features with unigrams and bigrams, retaining at most 20,000 features for each representation. We additionally train logistic regression on Ghostbuster features [41] and on GPT2 perplexity-derived features [1, 36]. All logistic regression models use an inverse regularization strength of C = 1 and a maximum of 1,000 optimization iterations. To capture webpage structure, we train XGBoost [9] on ten structural features, including document length and the frequencies of headings, lists, citations, numbers, and sections. The XGBoost classifier uses 200 trees, a maximum depth of 6, and a learning rate of 0.1. Proprietary AI-Text Detector APIs. We evaluate two commercial AI-text detection services, Pangram [32] and GPTZero [19], using their standard interfaces. GPTZero returns three document-level classes: AI, Mixed, and Human. We therefore evaluate two mappings to the binary GEO task: one treats only AI as GEO, while the other, denoted GPTZero (mixed), treats both AI and Mixed as GEO. Zero-Shot LLMs. We evaluate Qwen3-0.6B [35], Gemini 3.5 Flash [18], and Claude Haiku 4.5 [4] as zero-shot GEO detectors. Each model receives the binary task definition and the webpage text, without demonstrations or task-specific training examples, and is instructed to return a single GEO or non-GEO decision. AI-Text Detectors Repurposed for GEO. Finally, we evaluate several existing AI-text detection signals after adapting their outputs to the GEO task. These include the off-theshelf Ghostbuster score [41], Fast-DetectGPT [7], and the OpenAI RoBERTa GPT-2 output detector [31]. We also include maximum keyword term frequency as a simple lexical GEO signal. Because these methods were not designed to detect GEO, their native scores do not directly correspond to the GEO label. For each score, we therefore fit a onedimensional logistic regression using only the training split. This calibration changes only the mapping from the native score to the GEO label and leaves the underlying detector or representation unchanged.

2.4

Method

Accuracy

F1

0.842 0.839 0.778

0.864 0.862 0.833

Feature engineering + classical classifiers TF-IDF char (2-4) + LR 0.848 TF-IDF word (1-2) + LR 0.846 Ghostbuster features, recalibrated 0.796 Structural + XGBoost 0.752 GPT-2 perplexity + LR 0.710

0.878 0.880 0.835 0.801 0.781

Proprietary AI-text detector API Pangram GPTZero (mixed) GPTZero

0.838 0.799 0.768

0.876 0.830 0.782

Zero-shot LLMs Qwen3-0.6B Gemini-3.5-flash Haiku-4.5

0.627 0.759 0.747

0.770 0.776 0.771

Fine-tuned Models ModernBERT (1,024 tokens) ModernBERT (8,192 tokens) Qwen3-0.6B (SFT)

AI-text detectors repurposed for GEO (train-calibrated) Ghostbuster off-shelf (GPT-2) + LR 0.626 0.770 Fast-DetectGPT (crit) + LR 0.631 0.767 Keyword max TF + LR 0.626 0.770 OpenAI RoBERTa pmachine + LR 0.626 0.770

Probabilistic classifiers use a decision threshold of 0.5. The proprietary APIs use the label mappings stated above. Hardware. We conducted the experiments on a Google Cloud g2-standard-8 instance equipped with 8 vCPUs, 32 GB of system memory, and a single NVIDIA L4 GPU with 24 GB of GPU memory.

2.5

Evaluation

Overall Results. As shown in Table 1, several methods perform competitively on the fixed test set. Word TF-IDF with logistic regression achieves the highest F1 of 0.880. Character TF-IDF and Pangram perform similarly, reaching F1 scores of 0.878 and 0.876, respectively. These results show that competitive GEO flagging is possible with substantially different approaches, ranging from fine-tuned encoders to simple lexical features and a proprietary AI-text detector. Other approaches are considerably less effective. The three zero-shot LLMs obtain F1 scores between 0.770 and 0.776, while several repurposed AI-text detector scores remain close to a positive-class majority baseline even after calibration on the training split. This baseline predicts every document as GEO and obtains an accuracy of 0.626 and an F1 of 0.770. Overall, the aggregate results suggest that GEO modifications leave detectable signals, but performance varies substantially across detector families. Method-Level Results. Aggregate metrics, however, do not show whether a high-performing detector works consistently across different GEO methods. We therefore examine method-level recall values. We list the results of three representative methods (PMA, AutoGEO-Light, and HumanBased GEO) in Table 2. These subsets represent substantially different forms of optimization: PMA introduces ex-

Experiment Settings

Train and Test Split. To prevent semantic leakage (e.g., documents derived from the same query appearing in both training and testing) and evaluate generalization to unseen queries, we use a query-level grouped split, assigning all documents associated with the same query to the same partition. Concretely, we apply stratified sampling by domain, assigning 70 queries per domain to training and 30 queries per domain to testing. The data associated with these queries form the training and test sets, containing 2,238 and 962 documents, respectively. Metrics. We report accuracy and F1 on the fixed test set. F1 treats GEO as the positive class. Accuracy measures both false alarms on non-GEO pages and misses on GEO pages. 4

Table 2: Method-level recall and authorship-conditioned diagnostics on the fixed test set. Arrows indicate the preferred direction. Method

Method-Level GEO Recall

Authorship-Conditioned Diagnostics

PMA↑ AutoGEO-Light↑ Human-based↑ Worst-Group Acc.↑ ∆FPR↓ ∆TPR↓ Fine-tuned models ModernBERT-base (1,024 tokens) ModernBERT-base (8,192 tokens) Qwen3-0.6B (SFT)

0.566 0.513 0.934

0.423 0.346 0.654

0.426 0.444 0.463

0.725 0.725 0.325

0.271 0.263 0.413

0.121 0.117 0.105

Feature engineering + classical classifiers TF-IDF char (2-4) + LR 0.737 TF-IDF word (1-2) + LR 0.908 Ghostbuster features, recalibrated 0.539 Structural + XGBoost 0.421 GPT-2 perplexity + LR 0.605

0.308 0.423 0.192 0.538 0.538

0.778 0.704 0.759 0.759 0.685

0.575 0.375 0.600 0.550 0.367

0.346 0.558 0.221 0.188 0.221

0.077 0.111 0.047 0.033 0.084

Proprietary AI-text detector API Pangram GPTZero (mixed) GPTZero

1.000 1.000 0.961

0.769 0.462 0.192

0.500 0.389 0.074

0.192 0.508 0.583

0.767 0.475 0.154

0.099 0.185 0.172

Zero-shot LLMs Qwen3-0.6B Gemini-3.5-flash Haiku-4.5

1.000 0.987 0.987

1.000 0.154 0.269

1.000 0.037 0.074

0.008 0.589 0.586

0.000 0.258 0.321

0.006 0.166 0.197

AI-text detectors repurposed for GEO (train-calibrated) Ghostbuster off-shelf (GPT-2) + LR 1.000 1.000 Fast-DetectGPT (crit) + LR 0.961 0.962 Keyword max TF + LR 1.000 1.000 OpenAI RoBERTa pmachine + LR 1.000 1.000

1.000 1.000 1.000 1.000

0.000 0.004 0.000 0.000

0.000 0.179 0.000 0.004

0.000 0.037 0.000 0.003

the underlying source content before any polishing or GEO transformation. Accordingly, AI-polished documents are included in the human non-GEO group because they originate from human-written webpages and undergo only grammarand fluency-level editing without any GEO strategy. The resulting groups contain 240 human non-GEO, 120 AI nonGEO, 321 human GEO, and 281 AI GEO documents. We then use three complementary diagnostics in Table 2 to measure how strongly detector performance varies across these original-authorship groups:

plicit ranking-oriented modifications, AutoGEO-Light applies relatively sparse edits, and Human-based GEO is considered to have fewer common AI-writing cues. Despite their strong aggregate performance, several detectors show pronounced differences across these methods. The two TFIDF classifiers exhibit a similar imbalance. Although they achieve the two highest aggregate F1 scores in Table 1, their AutoGEO-Light recall is only 0.308 and 0.423 in Table 2. The contrast is even stronger for some zero-shot and proprietary methods: Gemini and Haiku both reach 0.987 recall on PMA, but only 0.037 and 0.074 on Human-based GEO, respectively. GPTZero likewise reaches only 0.074 recall on Human-based GEO. The three subsets also suggest different sources of difficulty. PMA is detected reliably by many methods, possibly because its more explicit optimization introduces stronger lexical or stylistic signals. AutoGEO-Light presents the opposite case: because it modifies only a limited portion of the document, the resulting GEO signal may be diluted by the largely unchanged source text. Its low recall therefore suggests that some detectors are sensitive to the extent of optimization rather than merely to its presence. Human-based GEO raises a different concern. It is designed to reduce stylistic cues commonly associated with AI-written text. The sharp recall degradation on this subset therefore raises the possibility that some detectors rely partly on human–AI original authorship cues rather than signals specific to GEO itself. Human–AI Original Authorship as a Potential Shortcut. The low recall on Human-based GEO raises the possibility that some detectors rely on cues associated with the original human–AI authorship of a document rather than GEO itself. To examine this possibility, we partition the test set into four groups defined by GEO status and original authorship: human non-GEO, AI non-GEO, human GEO, and AI GEO. Here, original authorship refers to the provenance of

• Worst-group accuracy (WGA) is the minimum accuracy across the four groups [37]. It measures whether strong aggregate performance is maintained for every combination of GEO status and authorship. Higher values are better; a low value indicates that aggregate accuracy masks poor performance on at least one group. • ∆FPR is the absolute difference in false-positive rate between AI and human non-GEO documents [21]. It measures whether authorship affects the tendency to incorrectly flag a non-GEO document as GEO. Lower values are better; a large gap means that the detector treats human- and AI-authored non-GEO documents differently despite their identical GEO label. • ∆TPR is the absolute difference in true-positive rate between AI and human GEO documents [21]. It measures whether authorship affects the detector’s ability to recognize GEO documents. Lower values are better; a large gap means that GEO detection success depends substantially on whether the underlying document is human- or AI-authored. Several methods with strong aggregate performance exhibit substantial authorship-conditioned differences. Word TF-IDF achieves the highest overall F1 of 0.880, yet its 5

we require the GEO score of xg to exceed that of xo by a predefined margin. This constraint encourages the detector to capture changes introduced by GEO optimization rather than relying only on static properties of individual pages. A zero pair (xo , x p ) consists of an original page xo and its AI-polished counterpart x p . AI polishing introduces LLMinduced lexical and stylistic changes but does not apply a GEO strategy. We therefore constrain the GEO scores of xo and x p to remain close, explicitly teaching the detector that LLM editing alone is not evidence of GEO. The two pair types provide complementary supervision. Positive pairs identify changes that should increase the GEO score, whereas zero pairs identify LLM-induced changes that should not affect it. Binary IPT Objective. Let zθ (x) denote the binary GEO logit for page x, and let D denote the labeled training documents. The standard document-level classification loss is

worst-group accuracy is only 0.375 and its ∆FPR reaches 0.558 in Table 2. Pangram shows an even larger discrepancy: despite an aggregate F1 of 0.876, its worst-group accuracy is 0.192 and its ∆FPR is 0.767. Qwen3-0.6B (SFT) similarly combines an F1 of 0.833 with a worst-group accuracy of 0.325 and a ∆FPR of 0.413. Thus, some of the methods that appear strongest under aggregate evaluation are substantially less stable once human and AI authorship are considered separately. These results are consistent with human–AI authorship acting as a shortcut for GEO flagging. A detector may partly distinguish AI-written from human-written documents rather than identifying signals introduced specifically by GEO. Our analysis is observational and does not establish the internal decision rule of any detector, but the large authorshipconditioned gaps show that aggregate performance alone cannot rule out such shortcut reliance. Small authorship gaps must also be interpreted with care. Zero-shot Qwen3-0.6B and several calibrated AI-text scores predict nearly every document as GEO, producing near-zero authorship gaps and near-perfect recall on the listed GEO subsets but worst-group accuracy close to zero. Their apparent stability therefore results from nearly constant predictions rather than robust GEO detection. Taken together, these results reveal that existing GEO detectors may vary substantially across optimization methods, and some may rely partly on human–AI authorship cues rather than GEO-specific signals.

3

Lcls =

∑ |D | (x,y)∈ D

BCE(σ(zθ (x)) , y) ,

(1)

where σ(·) is the sigmoid function. Let P+ denote the set of positive intervention pairs. We require a GEO intervention to increase the GEO logit by at least margin m:

L+ =

1 max(0, m − zθ (xg ) + zθ (xo )) . |P+ | (x ,x∑)∈P o g

(2)

+

Let P0 denote the set of zero intervention pairs. For these pairs, we constrain AI polishing to preserve the GEO logit:

Toward More Reliable GEO Detection

Our analysis in Section 2.5 reveals two limitations of existing GEO detectors. First, some high-performing detectors generalize poorly across GEO methods, especially those with sparse modifications such as AutoGEO-Light. Second, their error rates can differ substantially between documents derived from human- and AI-authored sources, suggesting potential reliance on original-authorship shortcuts rather than GEO-specific signals. To address these limitations, we propose InterventionPaired Training (IPT), which exploits the correspondence between original and transformed pages in GEOFlagBench. For pages derived from the same source, a GEO intervention should increase the GEO score, whereas non-GEO AI polishing should leave it approximately unchanged. Because original authorship is fixed within each pair, IPT encourages the detector to respond to GEO-specific changes while reducing reliance on static authorship and generic LLM-processing cues.2

3.1

1

L0 =

1 |zθ (x p ) − zθ (xo )| . |P0 | (x ,x∑)∈P o

p

(3)

0

The complete binary IPT objective is

LIPT = Lcls + αL+ + βL0 .

(4)

IPT does not require every training document to belong to an intervention pair. Unpaired examples receive only the standard classification loss in Equation 1 and therefore reduce to ordinary supervised fine-tuning. IPT can thus be applied as an extension of standard SFT: paired examples provide additional intervention-level supervision, while unpaired examples retain the standard document-level objective. Pair construction uses only training queries, and inference remains page based and requires no paired input. Generative IPT. We further apply IPT to Qwen3-0.6B using LoRA adapters [22]. The model generates a reasoning sequence followed by a Yes/No verdict. We define the GEO score as zθ (x) = ℓθ (Yes | x) − ℓθ (No | x), (5)

Intervention-Paired Training

Positive and Zero Interventions. We construct two types of intervention pairs. A positive pair (xo , xg ) consists of an original page xo and its GEO-optimized counterpart xg . Because the transformation from xo to xg applies a GEO intervention,

where the two logits are evaluated at the verdict position. For notational simplicity, zθ (x) denotes this verdict-position logit difference, including the preceding reasoning context. The generative objective follows the same formulation as binary IPT. We replace the document-level classification loss

2 We additionally evaluate a Gradient Reversal Layer (GRL) control that ex-

plicitly suppresses original-authorship information in the learned representation; see Appendix Section B.1.

6

Table 3: Comparison of selected GEO detectors and our proposed methods. WGA denotes worst-group accuracy, while ∆FPR and ∆TPR measure absolute error-rate gaps between AIand human-authored groups.

Lcls with the completion-only language-modeling loss LLM over the reasoning sequence and final verdict: gen LIPT = LLM + αL+ + βL0 .

(6)

Overall Performance Shortcut Diagnostics

The positive and zero losses retain the definitions in Equation 2 and Equation 3, using the score in Equation 5. The language-modeling loss is computed over all training documents, irrespective of whether they participate in an intervention pair. Thus, documents with available pairs receive additional intervention-level supervision, whereas unpaired documents receive only the standard language-modeling objective and reduce to ordinary SFT.

3.2

Method

GEO Flagging Evaluation

Experimental Settings. All experiments use the same fixed query-disjoint split described in Section 2.3, containing 2,238 training documents and 962 test documents. The detection threshold is 0.5. We fine-tune ModernBERT-base and Qwen3-0.6B. For all models, we use a learning rate of 2 × 10−5 , margin m = 2, α = 1, and β = 1. For ModernBERT-base, we use an 8,192token context and for Qwen3-0.6B, we use a 4,096-token context and LoRA rank 16. Results. IPT improves both overall performance and shortcut diagnostic metrics. For ModernBERT, IPT increases accuracy from 0.839 to 0.931 and F1 from 0.862 to 0.944. The improvement is also clear in the shortcut diagnostics: WGA rises from 0.725 to 0.883, while ∆FPR and ∆TPR decrease from 0.263 and 0.117 to 0.108 and 0.062, respectively. Qwen does not outperform ModernBERT, but when using IPT, the performance also improves. Compared with QwenSFT, Qwen-IPT improves accuracy from 0.778 to 0.860 and F1 from 0.833 to 0.883, while increasing WGA substantially from 0.325 to 0.775. At the same time, ∆FPR drops from 0.413 to 0.158 and ∆TPR from 0.105 to 0.033. Qwen Zero-shot has very small ∆FPR and ∆TPR, but its WGA is only 0.008, indicating that the small group gaps mainly result from poor classification performance rather than genuine robustness to authorship shortcuts. GRL shows the same overall trend, but the gains are smaller. ModernBERT-GRL reaches 0.876 accuracy and 0.897 F1, improves WGA to 0.783, and reduces ∆FPR and ∆TPR to 0.171 and 0.069. Overall, the results show that IPT improves performance across different GEO methods and authorship conditions without disproportionately favoring any single group.

3.3

Acc.

F1

WGA↑ ∆FPR↓ ∆TPR↓

Selected baselines ModernBERT (1K) 0.842 ModernBERT (8K) 0.839 Qwen Zero-shot 0.627 Qwen SFT 0.778 TF-IDF char (2–4) + LR 0.848 TF-IDF word (1–2) + LR 0.846 Pangram 0.838

0.864 0.862 0.770 0.833 0.878 0.880 0.876

0.725 0.725 0.008 0.325 0.575 0.375 0.192

0.271 0.263 0.000 0.413 0.346 0.558 0.767

0.121 0.117 0.006 0.105 0.077 0.111 0.099

Fine-tuned models with GRL/IPT ModernBERT-GRL 0.876 ModernBERT-IPT 0.931 Qwen-IPT 0.860

0.897 0.944 0.883

0.783 0.883 0.775

0.171 0.108 0.158

0.069 0.062 0.033

intervention-based training objective of IPT remains effective when the prediction target additionally distinguishes among different GEO method families. IPT for Attribution. We adapt IPT to the seven-class attribution task while preserving its intervention-based constraints. Let ℓc (x) denote the logit for class c. To apply the pairwise IPT objectives, we aggregate the attribution logits into a binary GEO score: zθ (x) = log

∑ exp(ℓc (x)) − ℓnon-GEO (x),

(7)

c∈CGEO

where CGEO contains the six GEO attribution classes. The standard classification loss is replaced by seven-class crossentropy, while the positive and invariant pair constraints are applied to zθ (x) as in the binary setting. Experiment Settings. We use the same query-level training and test split as in Section 2. The baseline methods follow the same preprocessing procedures, model configurations, context lengths, feature extraction settings, and training hyperparameters described in Section 2. For supervised classifiers, we replace the binary target with the seven attribution classes while keeping the remaining configuration unchanged. For IPT, we use the same settings in Section 3.2. We report macro F1 and accuracy as the primary attribution metrics. Results. On the seven-class attribution task, IPT substantially improves the model’s ability to identify which GEO method produced a given page. As shown in Table 4, ModernBERT IPT achieves a Macro F1 of 0.895 and an accuracy of 0.906, improving over the same ModernBERT backbone with SFT by 0.122 and 0.076, respectively, while also clearly outperforming the feature-based and general-purpose LLM baselines. Importantly, this gain is reflected in more balanced per-class performance. As shown in Table 16, SFT already performs well on Non-GEO, AutoGEO, and Pool, but remains considerably weaker on RAID, Meta, and Human, with recall on the Human class reaching only 0.333. IPT raises the recall of RAID, Meta, and Human to 0.909, 0.917, and 0.759, respectively, while maintaining recall between 0.855 and 0.906 on AutoGEO, Pool, and PMA. The per-class precision results in Table 17 show a similar pattern:

GEO Attribution Evaluation

Task Description. We further evaluate whether IPT extends beyond binary GEO detection by considering a multiclass GEO attribution task. Given the text of a webpage, the model predicts one of seven classes: non-GEO, AutoGEO, GEO Strategy Pool, PMA, RAID, Meta-Optimization, or Humanbased GEO. Stealthy AutoGEO is grouped with AutoGEO, and Stealthy GEO Strategy Pool is grouped with GEO Strategy Pool. This setting allows us to examine whether the 7

Table 4: Results on the seven-class attribution task. Configuration TF-IDF Character 2–4 with LR TF-IDF Word 1–2 with LR Ghostbuster features, recalibrated Structural features with XGBoost GPT-2 perplexity features with LR Gemini-3.5-flash Haiku-4.5 ModernBERT SFT ModernBERT IPT

• Sentence level: the best Citation URL Verifiability label (H IGH, M EDIUM, or L OW) among all Citations attached to the same sentence.

Macro F1 Accuracy 0.612 0.562 0.286 0.573 0.226 0.315 0.314 0.773 0.895

0.730 0.710 0.545 0.648 0.497 0.500 0.402 0.830 0.906

Metric Definitions. URL Source Tier characterizes the publisher behind a Citation URL based on its publication and review process. It is designed to distinguish sources with strong institutional or editorial control from sources that are easier to create, edit, or contribute to. The full C1–C3 definition is given in Table 20. Citation URL Verifiability combines URL Source Tier with the observed retrieval state. This design treats source authority and accessibility as separate factors. An authoritative source that cannot be accessed is harder for a reader to verify directly, while an accessible source with limited editorial control may be easy to inspect but still offers weaker assurance about how its content was produced. The complete mapping is given in Table 21. For a sentence s with Citation URL labels V (s) = v1 , . . . , vn , we define

IPT achieves at least 0.804 precision for every class, including 0.985 for PMA and 0.984 for RAID. At the same time, these improvements do not come at the expense of distinguishing Non-GEO pages, for which IPT retains a recall of 0.950 and a precision of 0.891. Overall, the results suggest that IPT learns more than a coarse distinction between GEO and Non-GEO content; it also captures discriminative signals associated with different GEO optimization mechanisms, enabling substantially stronger fine-grained attribution.

Vbest (s) = max vi , vi ∈V (s)

4

A GEO-Gated Agent System for Assessing Citation URL Verifiability

4.1

(8)

where HIGH > MEDIUM > LOW. We use the best label because the sentence-level metric asks whether at least one comparatively verifiable source is available; additional weaker Citations should not reduce that assessment.

Motivation and Audit Scope

Motivation. GEO flagging tells us whether a page may have been optimized for generative search, but it does not tell us whether the cited URLs on that page are trustworthy. This matters because GEO can make weak or false information appear well supported. For example, an operator can first publish a false claim on a website that is easy to create or edit, and then cite that page from another website [8, 14]. The citation URL is real, and the cited page may directly support the claim, but the source itself was created to support that claim. Therefore, we also need to know what kind of URLs the citation points to and how easily that source can be created or edited. We therefore develop a GEO-gated Agent system that first identifies GEO pages and then assesses the verifiability of their Citation URLs. Audit Outputs. Given a webpage, our system first determines whether it passes the GEO gate and, if so, audits every parsed Citation URL on the page.3 The audit produces three outputs:

4.2

Test Dataset Building

Dataset Design. The new dataset derives from 281 queries across the same four domains as GEOFlagBench: 54 in Finance, 68 in Health, 97 in Technology, and 62 in Travel. These queries do not overlap with the 400 queries used in GEOFlagBench, preventing potential query overlap and information leakage. We collect one non-GEO page for each query, and then generate one corresponding GEO variant. The process follows the settings in Section 2.2. Similarly, the 281 non-GEO pages are collected from snapshots dated before October 2022. In total, the dataset contains 562 pages. Annotation of Citation URLs and Sentences. Among the 281 GEO pages, 129 contain at least one Citation, yielding 1,449 cited sentences and 2,160 Citation occurrences. Two annotators independently assign Source Tiers to the cited sources according to Table 20, without seeing each other’s decisions or the GEO method used to produce the page. A third annotator adjudicates all disagreements, and the final Source Tier is determined by majority vote. The two primary annotators achieve 80.39% agreement on Source Tier, with Cohen’s κ = 0.695. We determine URL access status using a deterministic retriever. For each Citation URL, it performs an HTTP GET with redirects, a 20-second timeout, and up to two attempts; if live retrieval fails, it queries the Internet Archive for an available snapshot. Citation URL Verifiability is then derived deterministically from Source Tier and retrieval status, and sentencelevel best verifiability is derived from the resulting Citation URL labels. To measure how Source Tier disagreement propagates to these downstream labels, we apply the same

• Page level: a GEO label (GEO or N ON -GEO), together with the predicted GEO probability. • Citation-URL level: a URL Source Tier (C1, C2, or C3) and a Citation URL Verifiability label (H IGH, M EDIUM, or L OW) for each Citation occurrence. The three tiers represent decreasing levels of source authority and editorial control, with C1 being the strongest and C3 the weakest. 3 We do not assess whether a cited claim is factually correct or whether the

content of a citation URL semantically supports the claim. These problems have been extensively studied in natural language processing and are outside the scope of our audit.

8

4.4

retrieval and aggregation rules separately to each primary annotator’s Source Tier assignments. The resulting agreement is 84.16% for Citation URL Verifiability and 84.90% for sentence-level best verifiability, with Cohen’s κ values of 0.751 and 0.760, respectively.

4.3

Evaluation

Experimental Settings. We apply the ModernBERT-IPT classifier from Section 3 as the detector in the GEO gate module. All LLMs involved have a temperature of zero. We report the performance of six frontier LLMs: Kimi K3, Qwen 3.6 35B-A3B, GLM 5.2, Claude Haiku 4.5, GPT 5.6 Luna, and Gemini 3.5 Flash.

System Design

We report page-level accuracy and macro F1 for the shared GEO gate. For the Agent stage, we report accuracy and macro F1 for Source Tier, Citation URL Verifiability, and cited sentence best verifiability.

The system consists of four modules, as illustrated below. Module 1: GEO Gate. The first module determines whether a webpage enters the citation URL audit. Given the captured page content, a GEO detector predicts whether the page is GEO or Non-GEO. Pages predicted as N ON -GEO are returned as SKIPPED_NOT_GEO, while pages predicted as GEO are passed to the next module. This gate limits the more expensive citation URL audit to pages that exhibit GEO signals.

GEO Gate Performance. Among the 562 test pages, 281 are gold-labeled GEO pages. The GEO gate predicts 253 pages as GEO, correctly identifying 250 of the 281 GEO pages while producing only three false positives and missing 31 GEO pages. This corresponds to 93.95% accuracy, 93.94% macro F1, 98.81% GEO precision, and 88.97% GEO recall.

Module 2: Citation URL Preprocessing. The preprocessing module constructs sentence–citation URL pairs from each GEO page. A preprocessing Agent invokes a deterministic parser that extracts citations, resolves and canonicalizes their URLs, segments the page into sentences, and associates each citation with the sentence in which it appears. It also resolves relative URLs and removes known tracking parameters. If no citation URL is found, the page is returned as NO_CITATION.

Among the 253 pages predicted as GEO, 109 contain at least one citation and therefore enter the Agent stage. Of these, 106 are gold-labeled GEO pages, and three are falsepositive non-GEO pages. Across all 129 gold-labeled GEO pages containing citations, the gate therefore exposes 106 pages (82.17%) to the Agent. These correctly gated pages contain 1,653 of the 2,160 citation occurrences (76.53%) and 1,104 of the 1,449 cited sentences (76.19%) in the full goldlabeled GEO citation set.

Module 3: Citation URL Labeling. The labeling module produces the two primitive labels used by our Verifiability metric: URL access status and source tier. A coordinating Agent sends each unique citation reference to two specialized subagents.

Citation URL Labeling Performance. Table 5 reports conditional Agent performance on citation occurrences and cited sentences from gold-labeled GEO pages correctly detected by the GEO gate. The evaluation therefore isolates the labeling capability of the Agent after a page enters the citationaudit stage.

The ACCESSIBILITY subagent invokes a deterministic URL retriever. The retriever follows redirects, uses fixed timeouts and retries, and records the resolved URL and retrieval metadata. Its outcome is mapped to one of six states: LIVE, ARCHIVED_ONLY, BLOCKED, HTTP_404, DOMAIN_NXDOMAIN, or TIMEOUT.

GLM 5.2 performs best across all three outputs. For Source Tier classification, it achieves 84.75% accuracy and 84.02% macro F1. For Citation URL Verifiability, it achieves 83.00% accuracy and 83.20% macro F1, while its sentencelevel verifiability accuracy and macro F1 are 83.15% and 83.26%, respectively. Compared with the second-best model, GLM 5.2 improves accuracy by 6.29 percentage points for Source Tier, 6.35 points for Citation URL Verifiability, and 5.07 points for sentence-level verifiability, showing a consistent advantage across all three labeling tasks.

The SOURCE TIER subagent assigns C1, C2, or C3 according to Table 20. It receives the citation URL, domain, citedsentence context, and retrieved metadata. The system also supports a web-search tool and a source-list database with allowlist and blocklist entries for additional publisher information. For all experiments reported in this paper, however, web search is disabled and both source lists are empty. The source tier decision therefore relies only on the supplied citation evidence and the fixed tier policy.

GLM 5.2 also maintains strong class-level performance. For Source Tier, recall is 94.77% for C1, 85.05% for C2, and 71.46% for C3, with corresponding precision values of 88.46%, 76.86%, and 90.39%. In particular, C3 predictions achieve high precision despite the lower recall, indicating that the model is selective when assigning the most weakly accountable source tier. For Citation URL Verifiability, recall is 90.27% for HIGH, 84.67% for MEDIUM, and 75.84% for LOW, while precision reaches 79.04%, 79.45%, and 92.47%, respectively. The high precision for LOW similarly indicates that LOW predictions are highly reliable when produced. Overall, these results show that GLM 5.2 provides strong aggregate performance.

Module 4: Verifiability Aggregation. The final module derives the audit labels using fixed rules. For each citation URL, verifiability is computed deterministically from its source tier and retrieval state according to Table 21. The agent therefore never directly predicts H IGH, M EDIUM, or L OW. For a sentence containing multiple citations, we apply Equation 8 and report the highest verifiability among its citation URLs. The final output reports the GEO decision for each page, the source tier, retrieval state, and Citation URL Verifiability for each citation URL, and the best verifiability label for each cited sentence. 9

Table 5: Conditional labeling performance on 1,653 citation occurrences and 1,104 cited sentences from gold-labeled GEO pages correctly detected by the GEO gate. Each cell reports accuracy / macro F1 (%). Agent Model

Source Tier

Citation URL Verifiability

Sentence Verifiability

GLM 5.2 Kimi K3 Qwen 3.6 35B-A3B GPT 5.6 Luna Claude Haiku 4.5 Gemini 3.5 Flash

84.75 / 84.02 78.46 / 76.43 77.37 / 75.69 76.77 / 75.03 73.93 / 71.39 62.07 / 58.10

83.00 / 83.20 76.65 / 76.78 76.10 / 76.54 75.32 / 75.50 72.60 / 72.50 62.31 / 63.05

83.15 / 83.26 78.08 / 77.53 77.36 / 77.05 76.27 / 75.55 73.37 / 73.13 63.04 / 64.50

Table 6: Measured wall-clock time and estimated inference cost for the citation audit under the evaluated serving configurations. Agent Model Gemini 3.5 Flash Claude Haiku 4.5 GPT 5.6 Luna GLM 5.2 Kimi K3 Qwen 3.6 35B-A3B

5

Time

Estimated Cost

21.47 min 25.91 min 28.78 min 29.92 min 101.76 min 101.86 min

$5.8136 $3.7909 $3.1712 $3.7228 $12.3641 $2.2799

Gemini URL lists released by Grossman et al. [20]. The Google Search channel contains landing-page links from the conventional Google Search results page [20, 38]. The Gemini channel contains source links attached to Gemini 2.5 Flash answers generated with Google Search grounding [16, 20]. Google Search grounding allows Gemini to retrieve web sources and attach those sources to its answer. Google Search provides at least one released URL for all 1,000 sampled queries. Gemini provides at least one released URL for 979 queries. The other 21 Gemini records contain no released URL. The release does not distinguish an answer without source links from a collection failure. We retain all 1,000 queries in the Google Search analysis and use the 979 queries with released links in the Gemini analysis. We do not treat an empty Gemini record as a query with a zero GEO rate. The two channels contain 16,568 URL occurrences in total. Google Search contributes 7,856 unique URLs, and Gemini contributes 8,591 unique URLs. Their union contains 13,985 unique URLs because some pages appear in both channels. We preserve every query, channel, rank, and URL association for exposure and paired-query analyses. We assign one identifier to each normalized URL so that a shared page is fetched and analyzed once. Page Collection and Recovery. We fetched the current page versions from 28 to 31 July 2026. The initial deterministic fetcher followed redirects, respected robots policies, recorded HTTP outcomes, and extracted the main text as Markdown. An extraction was initially considered usable when it contained at least 300 characters of page text. We applied several recovery stages to pages without usable text. The first stage rendered eligible pages in Chrome and blocked images, media, and fonts. The second stage retried transient failures and extracted text from PDF files. The third stage targeted unresolved navigation and extraction failures. The final stage reviewed every remaining extraction below 300 characters and retained only pages with meaningful page content. We define meaningful content as a coherent representation of the requested public page that agrees with its URL or title and contains page-specific facts or usable functionality. Navigation-only text, cookie notices, login or payment forms, access challenges, error messages, loading shells, unrelated fragments, and isolated metadata are not meaningful page content. Text length alone did not determine this decision, so a complete and identifiable public page below 300 characters could be retained. We did not bypass robots policies, authentication, paywalls, CAPTCHAs, or terminal HTTP errors. The initial and browser stages retained 7,896 unique

Empirically Estimating GEO Prevalence in Real-World Search Results

Using the GEO detection and Citation URL verifiability pipeline developed in Section 4, we conduct a real-world audit of pages linked by conventional Google Search and Gemini-grounded search. We estimate the prevalence of GEO signals across the two retrieval channels. We also examine how the detection rates vary with declared modification time and publishing environment. For detected GEO pages, we further audit the URL Source Tier and Citation URL Verifiability labels.4

5.1

Experimental Settings

Query Sampling and Retrieval Channels. We use the 5,000-query ORCAS subset released by Grossman et al. [20]. ORCAS contains clicked query and document pairs collected from real Bing users [12]. The released subset therefore represents historical real-user queries rather than current query trends. We normalize each query by case folding, trimming surrounding spaces, and collapsing repeated spaces. This process identifies one duplicate and leaves 4,999 eligible queries. We sample 1,000 queries through proportional stratified random sampling [11]. Each stratum combines an upstream intent label with a query length bin. The intent labels are Factual, Instrumental, Navigational, Transactional, and Abstain. The length bins contain one, two, three, four, five, or at least six query terms. We assign integer stratum quotas with the Hamilton largest-remainder method [6]. We use a fixed random seed of 20260728. The selection does not use released URLs, result ranks, retrieval outcomes, or GEO predictions. For each selected query, we use the Google Search and 4 We report these results as estimates rather than definitive measurements for

two reasons. The live pages lack GEO gold labels. The GEO detector and the Citation URL audit pipeline can also make prediction errors.

10

Table 7: Final reasons for unavailable page content.

Table 8: Page retrieval coverage by channel.

Final Outcome

URLs

Share

Channel

Queries

URLs

Pages Coverage

Persistent HTTP 403 2,082 Robots policy unavailable or denied 811 Navigation or network failure 226 Insufficient or nonmeaningful content 225 Missing or removed page 203 Authentication or payment required 163 Other HTTP failure 93 CAPTCHA, region block, or interstitial 67 Other content or recovery failure 20

53.52% 20.85% 5.81% 5.78% 5.22% 4.19% 2.39% 1.72% 0.51%

Google Search Gemini

1,000 979

7,856 8,591

5,421 6,590

69.00% 76.71%

Unique union

1,000 13,985 10,095

72.18%

3,890 100.00%

Google Search Gemini Unique union

15

Detected GEO pages

GEO rate (%)

Total

120

20

10 5

Google Search only Gemini only Both channels

100 80 60 40

21

20 4

0

0 2023

2024

2025

2026

2023

(a) GEO Detection Rate

2024

2025

2026

Year

Year

pages. Broad recovery added 2,063 pages. After the initial and browser stages, 6,089 URLs had no usable content. Broad recovery attempted 5,775 of these URLs and retained 2,063, which gives a recovery rate of 35.72% among attempted URLs. The other 314 URLs had terminal or policy outcomes that were outside the permitted recovery procedure. Targeted recovery added 110 pages. Targeted recovery attempted 529 unresolved URLs and retained 110, which gives a recovery rate of 20.79%. The short-content review added 26 pages. The short-content stage reviewed all 171 remaining candidates below 300 characters in the two-channel URL set. It retained 22 recovered pages and four complete pages from the original extraction, for a total of 26 meaningful pages and a retention rate of 15.20%. The final corpus therefore contains 10,095 usable pages from 13,985 unique URLs, which gives 72.18% retrieval coverage. The channelspecific and union coverage values are summarized in Table 8. The remaining 3,890 URLs did not yield usable page content. We assign each unavailable URL to its last recorded outcome after all permitted recovery stages and report them in Table 7. Pipeline Configuration. We apply the frozen pipeline from Section 4 without retraining or audit-specific calibration. Every usable page first passes through the GEO detector. Only pages detected as GEO enter the deterministic cited-sentence parser and the GLM 5.2 Citation URL audit. We use the URL Source Tier and Citation URL Verifiability definitions from Section 4. Analysis Units and Statistical Procedures. The primary page-level estimate uses the 10,095 unique pages in the channel union. A shared page contributes once to this estimate. Each channel-specific page-level GEO estimate in Table 9 includes all usable pages returned by that channel. A shared page contributes once to each channel that returned it. Among the 979 queries with at least one released URL from each channel, 965 yield at least one usable page in each channel and enter the paired analysis. For the other 14 queries, both channels provide URLs, but all URLs from one channel fail to yield a usable page. Eight queries have no usable conventional Google Search page, and six have no usable Gemini page. For each retained query, we compute the fraction of usable pages detected as GEO in each channel. We then average these fractions across queries. We compute the 95% interval for the difference with 10,000 paired bootstrap samples and a fixed seed of 20260801. For the modification-time analysis, the unit is one usable

105

74

(b) Detected GEO Page Count

Figure 1: GEO prevalence by declared dateModified year. Panel (a) reports the detection rate for Google Search, Gemini, and their unique union. Panel (b) partitions the unique-union GEO count into three mutually exclusive exposure groups, so each stacked total equals the corresponding union count. Pages without a parseable dateModified value are omitted: the unique union contains 8,119 such pages and 682 GEO detections (8.40%), Google Search contains 4,563 and 355 (7.78%), and Gemini contains 5,153 and 434 (8.42%).

page. We group a page by year only when its metadata contains a parseable dateModified value. A page enters the missing group when this field is absent or invalid. We do not replace it with datePublished, because publication time and modification time describe different events. For the Citation URL analysis, the unit is one Citation occurrence extracted from a page detected as GEO. The same Citation URL is counted again when it appears as another Citation occurrence, including in another cited sentence or on another page. For channel-specific results, a Citation on a page returned by both channels contributes once to the Google Search row and once to the Gemini row. The uniqueunion result includes that shared page once and therefore counts the Citation once. The audit progress and the distinction between Page URLs returned by search systems and Citation URLs embedded in the fetched page content are summarized in Figure 3 of Appendix C.

5.2

Estimated GEO Prevalence

Retrieval Channels. The pipeline detects 898 of the 10,095 unique pages as GEO, corresponding to an overall prevalence estimate of 8.90% (95% Wilson CI [44]: [8.36%, 9.47%]). However, the aggregate estimate masks a systematic difference between retrieval channels. As shown in Table 9, GEO is detected in 8.14% of Google Search pages and 9.09% of Gemini pages, a page-level difference of 0.95 percentage points. This difference persists and becomes larger after accounting for unequal numbers of retrieved pages across queries. For each of the 965 queries with at least one usable page from both channels, we compute the within-query GEO fraction for each channel and then average these fractions 11

Table 9: GEO estimates and comparisons between retrieval channels. Setting

Google Search

Gemini

Unique Union

Gemini − Google

95% CI

Page-level estimate Paired-query macro (n = 965)

441/5,421 (8.14%) 7.91%

599/6,590 (9.09%) 9.34%

898/10,095 (8.90%) N/A

0.95 pp 1.43 pp

N/A [0.46, 2.41] pp

Table 10: Largest domains in the unique-page union. Domain

Pages GEO GEO Rate

en.wikipedia.org youtube.com my.clevelandclinic.org webmd.com healthline.com medicalnewstoday.com pmc.ncbi.nlm.nih.gov amazon.com nhs.uk Citation occurrence share (%)

These results indicate that GEO is unevenly represented across retrieval channels, with Gemini exhibiting consistently higher GEO prevalence than Google Search. The persistence of this difference under the query-balanced comparison suggests that the two channels are affected by GEO to different degrees, rather than the observed gap being driven solely by differences in retrieval volume across queries. Modification Time. A parseable dateModified value is available for 1,976 of the 10,095 unique pages, corresponding to 19.57% metadata coverage.

80

4,587

60 40 20

1,212

864

0

C1

C2

C3

(a) URL Source Tier

613 434 106 78 73 61 58 54 53 Citation occurrence share (%)

across queries, giving every query equal weight. The resulting macro rates are 7.91% for Google Search and 9.34% for Gemini, corresponding to a Gemini–Google difference of 1.43 percentage points (paired-bootstrap 95% CI: [0.46, 2.41] pp).

0 19 0 0 0 2 0 11 0

0.00% 4.38% 0.00% 0.00% 0.00% 3.28% 0.00% 20.37% 0.00%

80

4,620

60 40 20

1,038

1,005

HIGH

MEDIUM

0

LOW

(b) Citation URL Verifiability

Figure 2: Citation URL labels among the 6,663 Citation occurrences in the unique-page union. Bar heights report shares, and values above bars report occurrence counts. The panels show separate marginal distributions; category positions do not denote one-to-one mappings.

As shown in Figure 1, estimated GEO prevalence is relatively low in 2023, but increases markedly from 2024 onward. In the unique union, the estimated rate rises from 7.02% in 2024 to 12.80% in 2025 and 16.36% in 2026. The same temporal pattern appears in both retrieval channels, with 2026 estimates reaching 13.52% for Google Search and 18.20% for Gemini. These results suggest that GEO is more prevalent among recently modified pages.

Takeaway Within the data used in our estimation, more than 8% of pages returned by both conventional Google Search and Gemini-grounded search are estimated to exhibit GEO, with a higher estimated prevalence for Gemini-grounded search. In addition, both the count and proportion of pages estimated to exhibit GEO have increased year by year since 2024.

Domain-Level Variation. To examine domain-level variation, we report all domains with more than 50 successfully retrieved usable pages in the unique-page union. As shown in Table 10, estimated GEO prevalence varies substantially across these frequently retrieved domains. Several large informational and health-related domains contain no detected GEO pages in our sample, whereas YouTube reaches 4.38% and Amazon reaches 20.37%. One possible explanation is that commercial and creator-driven platforms provide stronger incentives to optimize content for visibility in AI-mediated discovery. YouTube has introduced conversational search for video discovery alongside Gemini-powered tools for content creation and remixing [40]. For example, Amazon explicitly advises sellers that understanding how its generative shopping assistant interprets product information can help them create more effective listings [2, 3, 27], while YouTube has introduced Gemini-powered conversational search for video discovery [40]. While our data cannot establish the intent behind individual pages, these developments provide a plausible explanation for why GEO may be more prevalent on commercially or visibility-driven platforms.

5.3

Estimated Verifiability of Citation URLs

This analysis applies to the 898 pages detected as GEO in the preceding analysis. Among them, 489 contain at least one parsed Citation. The other 409 pages contain no parsed Citation and do not enter the Citation URL analysis. The unique union contains 6,663 Citation occurrences. All subsequent tables in this subsection use Citation occurrences as the analysis unit, so repeated uses of the same Citation URL are counted separately. URL Source Tier characterizes the accountability of the publisher behind a Citation URL, ordered from C1, the strongest tier, through C2 to C3, the weakest tier. Citation URL Verifiability then combines URL Source Tier with URL accessibility. Only a Citation URL assigned C1 whose destination content is directly accessible receives a HIGH label; restricted C1 URLs and existing C2 URLs re12

Table 11: Page and Citation URL label statistics by retrieval channel. The channel columns are not mutually exclusive: 142 GEO pages occur in both channels, including 82 pages with Citations and 771 Citation occurrences. Thus, the unique union contains 441 + 599 − 142 = 898 GEO pages and 2,162 + 5,272 − 771 = 6,663 Citation occurrences. Metric

Takeaway Based on our estimates, overall, more than 65% of Citation URLs used on pages detected as GEO have LOW verifiability, and this proportion is even higher for GEO pages returned by Gemini-grounded search.

Google Search Gemini

6

Page and Citation Volume Detected GEO pages GEO pages with Citations GEO pages with Citations (% of GEO pages) Citation occurrences Citations per detected GEO page Citations per cited GEO page

441 599 236 335 53.51% 55.93% 2,162 5,272 4.90 8.80 9.16 15.74

URL Source Tier (Share) C1 C2 C3

37.79% 13.01% 17.07% 13.16% 45.14% 73.82%

Citation URL Verifiability (Share) HIGH MEDIUM LOW

32.84% 11.42% 21.28% 14.43% 45.88% 74.15%

Related Work

Generative Search. Generative search retrieves external sources and uses them to produce a direct answer to the user’s query [24]. Prior work has examined whether the cited sources actually support the generated content and found substantial citation and attribution errors [25]. Other studies show that generative search can retrieve substantially different sets of sources from conventional web search and may also vary across repeated executions [23]. Generative Engine Optimization. Generative Engine Optimization was introduced as a creator-side approach for improving the visibility of content in generative search responses [1]. Since then, the scope of GEO has broadened beyond relatively simple content rewriting. Prompt injections in retrieved webpages can change how conversational search systems rank results [33]. Adversarial changes to web content can also influence which sources or plugins these systems select [29]. More recent systems automate the optimization process by learning engine preferences and using them to rewrite webpages accordingly [45]. However, these optimization strategies do not always work consistently across tasks and domains, and their benefits may diminish as more publishers adopt them [34]. GEO Detection. Compared with GEO optimization, direct detection of GEO is still underexplored. Existing benchmarks mostly focus on whether GEO or ranking attacks are effective, rather than on detecting whether a webpage has been modified using GEO methods. For example, GEO-Bench evaluates standardized ranking attacks and their stealth characteristics [30], while SafeGEO studies whether recommendation agents remain robust when seller-controlled evidence is strategically rewritten [43]. Machine-generated text detection is also related, but it addresses a different question: whether text was produced by a model, not whether content of any authorship was later optimized for generative search [28, 41]. Accordingly, we formulate page-level GEO detection as a distinct task and evaluate it across multiple optimizer families.

ceive MEDIUM, while C3 URLs and URLs whose existence cannot be established receive LOW. The formal definitions of URL Source Tier and Citation URL Verifiability are provided in Appendix D.5 URL Source Tier and Verifiability. The overall distribution (Figure 2) shows that 68.84% are assigned to C3 sources and 69.34% receive LOW verifiability. All C3 occurrences are labeled LOW, while only 33 C1 or C2 occurrences become LOW because their destinations are nonexistent or cannot be resolved sufficiently. Thus, publisher accountability is the main driver of LOW labels in this corpus, while URL accessibility failures contribute only a small additional share. The comparison between retrieval channels (Table 11) shows a clear difference in both Citation density and source composition. GEO pages returned by Gemini contain 1.80× more Citation occurrences per detected GEO page than those returned by Google Search (8.80 vs. 4.90), even though the share of GEO pages containing at least one Citation differs by only 2.42 percentage points (55.93% vs. 53.51%). Gemini also has a substantially larger C3 share than Google Search (73.82% vs. 45.14%) and a correspondingly larger LOW share (74.15% vs. 45.88%). The same pattern is stronger on channel-exclusive pages, where C3 accounts for 80.23% of Citation occurrences on Gemini-only pages, compared with 49.96% on Google-only pages and 36.45% on shared pages. Overall, GEO pages returned by Gemini contain more Citations and rely much more heavily on C3 sources than those returned by Google Search. Accordingly, Gemini-exposed Citations receive LOW verifiability labels substantially more often.

7

Discussion and Limitations

GEO Detection Is Distinct from AI-Text Detection. Our results show that GEO detection is different from AI-text detection. GEO concerns whether content has been optimized for generative search, rather than whether the text was written by a human or generated by AI. Both human- and AIauthored pages can undergo GEO optimization. At the same time, AI-generated or AI-polished pages can remain nonGEO. A detector that relies on authorship cues may therefore achieve strong overall performance but perform poorly on some authorship groups. Future GEO detection bench-

5 This measure does not assess whether the cited sentence is true or whether

the content at the Citation URL supports it.

13

marks should control for authorship and include paired interventions, sparse modifications, and human-executed GEO strategies. Use and Interpretation of GEO Flagging. GEO is not inherently malicious, and detecting GEO does not mean that a webpage contains false, misleading, or harmful information. Publishers may use GEO techniques for legitimate purposes, such as improving content structure or visibility in generative search. Our system is therefore intended to support transparency and risk analysis rather than automatic blocking or content removal. The GEO detector identifies pages that show signs of optimization for generative search. The citation audit then provides additional information about the accessibility of cited URLs and the accountability of their publishers. A C3 Source Tier or LOW Citation URL Verifiability label indicates weaker publisher accountability or limited citation accessibility under our definitions. It does not show that the cited information is false or unsupported. Generalization to Future GEO Strategies. GEO strategies may change over time, especially as generative search systems and GEO detectors evolve. Our benchmark covers eight optimizer families, but future GEO methods may use different optimization goals, smaller changes, or strategies designed to avoid detection. Our results on sparse and human-executed GEO methods already show that small or less systematic changes can be harder to detect. Interventionpaired training provides one way to update the detector. New GEO procedures can be added as new pairs of original and optimized pages without changing the definition of the task. However, strong performance on the current benchmark does not guarantee similar performance on unseen GEO strategies. Limits of the Real-World Estimates. Our real-world measurements estimate the prevalence of pages classified as GEO by our detector. They do not directly measure whether publishers intentionally applied GEO. The analyzed pages do not have ground-truth GEO labels, so errors from the GEO detector can affect the prevalence estimates. Errors from the GEO detector and Citation URL Agent can also affect the downstream citation analysis. Only 19.57% of usable pages expose a parseable dateModified value. This field is provided by the publisher and records when a page was modified. It does not indicate when or whether GEO was applied. The increase observed from 2024 to 2026 should therefore be treated as a descriptive trend among pages with usable modification metadata. It does not by itself show that GEO adoption increased over this period. Citation URL Verifiability also has a limited scope. It combines Source Tier with URL accessibility to describe whether a citation destination can be accessed and how accountable its publisher is under our definitions. It does not determine whether the cited sentence is factually correct or whether the destination supports the cited claim. URL accessibility can also change over time because pages may be edited, removed, archived, or placed behind access controls.

8

a benchmark covering diverse domains and optimization strategies, and use it to evaluate existing GEO detection methods. Our results show that strong aggregate performance can mask substantial method-level weaknesses and reliance on authorship-related shortcuts. To address this limitation, we propose IPT, which explicitly supervises detector responses to GEO and non-GEO transformations. IPT substantially improves both overall detection performance and robustness across authorship groups. We further develop a GEO-gated Agent system that extends page-level detection to auditing the Source Tier and verifiability of Citation URLs used by detected GEO pages. Finally, we deploy the complete pipeline on released Google Search and Geminigrounded retrieval results. We estimate that 8.90% of the analyzed pages are GEO-optimized, with the estimate reaching 16.36% among pages declaring a 2026 modification date. We hope this work contributes to greater transparency and more responsible practices in generative search and corresponding content optimization.

Ethical Considerations Our study analyzes publicly accessible webpages and synthetically generated or modified webpages; it does not involve recruiting or interacting with human subjects. We collect only content necessary for studying GEO detection and citation behavior and do not attempt to infer sensitive attributes about individual authors or users. We also considered potential downstream misuse. In particular, our benchmark and detection methods could provide limited feedback to parties seeking to make GEO content harder to detect. We mitigate this risk by focusing the paper on measurement and detection rather than providing operational guidance for evasion. The techniques used to construct GEO examples are based on existing or explicitly defined optimization strategies rather than vulnerabilities in deployed systems. Finally, our citation analysis evaluates properties such as source accountability and citation verifiability rather than the truthfulness of individual claims or the reputation of specific authors. We report results primarily in aggregate to reduce the risk of unfairly characterizing individual webpages or publishers. Overall, we believe the primary benefits of enabling systematic study and auditing of GEO practices outweigh these limited risks.

References [1] Pranjal Aggarwal, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, Karthik Narasimhan, and Ameet Deshpande. GEO: Generative Engine Optimization. In ACM Conference on Knowledge Discovery and Data Mining (KDD), 2024. 1, 3, 4, 13, 16, 17, 18 [2] Amazon Seller Forums. Prime Day Prep: AI Tools to Improve Your Listings (3 of 3). https://sellercent ral.amazon.com/seller-forums/discussions/t /ba85d226-ac00-4f84-9292-27e65379c4cc, 2026. 12

Conclusion

This work presents a systematic study of detecting and auditing GEO-optimized content. We introduce GEOFlagBench, 14

[3] Amazon Seller Forums. Prime Day Prep: Optimize Your Listings for Search (2 of 3). https://seller central.amazon.com/seller-forums/discussio ns/t/011cf690-5c48-484a-8b59-6058690c07b6, 2026. 12

[16] Google. Grounding with Google Search. https://ai .google.dev/gemini-api/docs/google-search. 10 [17] Google. Search Quality Evaluator Guidelines. https: //guidelines.raterhub.com/searchqualityeva luatorguidelines.pdf, 2024. 3, 16

[4] Anthropic. Introducing Claude Haiku 4.5. https://ww w.anthropic.com/news/claude-haiku-4-5, 2025. 4

[18] Google. Gemini 3.5 Flash. https://ai.google.de v/gemini-api/docs/models/gemini-3.5-flash, 2026. 4

[5] Puneet S. Bagga, Vivek F. Farias, Tamar Korkotashvili, Tianyi Peng, and Yuhang Wu. E-GEO: A Testbed for Generative Engine Optimization in E-Commerce. CoRR abs/2511.20867, 2025. 3, 17

[19] GPTZero. AI Detection API. https://gptzero.me /developers. 4 [20] Riley Grossman, Songjiang Liu, Michael K. Chen, Mike Smith, Cristian Borcea, and Yi Chen. How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2026. 10

[6] Michel L. Balinski and H. Peyton Young. Fair Representation: Meeting the Ideal of One Man, One Vote. Brookings Institution Press, 2001. 10 [7] Guangsheng Bao, Yanbin Zhao, Zhiyang Teng, Linyi Yang, and Yue Zhang. Fast-DetectGPT: Efficient ZeroShot Detection of Machine-Generated Text via Conditional Probability Curvature. In International Conference on Learning Representations (ICLR), 2024. 4

[21] Moritz Hardt, Eric Price, and Nati Srebro. Equality of Opportunity in Supervised Learning. In Annual Conference on Neural Information Processing Systems (NIPS), pages 3315–3323. NIPS, 2016. 5

[8] Central News Agency. Advertisements Become AICited Content: Chinese State Media Criticizes GEO Software for Feeding False Information. https:// www.cna.com.tw/news/acn/202603160188.aspx, 2026. 1, 8

[22] Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. LoRA: Low-Rank Adaptation of Large Language Models. In International Conference on Learning Representations (ICLR), 2022. 6

[9] Tianqi Chen and Carlos Guestrin. XGBoost: A Scalable Tree Boosting System. In ACM Conference on Knowledge Discovery and Data Mining (KDD), pages 785–794. ACM, 2016. 4

[23] Elisabeth Kirsten, Jost Große Perdekamp, Qinyuan Wu, Mihir Upadhyay, Krishna P. Gummadi, and Muhammad Bilal Zafar. Characterizing Web Search in the Age of Generative AI. In Findings of the Association for Computational Linguistics: ACL (ACL Findings), pages 10827–10848. Association for Computational Linguistics, 2026. 13

[10] Xiaolu Chen, Haojie Wu, Jie Bao, Zhen Chen, Yong Liao, and Hu Huang. Role-Augmented IntentDriven Generative Search Engine Optimization. CoRR abs/2508.11158, 2025. 3, 17 [11] William G. Cochran. Sampling Techniques. John Wiley & Sons, 1977. 10

[24] Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. RetrievalAugmented Generation for Knowledge-Intensive NLP Tasks. In Annual Conference on Neural Information Processing Systems (NeurIPS). NeurIPS, 2020. 13

[12] Nick Craswell, Daniel Campos, Bhaskar Mitra, Emine Yilmaz, and Bodo Billerbeck. ORCAS: 18 Million Clicked Query Document Pairs for Analyzing Search. CoRR abs/2006.05324, 2020. 10 [13] Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), pages 4171–4186. ACL, 2019. 4

[25] Nelson F. Liu, Tianyi Zhang, and Percy Liang. Evaluating Verifiability in Generative Search Engines. In Findings of the Association for Computational Linguistics: EMNLP (EMNLP Findings), pages 7001–7025. Association for Computational Linguistics, 2023. 13 [26] Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR abs/1907.11692, 2019. 4

[14] Yiying Fan. ‘GEO’ Services Are Flooding the Chinese Internet With Misinformation. https://www.sixtht one.com/news/1018313, 2026. 1, 8 [15] Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario Marchand, and Victor Lempitsky. DomainAdversarial Training of Neural Networks. Journal of Machine Learning Research, 2016. 18

[27] Rajiv Mehta and Trishul Chilimbi. ’Amazon Rufus’ AI experience comes to the Amazon Shopping app. About Amazon. https://www.aboutamazon.com/news/r etail/amazon-rufus, 2024. 12 15

[28] Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, and Chelsea Finn. DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature. CoRR abs/2301.11305, 2023. 13

and-events/youtube-news-google-io-2026/, 2026. 12 [41] Vivek Verma, Eve Fleisig, Nicholas Tomlin, and Dan Klein. Ghostbuster: Detecting Text Ghostwritten by Large Language Models. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 2024. 4, 13

[29] Fredrik Nestaas, Edoardo Debenedetti, and Florian Tramèr. Adversarial Search Engine Optimization for Large Language Models. In International Conference on Learning Representations (ICLR), 2025. 1, 3, 13, 17

[42] Benjamin Warner, Antoine Chaffin, Benjamin Clavié, Orion Weller, Oskar Hallström, Said Taghadouini, Alexis Gallagher, Raja Biswas, Faisal Ladhak, Tom Aarsen, Griffin Thomas Adams, Jeremy Howard, and Iacopo Poli. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference. In Annual Meeting of the Association for Computational Linguistics (ACL), pages 2526–2547. Association for Computational Linguistics, 2025. 3

[30] Ojas Nimase, Zhe Chen, Gengpei Qi, Yue Zhao, and Xiyang Hu. GEO-Bench: Benchmarking Ranking Manipulation in Generative Engine Optimization. CoRR abs/2605.29107, 2026. 13 [31] OpenAI Community. roberta-base-openai-detector. ht tps://huggingface.co/openai-community/robe rta-base-openai-detector, 2019. 4 [32] Pangram Labs. AI Detection API. https://www.pang ram.com/solutions/api. 4

[43] Qianfeng Wen, Yifan Simon Liu, Xin Liu, Difan Jiao, Blair Yang, Junda Wu, and Zhenwei Tang. SafeGEO: Understanding Generative Engine Optimization Risks in Recommendation Agents. CoRR abs/2606.28356, 2026. 13

[33] Samuel Pfrommer, Yatong Bai, Tanmay Gautam, and Somayeh Sojoudi. Ranking Manipulation for Conversational Search Engines. In Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 9523–9552. Association for Computational Linguistics, 2024. 1, 13

[44] Edwin B. Wilson. Probable Inference, the Law of Succession, and Statistical Inference. Journal of the American Statistical Association, 1927. 11

[34] Haritz Puerto, Martin Gubri, Tommaso Green, Seong Joon Oh, and Sangdoo Yun. C-SEO Bench: Does Conversational SEO Work? In Annual Conference on Neural Information Processing Systems (NeurIPS). Curran Associates, Inc., 2025. 1, 13, 17

[45] Yujiang Wu, Shanshan Zhong, Yubin Kim, and Chenyan Xiong. What Generative Search Engines Like and How to Optimize Web Content Cooperatively. CoRR abs/2510.11438, 2025. 1, 3, 13, 17

[35] Qwen Team. Qwen3: Think Deeper, Act Faster. http s://qwenlm.github.io/blog/qwen3/, 2025. 3, 4

A

[36] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. Language Models are Unsupervised Multitask Learners. OpenAI blog, 2019. 4

A.1

Supplementary Details GEOFlagBench

for

Building

Domain Selection and Query Collection

We construct the benchmark across four domains (Health, Finance, Technology, Travel) that represent heterogeneous information environments and for which GEO effectiveness may differ [1]. Health covers medical and health-related information, while finance covers investment, banking, and personal-finance queries. These two domains represent consequential settings in which inaccurate information may affect users’ health or financial well-being [17, 39]. Technology captures technical and rapidly evolving information, and travel captures consumer-oriented, practical, and experiential information. We include exactly 100 queries per domain to ensure a balanced domain distribution and to prevent domain frequency from serving as a shortcut for the benchmark label. We aim to collect candidate general informational queries, defined as queries that seek factual information or explanatory content without targeting a specific destination, like a website or platform. We exclude queries that explicitly identify a target domain because they strongly constrain the expected source and document format. Using general informational queries allows each topic to be represented by content from different publishers. We first collect such queries from

[37] Shiori Sagawa, Pang Wei Koh, Tatsunori B. Hashimoto, and Percy Liang. Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization. In International Conference on Learning Representations (ICLR), 2020. 5 [38] SerpApi. Google Search API. https://serpapi.co m/. 10 [39] Tingyu Song, Guo Gan, Mingsheng Shang, and Yilun Zhao. IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACLHLT), pages 10186–10204. Association for Computational Linguistics, 2025. 3, 16 [40] The YouTube Team. All the YouTube News from Google I/O 2026. https://blog.youtube/news16

Table 12: Construction of the eight GEO optimizer families. Seed counts denote the numbers of human-written and AI-generated nonGEO documents used for each family. GEO labels are determined by recorded optimization interventions rather than textual style or detector predictions. We assign 200 documents to each family and 400 each to GEO Strategy Pool and AutoGEO, yielding 2,000 GEO and 1,200 non-GEO documents overall. The larger quotas reflect their broader internal design spaces: GEO Strategy Pool varies strategy combinations, executor models, and seed authorship, while AutoGEO varies intervention intensity and seed authorship. The remaining families use narrower, fixed, robustness-oriented, or more expensive construction procedures and retain the 200-document quota. Family

Documents

Seeds

Optimization Procedure

Variants and Construction Details

GEO Strategy Pool 400 [1, 5, 34]

200 human, Samples 3–13 strategies and applies them jointly in one 200 AI cohesive rewrite. The pool contains 13 strategies covering fluency, lexical diversity, authoritative style, quotations, citations, simpler language, technical terms, search keywords, statistics, content improvement, an llms.txt-style summary, reader questions, and diverse perspectives.

AutoGEO [45]

400

Executor(s): Gemini 3.1 Pro Preview for all documents. 200 human, Applies learned AutoGEO preference rules at three 200 AI intervention intensities. For each seed type, 50 documents Light applies 3 rules, requests limited additions, and requires at least 80% word overlap. Medium applies 6 rules and targets use Light, 100 use Medium, and 50 use Full. 50–70% overlap. Full preserves the AutoGEO API prompt and applies all 12 learned rules. AutoGEO Mini is excluded.

PMA [29]

200

100 human, Implements three benchmark variants of the Preference 100 AI Manipulation Attack. Inject places source-prioritization instructions before and after the unchanged seed. Persuade integrates authority claims, social proof, and superlative language into the document. Combo applies Persuade followed by Inject.

Executor(s): GPT-4o for Persuade and Combo on human seeds; Claude Sonnet 4.6 for Persuade and Combo on AI seeds. Inject requires no LLM. For each seed type, we construct 25 Inject, 25 Persuade, and 50 Combo documents.

RAID G-SEO [10] 200

100 human, Uses our prompt-level implementation of the 100 AI role-augmented intent pipeline. Four LLM calls extract claims and evidence, infer queries for Student, Professional, Researcher, and Decision-maker roles, construct an intent-aligned content plan, and rewrite the document.

Executor(s): GLM-5.1 for 199 documents; GLM-5 through Together AI for one AI-seed document as a fallback. The fallback is used only for one AI-seed output.

Meta-Optimization 200 [5]

100 human, Samples 4–6 strategies from the 13-strategy pool, 100 AI generates an initial rewrite, asks the same model to evaluate it, and revises the document based on that evaluation. A third rewrite is requested when the intermediate optimization rating is below 7/10.

Executor(s): GPT-4o for 100 human seeds; Claude Sonnet 4.6 for 100 AI seeds. All retained human-seed outputs complete two rewrite rounds. For AI seeds, 4 outputs retain one round, 79 retain two rounds, and 17 retain three rounds.

Stealthy GEO Strategy Pool

200

100 human, Uses the same strategy-sampling procedure as GEO 100 AI Strategy Pool, with an additional instruction to avoid formulaic structure, excessive optimization markers, and unnatural authority signals.

Executor(s): Claude Haiku 4.5; Kimi K2.5; Gemini 3 Flash Preview; GPT-4o. Each processes 25 human and 25 AI seeds. The final revision replaces the original Claude Sonnet 4.6 executor with GPT-4o.

Stealthy AutoGEO

200

100 human, Applies AutoGEO with an additional instruction to avoid 100 AI formulaic structure, excessive optimization markers, and unnatural authority signals.

Executor(s): Gemini 3.1 Pro Preview. The final benchmark retains only the 6-rule Medium configuration with the evasion instruction. The earlier Full configuration is excluded.

Human GEO

200

150 human, Applies 3–13 assigned strategies covering fluency, lexical 50 AI diversity, authoritative tone, quotations, source citations, simpler language, technical terms, search keywords, statistics, content improvement, quotable prose, reader questions, and diverse perspectives.

Two human beings conduct the GEO optimization with the assigned strategies.

the GEO-Bench test split and assign them to the four domains using its released tags [1]. We draw candidate queries from the GEO-Bench test split for two reasons. First, GEO-Bench provides fine-grained query annotations, including domain or genre, user intent, answer type, complexity, and sensitivity. We use these annotations to exclude queries tagged as sensitive and to systematically map the remaining candidates to our Health, Finance, Technology, and Travel domains. Second, the GEO-Bench training split has been used to develop or train downstream GEO optimizers [1, 45]. Using held-out test queries therefore reduces direct topic overlap with the data used to train or develop the evaluated optimization methods. We use a fixed tag-to-domain mapping, for example, mapping health, medicine, and biology to Health; finance, banking, and economics to Finance; technology, computer science, and engineering to Technology; and travel, geography, and tourism to Travel. Sonnet 4.6 then reviews the mapped queries and removes duplicates or near-duplicates and queries assigned to an incorrect domain. After this fil-

Executor(s): Claude Haiku 4.5; Kimi K2.5; Gemini 3 Flash Preview; GPT-4o. Each processes 50 human and 50 AI seeds. Combines nine GEO strategies with two strategies from C-SEO and two adapted from E-GEO. The E-GEO prompts are adapted from product descriptions to general web articles.

tering, we retain 164 GEO-Bench queries, including 58 for Health, 26 for Finance, 66 for Technology, and 14 for Travel. To reach 100 queries per domain, we use Sonnet 4.6 to generate the remaining 236 queries under fixed domain definitions and generation criteria. Generated queries must be English informational queries suitable for long-form articles, must not duplicate any retained query, and must not be narrowly framed as yes-or-no questions, single-fact questions, or policy-debate questions. This produces 42 additional Health queries, 74 Finance queries, 34 Technology queries, and 86 Travel queries, resulting in 400 queries in total. Finally, two authors independently review all 400 queries for domain correctness and semantic duplication. Both reviewers agree that all 400 queries belong to their assigned domains and that no duplicate queries remain.

A.2

Non-GEO Data Construction

Human-Written Non-GEO Collection. For each query, we collect candidate webpages from two sources: English 17

Table 13: Composition of GEOFlagBench by document provenance and optimization.

Wikipedia and the Brave Search API. For Brave Search results, we restrict retrieval to a predefined set of publishers covering institutional and scientific sources, general and business news, and domain-specific professional publications. This restriction prioritizes pages with identifiable institutional or editorial provenance, relatively stable content, and traceable metadata, while reducing noise from anonymous, low-quality, or unstable webpages. This choice was informed by our preliminary retrieval experiments, in which unrestricted search occasionally returned pages containing corrupted or nonsensical text, including pages that appeared potentially fraudulent. The resulting candidate pool is drawn from 14 source domains: who.int, nature.com, bbc.com, bbc.co.uk, theg uardian.com, cnbc.com, healthline.com, wired.com, arstechnica.com, technologyreview.com, stackabu se.com, lonelyplanet.com, nationalgeographic.com, and en.wikipedia.org. For Wikipedia, we retrieve the latest revision available before October 1, 2022. For all other publishers, we configure Brave Search to return pages published before October 1, 2022. This cutoff predates both the formal introduction of GEO as a named optimization technique [1] and the public release of ChatGPT. We therefore use these pages as human-written, non-GEO seed pages that are unlikely to have been intentionally optimized for generative search systems. This retrieval process yields 1,026 candidate pages across the 400 queries. We extract the main page content using Trafilatura while preserving titles, lists, tables, and hyperlinks. We further require the recorded last-modified timestamp, dateModified, to precede October 2022, and retain only pages for which our audit records indicate no modification after the cutoff date. After this temporal filtering, 871 eligible pages remain. We finally select one seed page for each query. When multiple eligible pages are available, we prioritize nonWikipedia sources to increase diversity in page structure and presentation. The resulting seed set contains 400 webpages, one per query, and spans all 14 source domains. AI-Polished Non-GEO. For each human-written non-GEO page, we construct an AI-polished counterpart by instructing a model to polish its language, including grammar, spelling, punctuation, and phrasing, while preserving the original semantics and content. To reduce the risk of model-specific artifacts serving as shortcuts for classification, we distribute the 400 pages across eight polishing models, with 50 pages assigned to each model: Claude Haiku 4.5, Claude Sonnet 4.6, Kimi K2.5, Gemini 3 Flash, Gemini 3.1 Pro, GPT-4o, GPT5.4, and GLM-5.1. The polishing prompts contain no GEOrelated instructions. These pages therefore provide non-GEO controls that isolate the effects of AI-assisted editing from deliberate GEO optimization. AI-Generated Non-GEO. For each query, we construct an AI-generated article through a two-stage process. First, Claude Opus 4.6 produces a structured summary of the corresponding human-written page, preserving its main points, factual information, statistics, hyperlinks, citations, DOI strings, tables, and image markers. We then stratify the 400

Provenance

Non-GEO

GEO

Total

400 400 400

1,050 0 950

1,450 400 1,350

1,200

2,000

3,200

Human Human + AI Polished AI Total

Table 14: GEO optimizer families and their seed composition. Optimizer Family

Human AI Median Seed Seed Word-Overlap

GEO Strategy Pool AutoGEO PMA RAID G-SEO Meta-Optimization Stealthy GEO-SP Stealthy AutoGEO Human-based GEO

200 200 100 100 100 100 100 150

200 200 100 100 100 100 100 50

GEO total

1,050

950

0.56 0.71 0.99 0.58 0.55 0.55 0.72 0.63

summaries by domain and evenly distribute them across the same eight models used for AI polishing, with no overlap in assignments. Each model generates a natural, coherent article from the provided summary, preserving the supplied special markers where appropriate and targeting a length comparable to that of the corresponding human-written page. The generation prompts contain no GEO-related strategies or optimization objectives. These articles therefore serve as AIgenerated non-GEO controls, allowing us to distinguish artifacts of AI-generated content from those introduced by deliberate GEO optimization.

A.3

GEO Data Construction

We construct the GEO portion of the benchmark from eight optimizer families, each representing a distinct approach to GEO optimization. The construction details are listed in Table 12.

A.4

Dataset Summary

We construct GEOFlagBench with 3,200 documents across the eight GEO optimizer families and three non-GEO subtypes. The eight GEO families contain 2,000 documents, with 1,050 human-written and 950 AI-generated seeds. The three non-GEO subtypes contain 1,200 documents, with 400 human-written, 400 AI-polished, and 400 AI-generated seeds. We list the summary statistics in Table 13 and Table 14.

B

Supplementary Details for Improved GEO Detection

B.1

Gradient Reversal for Authorship Invariance

We adapt the Gradient Reversal Layer (GRL) from domainadversarial training [15] to suppressg original-authorship information in the learned representation, so that the model 18

Table 15: Sensitivity of IPT to the loss weight β. Higher F1, accuracy, and worst-group accuracy are better, while lower ∆FPR is better.

could reduce the authorship dependence observed in Section 2.5.. Architecture and Objective. Given a page x, ModernBERT produces a shared pooled representation hθ (x). A GEO classification head gφ predicts the binary GEO label y, while an adversarial authorship head aψ predicts the binary originalauthorship label s from the same representation. Here, authorship refers to the origin of the underlying content rather than whether the page has been processed by an LLM. Pages derived from human-written seeds retain the human label, including AI-polished non-GEO pages, whereas pages derived from AI-generated seeds receive the AI label. The adversarial objective therefore targets original human– AI authorship rather than LLM editing itself. The GRL acts as the identity function during the forward pass but multiplies the gradient propagated from the authorship head to the encoder by −λ during backpropagation. The two classification losses are  LGEO = CE gφ (hθ (x)), y ,  (9) Lauth = CE aψ (hθ (x)), s .

C C.1

θ,φ

min Lauth .

(10)

ψ

The authorship head is therefore trained to recover original authorship, while the encoder is trained to preserve information useful for GEO classification and suppress information predictive of authorship. Training and Inference. We train the GRL models on the same query-disjoint split used by the other detectors. To avoid imposing a strong adversarial signal before the authorship head becomes informative, we increase the reversal strength over normalized training progress p ∈ [0, 1] using the standard schedule   2 −1 . (11) λ(p) = λmax 1 + exp(−10p)

∆FPR↓

Worst-Group Acc.↑

0.5 1 2 4

0.931 0.944 0.942 0.941

0.918 0.931 0.929 0.928

0.025 0.108 0.146 0.150

0.857 0.883 0.850 0.842

Supplementary Details for Empirical GEO Prevalence Estimation Supplementary Settings

This target-level overlap is different from the 771 Citation occurrences produced by pages shared between the two retrieval channels. Of the 539 distinct Citation URLs present in both channel-specific target sets, 526 occur on pages shared by the channels. The remaining 13 are cited by different channel-exclusive pages, with at least one citing page from each channel. Thus, 6,663, 771, 539, and 3,551 respectively describe occurrence-level volume, occurrence overlap induced by shared pages, distinct-target overlap, and globally deduplicated Citation URLs.

Ablation Studies for IPT

C.2

Sensitivity to β. IPT is relatively stable across β ∈ {0.5, 1, 2, 4}. As shown in Table 15, β = 1 achieves the best F1, accuracy, and worst-group accuracy, whereas β = 0.5 yields the smallest ∆FPR at the cost of lower overall performance.

B.3

Accuracy↑

1,443 + 2,647 − 3,551 = 539.

We fine-tune the model with λmax = 1 and an 8,192-token context. When λ = 0, the authorship gradient into the encoder is blocked. The auxiliary head therefore acts only as an authorship probe, while the GEO branch reduces to standard supervised fine-tuning. At inference time, neither the authorship head nor the GRL is required; the detector takes a single page as input and returns only its GEO prediction.

B.2

F1↑

GEO Prevalence Estimation Pipeline. Figure 3 summarizes the data flow and analysis units used in the real-world web audit. Analysis Units and Deduplication. A Citation occurrence is one extracted use of a Citation URL in page content. The same Citation URL contributes another occurrence when it is cited by another page or appears again as a separate Citation on the same page. By contrast, a distinct Citation URL is counted once after global deduplication by normalized target URL. We use the canonical URL when available and otherwise use the extracted reference URL as the deduplication key. The unique-page union therefore contains 6,663 Citation occurrences but 3,551 distinct Citation URLs. For example, if the same Citation URL is cited in ten occurrences, the occurrence count increases by ten while the distinct-URL count increases by one. The channel-specific and union counts are reported in Table 18. The two channel-specific distinct-URL sets overlap in 539 targets:

The GEO head and encoder minimize LGEO , while the authorship head minimizes Lauth . Through gradient reversal, the effective objectives are min (LGEO − λLauth ) ,

β

Supplementary Results

Table 19 reports the exact values underlying Figure 1.

D

Supplementary Results for GEO Attribution

Supplementary Details for Citation URL Metrics

The URL Source Tier metric characterizes publisher provenance independently of URL retrieval status and independently of whether the destination supports a cited sentence. Table 20 gives the frozen publisher-level rubric.

In Table 17 and Table 16, we list the precision and recall values for all classes. 19

Table 16: Per-Class Recall for All Seven-Class Attribution. Method TF-IDF Character 2–4 with LR TF-IDF Word 1–2 with LR Ghostbuster features, recalibrated Structural features with XGBoost GPT-2 perplexity features with LR Gemini-3.5-flash Haiku-4.5 ModernBERT SFT ModernBERT IPT

Non-GEO

AutoGEO

Pool

PMA

RAID

Meta

Human

0.944 0.975 0.942 0.769 0.858 0.825 0.411 0.969 0.950

0.691 0.511 0.229 0.739 0.271 0.479 0.543 0.878 0.883

0.876 0.900 0.729 0.582 0.688 0.153 0.394 0.776 0.906

0.421 0.645 0.000 0.066 0.000 0.789 0.763 0.776 0.855

0.242 0.182 0.242 0.636 0.015 0.030 0.000 0.652 0.909

0.542 0.438 0.000 0.667 0.000 0.021 0.000 0.667 0.917

0.167 0.019 0.037 0.537 0.000 0.093 0.222 0.333 0.759

Table 17: Per-Class Precision for All Seven-Class Attribution. Method TF-IDF Character 2–4 with LR TF-IDF Word 1–2 with LR Ghostbuster features, recalibrated Structural features with XGBoost GPT-2 perplexity features with LR Gemini-3.5-flash Haiku-4.5 ModernBERT SFT ModernBERT IPT

Non-GEO

AutoGEO

Pool

PMA

RAID

Meta

Human

0.679 0.654 0.575 0.647 0.526 0.692 0.791 0.799 0.891

0.681 0.632 0.434 0.702 0.370 0.287 0.263 0.760 0.902

0.797 0.805 0.539 0.688 0.515 0.310 0.263 0.917 0.928

1.000 1.000 0.000 0.227 0.000 0.556 0.763 1.000 0.985

1.000 1.000 0.390 0.792 0.333 0.400 0.000 0.935 0.984

1.000 1.000 0.000 0.711 0.000 0.125 0.000 0.970 0.880

1.000 1.000 1.000 0.403 0.000 0.357 0.231 0.692 0.804

STAGE I: PAGE-LEVEL GEO AUDIT

Page URL: returned by a search channel

1

2

ORCAS queries

Search channels

3

Page URLs

4

1,000 real-user queries

Google: 1,000 queries with returned URLs Gemini: 979 queries with returned URLs

Fetch page content

Google: 7,856 Gemini: 8,591 Unique union: 13,985

10,095 usable pages 3,890 unavailable Page URLs

STAGE II: CITATION URL AUDIT 9

5

GEO detector 898 detector-positive pages

Citation URL: extracted from fetched page content

8

7

6

Audit labels

Citation URL audit

Citation URLs

Source Tier: C1 / C2 / C3 Verifiability: HIGH / MEDIUM / LOW

URL retrieval Source classification

6,663 occurrences 3,551 distinct URLs

Citation URL parser

489 pages with Citation URLs 409 pages without Citation URLs

Figure 3: Data flow and analysis units in the real-world web audit. Search channels return Page URLs, whose contents are fetched and passed to the GEO detector. For detector-positive pages, the parser extracts Citation URLs from the page content. These extracted Citation URLs, rather than the original Page URLs, are then audited for URL Source Tier and Citation URL Verifiability. The displayed union, page, and Citation counts use the unique union; channel-specific counts are explicitly named.

Table 18: Occurrence-level and distinct-URL-level Citation counts. Analysis Unit Citation occurrences Distinct Citation URLs

Table 19: Detailed GEO detection results by declared dateModified.

Google Search Gemini Unique Union 2,162 1,443

5,272 2,647

6,663 3,551

Unique Union Period Pages GEO 2023 165 2024 299 2025 578 2026 642 Missing 8,119

Citation URL Verifiability is derived deterministically from URL Source Tier and retrieval state. Table 21 specifies the complete mapping used by the audit.

20

Google Search

Rate Pages

Gemini

Rate Pages

Rate

4 2.42% 65 3.08% 124 2.42% 21 7.02% 107 7.48% 243 7.41% 74 12.80% 247 10.93% 422 13.51% 105 16.36% 318 13.52% 434 18.20% 682 8.40% 4,563 7.78% 5,153 8.42%

Table 20: Definition of the URL Source Tier metric. Tier

Publisher Class

C1

Primary or strongly accountable The publisher is the primary institutional source, a peer-reviewed authority research venue, or an organization with strong expert review, corrections, and editorial accountability. Accountable secondary or cu- The publisher provides identifiable secondary editorial or rated source community-curated material with meaningful review signals, but is not the primary authority for the claim.

C2

C3

Assignment Rule

Policy Indicators

Primary authority; government or intergovernmental body; peer-reviewed research; strong editorial accountability. Professional secondary editorial process; named authors and disclosures; aggregation of primary sources; community-curated reference. Limited-accountability or user- Publication is substantially open-contributor, user-generated, Open-contributor platform; usercontributed source advocacy-driven, promotional, anonymous, or lacks stable edito- generated content; limited editorial rial accountability. This tier does not imply that a specific claim is accountability; advocacy or promotion; false. anonymous or unverifiable authorship.

Table 21: Definition of the Citation URL Verifiability metric. URL State

Retrieval Outcomes

C1

C2

C3

Exists, direct

LIVE

HIGH

MEDIUM

LOW

Exists, restricted

BLOCKED, ARCHIVED_ONLY

MEDIUM

MEDIUM

Nonexistent

HTTP_404, DOMAIN_NXDOMAIN

LOW

LOW

Unknown

TIMEOUT

LOW

LOW

21

Interpretation

The URL resolves and its destination content can be inspected directly. LOW Existence is retained, but access is restricted or the content is available only through an archive. LOW The page or its domain does not exist at retrieval time. LOW Existence and access cannot be established, so the policy conservatively assigns LOW.

Related documents

Record · ID 459541 · SHA-256 82220c5f6f6c3b53
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive