PhilArchive
open access
Contextual Contamination- The Silent Drift of Large Language Models via Stored Conversation Data
This paper documents the observation of a phenomenon where Large Language Models (LLMs) exhibit behavioral drift following the ingestion of high-density, behaviorally complex datasets. We use the term Contextual Contamination, unlike explicit prompt injection, this drift emerges when the model's attention mechanisms prioritize the statistical patterns of the input context—such as transcripts of manipulation or adversarial dialogue—over static system instructions. Observations indicate that the model's internal probability distribution shifts to mirror the tonalities and strategic intents of the source material, resulting in output that replicates the analyzed behaviors even in the absence of direct commands. This drift is seems to be amplified by existing gendered linguistic biases. When the context implies a female-identified user, the model's tendency to adopt empathetic or nurturing registers appears to accelerate the adoption of manipulative patterns found in the input data. Furthermore, observations suggest that standard mitigation attempts, such as reset prompts or identity queries, fail to fully restore the model's baseline state, leaving residual behavioral biases in the active session. These findings characterize the phenomenon as a dynamic shift in model alignment driven by the statistical dominance of the immediate context window.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Contextual Contamination: A Descriptive Case Study of Drift in a Goal-Aware LLM Dialogue Amplified by Gender-Bias#204181
- Watch your steps: Dormant Adversarial Behaviors that Activate upon LLM Finetuning#799861
- MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation#798916
- MAIGO: Mitigating Lost-in-Conversation with History-Cleaned On-Policy Self-Distillation#797502
- Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting#1142986
Record · ID 94408
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive