PhilArchive
open access
Statistical Structure and the Failure of Pointing: A System-Class Law for Compression-Based Generative Systems
This paper proposes a system-class law for large language models as compression-based generative systems: statistical structure is preserved under compression, whereas indexical structure — the recoverable relation between an output and its originating evidential context — is not preserved in its pointing function. The asymmetry between statistical structure and indexical structure is not a contingent deficiency of current models but a structural property of compression-based generation. Compression preserves recurring regularities across the training distribution, but it does not thereby preserve particular pointing relations as such. From this law follows the Grounding Ceiling: increases in predictive capability can improve calibration and surface accuracy but cannot by themselves make output generation constitutively evidential, because the generation process does not traverse the evidential relations grounding requires. A conditional extension of the law, the Control Ceiling, follows if future empirical work confirms that inference proceeds through stable behavioural regimes shaped by pretraining: post-training control methods cannot then be assumed to arbitrarily rewrite that underlying regime structure. Together, these two ceilings establish a methodological consequence: current evaluation practices are organised primarily around surface plausibility rather than around the deeper properties this account identifies as explanatorily fundamental — grounding recoverability at the compression level and stable regime structure at the dynamical level. Once the evaluative target shifts, capability forecasting, interpretability, safety, and design change in kind.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Uncheatable Eval: Dynamic Compression-Based Evaluation of Language Models#1064054
- Prediction Error Convergence (PEC) Protocol for Realizing Intersubjective Rest: A Load Minimization Theory (LMT) Framework#83489
- Training-Free Inference-Time Self-Reflection and Cost-Bounded Early Stopping for Large Language Models#467181
- Limits of Reliability and Scaling in Language Models#973274
- The Geometry of Underdetermination: A Variational Principle for Discrimination#97954
Record · ID 222006
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive