PhilArchive
open access
AGI is Mathematically Impossible 2: When Entropy Returns - Infinite Choice Barrier, Shannon Revisited
!Author’s Note (Update - June 18, 2025) Subsequent to the completion of this paper, a widely discussed study by Shojaee et al. at Apple (The Illusion of Thinking, 2025) presented empirical evidence that several advanced reasoning models (e.g., Claude 3.7 Sonnet, DeepSeek-R1) exhibit a collapse in reasoning effort and accuracy as task complexity increases — despite sufficient inference budget. Notably, the observations they report closely mirror the predictions derived in Chapters 6 and 7 of this paper, particularly regarding entropy divergence in heavy-tailed decision spaces and the increased instability introduced by deeper model architectures. While developed independently and prior to these results, the framework presented here may be seen as a theoretical explanation for the empirical phenomena documented in their study. Abstract This paper presents a second, independent proof that Artificial General Intelligence (AGI) is mathematically impossible. While Part 1 established the Infinite Choice Barrier (ICB) through computability theory, this paper presents an information-theoretic proof that general algorithmic reasoning faces a fundamental structural limit — the Infinite Choice Barrier (ICB). In decision spaces governed by heavy-tailed distributions with tail exponent \alpha \leq 1, entropy does not converge, and additional information increases uncertainty rather than reducing it. We define this phenomenon as Information Opens, Entropy Rises (IOpenER) and show that such spaces are undecidable by algorithmic systems, regardless of compute scale or architectural depth. We also introduce the Layer Hypothesis, which predicts that deeper models produce more semantic divergence under structural instability. Taken together, these results offer a formal limit on the reasoning capacity of current AI systems. Notably, key predictions derived here have since been empirically confirmed in Shojaee et al. (Apple, 2025), which documents collapse behaviors in frontier reasoning models consistent with this framework. (Note: Sections 2.-4. are identical to those in the first paper "AGI is Impossible - Here is The Proof")
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- On Logical Inference over Brains, Behaviour, and Artificial Neural Networks#112634
- Understanding Generalization Requires Universal Induction#1128728
- Beyond the Illusion: Load Minimization Theory as a Countermeasure to Reasoning Model Limitations in Complex Problems#716607
- Explainable AI lacks regulative reasons: why AI and human decision‑making are not equally opaque#716461
- The Future of Human-Artificial Intelligence Nexus and its Environmental Costs#769707
Record · ID 699367
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive