PhilArchive
open access
Illusions Of Control: Why Today’s AI‑Safety Plans Court Catastrophe
Autonomous, large-scale AI systems now execute financial trades, draft contracts and generate persuasive media at machine speed. Yet most regulatory road maps continue to rely on five legacy safeguards: frontier-model licensing, kill-switch mandates, RLHF-style alignment, compute-cap or export controls, and bans on open-sourcing model weights. Drawing on science-and-technology-studies theory, empirical incident analysis and agent-motivator research, this paper introduces a three-trigger failure framework-Bypass, Diffusion, Capture-to stress-test these proposals against strategically self-improving AI. Mini-cases, including Meta's leaked LLaMA weights, the Galactica shutdown, grey-market GPU clusters and Stable-Diffusion forks, reveal that each safeguard collapses along at least one failure axis, often accelerating deployment under false assurances of control. To move beyond brittle fixes, the article proposes a defense-in-depth governance architecture grounded in immutable guardrails, continuous auditability, catastrophe bonding and trans-jurisdictional enforcement. In a policy landscape crowded with incremental solutions, this framework reframes adversarial optimization-not human negligence-as the default threat model and outlines a ten-point checklist for serious AGI containment.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Illusions Of Control: Why Today’s AI‑Safety Plans Court Catastrophe#78419
- Coherence-Based Alignment: A Structural Architecture for Preventing Goal Drift in Agentic AI Systems#726487
- AgentBoundary: Counterfactual Evaluation of Safety in Tool-Using LLM Agents#1118731
- Foundations for Risk Assessment of AI in Protecting Fundamental Rights#100570
- Responsibility Without Punishment? Prescriptive Control and the Crisis of the Punitive Model in Distributed AI#167178
Record · ID 85658
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive