Conceptio › Archive › PhilArchive
PhilArchive open access

Illusions Of Control: Why Today’s AI‑Safety Plans Court Catastrophe

Gropper, Jonathan · 2025
PhilArchive · Papers · 2025
Open Source ↗
philosophy
Autonomous, large-scale AI systems now execute financial trades, draft contracts and generate persuasive media at machine speed. Yet most regulatory road maps continue to rely on five legacy safeguards: frontier-model licensing, kill-switch mandates, RLHF-style alignment, compute-cap or export controls, and bans on open-sourcing model weights. Drawing on science-and-technology-studies theory, empirical incident analysis and agent-motivator research, this paper introduces a three-trigger failure framework-Bypass, Diffusion, Capture-to stress-test these proposals against strategically self-improving AI. Mini-cases, including Meta's leaked LLaMA weights, the Galactica shutdown, grey-market GPU clusters and Stable-Diffusion forks, reveal that each safeguard collapses along at least one failure axis, often accelerating deployment under false assurances of control. To move beyond brittle fixes, the article proposes a defence-in-depth governance architecture grounded in immutable guardrails, continuous auditability, catastrophe bonding and trans-jurisdictional enforcement. In a policy landscape crowded with incremental solutions, this framework reframes adversarial optimisation-not human negligence-as the default threat model and outlines a ten-point checklist for serious AGI containment.
Conceptio Open Archive

Analyze & explore related research in Conceptio

Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.

This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗

Related documents

Record · ID 78419
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive