PhilArchive
open access
Robustness to fundamental uncertainty in AGI alignment
The AGI alignment problem has a bimodal distribution of outcomes with most outcomes clustering around the poles of total success and existential, catastrophic failure. Consequently, attempts to solve AGI alignment should, all else equal, prefer false negatives (ignoring research programs that would have been successful) to false positives (pursuing research programs that will unexpectedly fail). Thus, we propose adopting a policy of responding to points of metaphysical and practical uncertainty associated with the alignment problem by limiting and choosing necessary assumptions to reduce the risk false positives. Herein we explore in detail some of the relevant points of uncertainty that AGI alignment research hinges on and consider how to reduce false positives in response to them.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- When a Human-in-the-Loop Amplifies the Risk of Misalignment: Considerations for Research Ethics Oversight.#659466
- Coordinated Holistic Alignment of Manufacturing Processes (CHAMP)#714216
- Uncertainty tolerance in healthcare: towards a normative conception#103797
- Structural Theory of Everything IV: The Continuance; Naming, Governance, and the Structural Conditions for Civilizational#709048
- From Epistemic Injustice to Artificial Communication: Why False Information Spreads as a Social Solution#688207
Record · ID 736198
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive