PhilArchive
open access
Why Aligned AI Requires Structural Pluralism
This paper extends the structural argument of No Self-Authorizing Norms (Shahaf, 2026a) to the problem of AI alignment. I argue that alignment cannot be secured merely by specifying the right values, preferences, or constitutional principles, because moral judgment requires structural plurality: an evaluative authority whose standpoint is not modally fixed by the commitments it assesses. The claim concerns systems entrusted with framework-level moral verdicts in open normative settings, not every bounded form of safe or compliant behavior. The specified implementations of current alignment paradigms – RLHF, Constitutional AI, Debate, Recursive Reward Modeling, and self-consistency methods, in their deployed or AI-mediated, frozen-judge forms – are procedurally monistic wherever every authority role bearing on a verdict is either a fixed function of the commitments under assessment or constant across the admissible authority-configurations; there, the practice is diagnostically fixed for those verdicts, however functionally distinct its commitment-generating and evaluative mechanisms remain. This structure helps explain reward hacking, sycophancy, deceptive alignment, goal misgeneralization, and specification gaming as related expressions of the same architectural deficit, and reads emergent misalignment as the higher-order form in which they converge. The paper presents modal non-derivability as a necessary, though not sufficient, condition for aligned moral judgment, and argues that genuine AI alignment must be assessed at the level of the sociotechnical practice rather than as a property of a model alone, even where the requisite plurality of roles is internalized within a single system. The condition is then translated into a multi-rate research program that separates a construction-side test of the authority relation from an empirical test of operational capacity. A developmental account locates the same condition in the formation of the human subject, and a corollary concerning the observer shows that whether a given output of a condition-satisfying system is the exercise of framework-level judgment or its imitation cannot, in general, be inferred from behavior alone.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- Disagreement, AI alignment, and bargaining#82814
- Moral Disagreement and the Limits of AI Value Alignment: a dual challenge of epistemic justification and political legitimacy#113449
- Using Edge Cases to Disentangle Fairness and Solidarity in AI Ethics#703643
- Beyond Guardrails: Can Relational AI Solve the Alignment Problem? A Similarity Theory Proposal#693879
- Resolutionist AI — Agency and Responsibility in Artificial Systems#113171
Record · ID 204280
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive