The Category Error in Contemporary AI Safety Discourse and Why Non-Sentient Systems Cannot Be Moral Machines

Contemporary AI safety discourse increasingly treats artificial intelligence systems as potential bearers of moral status, referring to them as “moral machines” and debating their rights, responsibilities, and moral standing. This paper argues that such framings commit a foundational category error: they conflate functional sophistication with phenomenal consciousness, mistaking computational processes for the sentient experience required for genuine moral patiency. Drawing on the philosophical zombie tradition, recent work in AI ethics, and critiques of anthropomorphism, I argue that current AI systems are best understood as moral zombies: entities capable of simulating moral behavior without possessing the experiential properties that ground moral concern. I further argue that this misclassification has practical consequences for AI safety, responsibility attribution, and policy design. By incorporating counterarguments from relational ethics, empirical studies of human–AI interaction, and global perspectives on moral status, the paper reframes AI safety as an ontological and ethical clarity problem rather than a matter of value encoding or moral optimization.