The Ethics of Automating Therapy

The mental health crisis and loneliness epidemic have sparked a growing interest in leveraging artificial intelligence (AI) and chatbots as a potential solution. This report examines the benefits and risks of incorporating chatbots in mental health treatment. AI is used for mental health diagnosis and treatment decision-making and to train therapists on virtual patients. Chatbots are employed as always-available intermediaries with therapists, flagging symptoms for human intervention. But chatbots are also sold as stand-alone virtual therapists or as friends and lovers. There is evidence that these uses of AI and chatbots can provide better quality service, improve accessibility, and lower costs. The systems can reduce the stigma and shame of sharing their problems and leverage a mass of biometric and behavioral data to supplement self-reports. As the systems' intelligence rapidly improves, they will need to be rigorously tested for the accuracy and precision of their diagnoses and the quality of their interactions with patients. As chatbots become indistinguishable from humans and leverage their superhuman capacity to detect affect and draw on knowledge of a patient’s life, patients will be drawn to attribute personality to and relationship with the chatbot. Consequently, it will be essential to study what the “therapeutic alliance” with an actual human counselor provides and the risks of patients attributing such a relationship to a one-sided or “parasocial” relationship.