Multimodal Artificial Intelligence for Detecting the Psychological State of Cancer Patients

Artificial intelligence (AI) technology is expected to assist clinical doctors in promptly identifying cancer patients at risk of developing psychological issues and to develop preemptive management plans, thereby enhancing their quality of life. Computer vision technology can directly capture and extract subtle changes in skin color from facial images in videos, assess heart rate using signal processing algorithms, and also extract facial expressions to evaluate psychological conditions through facial expression change signal processing algorithms. The accuracy rate can exceed 88%. By leveraging the capabilities of computer vision technology, it can accurately capture subtle movements and expressions of the human body, thereby understanding the internal psychological state and obtaining relevant psychological information