Amid the COVID-19 pandemic, mental health issues like depression have risen, leading researchers to propose a multimodal framework for detecting depression on social media.(Anshul 2024, Li 2024).
By combining textual, user-specific, and image analyses, the framework aims to extract features for depression detection.(Anshul 2024, Li 2024).
A deep learning model, VNN, was used to generate visual embeddings from user-posted images, showing promising results for detecting depression during the pandemic.(Anshul 2024, Li 2024)
Depression is a complex mental disease, which involves many factors such as psychology, physiology, and society, and which causes harm to society.
Up to now, there are no valuable biomarkers for clinical diagnosis. This research constructed a dataset, which includes calm, sad, and happy facial expressions from both patients with depression and normal people, and classification and visualization of depression.
The network includes a dual-scale convolution module, adaptive channel attentional mechanism, and gradient class activation mapping technique. In which, dual-scale convolution captures features of the facial region at different scales and the adaptive channel attention captures the facial region with the most significant features.
The results show an improvement in the performance of depression classification based on facial information, and recruit gradient class activation mapping technique obtaining a specific visual face pattern of depression that is different from that of normal people, which provides a potential interpretable and discriminant evidence for the clinical diagnosis.
Thereby, promoting the development and application of artificial intelligence in the field of psychiatry.
Leave a Reply