English
Related papers

Related papers: Mental-Perceiver: Audio-Textual Multi-Modal Learni…

200 papers

Conversations contain a wide spectrum of multimodal information that gives us hints about the emotions and moods of the speaker. In this paper, we developed a system that supports humans to analyze conversations. Our main contribution is…

Human-Computer Interaction · Computer Science 2020-01-29 Joshua Y. Kim , Greyson Y. Kim , Kalina Yacef

We developed a novel, interpretable multimodal classification method to identify symptoms of mood disorders viz. depression, anxiety and anhedonia using audio, video and text collected from a smartphone application. We used CNN-based…

Machine Learning · Computer Science 2021-09-08 Tathagata Banerjee , Matthew Kollada , Pablo Gersberg , Oscar Rodriguez , Jane Tiller , Andrew E Jaffe , John Reynders

Depression is a serious mental health illness that significantly affects an individual's well-being and quality of life, making early detection crucial for adequate care and treatment. Detecting depression is often difficult, as it is based…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Md Rezwanul Haque , Md. Milon Islam , S M Taslim Uddin Raju , Hamdi Altaheri , Lobna Nassar , Fakhri Karray

Mental health disorders are a global crisis. While various datasets exist for detecting such disorders, there remains a critical gap in identifying individuals actively seeking help. This paper introduces a novel dataset, M-Help,…

Computation and Language · Computer Science 2025-08-22 MSVPJ Sathvik , Zuhair Hasan Shaik , Vivek Gupta

Speech-based depression detection poses significant challenges for automated detection due to its unique manifestation across individuals and data scarcity. Addressing these challenges, we introduce DAAMAudioCNNLSTM and…

Sound · Computer Science 2024-09-04 Georgios Ioannides , Adrian Kieback , Aman Chadha , Aaron Elkins

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…

This paper presents our approach to the first Multimodal Personality-Aware Depression Detection Challenge, focusing on multimodal depression detection using machine learning and deep learning models. We explore and compare the performance…

Computation and Language · Computer Science 2025-08-29 Javier Si Zhao Hong , Timothy Zoe Delaya , Sherwyn Chan Yin Kit , Pai Chet Ng , Xiaoxiao Miao

Mental health disorders are rising worldwide. However, the availability of trained clinicians has not scaled proportionally, leaving many people without adequate or timely support. To bridge this gap, recent studies have shown the promise…

Computation and Language · Computer Science 2025-08-19 Aishik Mandal , Prottay Kumar Adhikary , Hiba Arnaout , Iryna Gurevych , Tanmoy Chakraborty

This study proposes an innovative multimodal fusion model based on a teacher-student architecture to enhance the accuracy of depression classification. Our designed model addresses the limitations of traditional methods in feature fusion…

Computation and Language · Computer Science 2025-02-03 Lindy Gan , Yifan Huang , Xiaoyang Gao , Jiaming Tan , Fujun Zhao , Tao Yang

Mental health problems impact quality of life of millions of people around the world. However, diagnosis of mental health disorders is a challenging problem that often relies on self-reporting by patients about their behavioral patterns.…

Machine Learning · Computer Science 2021-02-23 Shayan Hassantabar , Joe Zhang , Hongxu Yin , Niraj K. Jha

Multimodal depression classification has gained immense popularity over the recent years. We develop a multimodal depression classification system using articulatory coordination features extracted from vocal tract variables and text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Nadee Seneviratne , Carol Espy-Wilson

The in-context learning capabilities of large language models (LLMs) show great potential in mental health support. However, the lack of counseling datasets, particularly in Chinese corpora, restricts their application in this field. To…

Computation and Language · Computer Science 2025-03-06 Keqi Chen , Zekai Sun , Yuhua Wen , Huijun Lian , Yingming Gao , Ya Li

Mental health disorders remain among the leading cause of disability worldwide, yet conditions such as depression, anxiety, and Post-Traumatic Stress Disorder (PTSD) are frequently underdiagnosed or misdiagnosed due to subjective…

Computation and Language · Computer Science 2025-10-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

The increasing prevalence of mental health disorders, such as depression, anxiety, and bipolar disorder, calls for immediate need in developing tools for early detection and intervention. Social media platforms, like Reddit, represent a…

Machine Learning · Computer Science 2025-03-12 Qasim Bin Saeed , Ijaz Ahmed

Depression is a major mental health disorder that is rapidly affecting lives worldwide. Depression not only impacts emotional but also physical and psychological state of the person. Its symptoms include lack of interest in daily…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Shubham Dham , Anirudh Sharma , Abhinav Dhall

The classification of mental health is challenging for a variety of reasons. For one, there is overlap between the mental health issues. In addition, the signs of mental health issues depend on the context of the situation, making…

Machine Learning · Computer Science 2026-03-17 Menna Elgabry , Ali Hamdi , Khaled Shaban

Early detection of depressive episodes is crucial in managing mental health disorders such as Major Depressive Disorder (MDD) and Bipolar Disorder. However, existing methods often necessitate active participation or are confined to clinical…

Human-Computer Interaction · Computer Science 2024-04-24 Rahul Islam , Sang Won Bae

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

Early detection of Alzheimer's Dementia (AD) and Mild Cognitive Impairment (MCI) is critical for timely intervention, yet current diagnostic approaches remain resource-intensive and invasive. Speech, encompassing both acoustic and…