English
Related papers

Related papers: Towards Explainable Multimodal Depression Recognit…

200 papers

Major depressive disorder (MDD) is a prevalent mental disorder associated with complex neurobiological changes that cannot be fully captured using a single imaging modality. The use of multimodal magnetic resonance imaging (MRI) provides a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nojod M. Alotaibi , Areej M. Alhothali

In this work we propose a machine learning model for depression detection from transcribed clinical interviews. Depression is a mental disorder that impacts not only the subject's mood but also the use of language. To this end we use a…

Computation and Language · Computer Science 2020-06-16 D. Xezonaki , G. Paraskevopoulos , A. Potamianos , S. Narayanan

Multimodal machine learning (MML) is rapidly reshaping the way mental-health disorders are detected, characterized, and longitudinally monitored. Whereas early studies relied on isolated data streams -- such as speech, text, or wearable…

Machine Learning · Computer Science 2025-06-25 Zahraa Al Sahili , Ioannis Patras , Matthew Purver

According to the World Health Organization, the number of mental disorder patients, especially depression patients, has grown rapidly and become a leading contributor to the global burden of disease. However, the present common practice of…

The Audio/Visual Emotion Challenge and Workshop (AVEC 2016) "Depression, Mood and Emotion" will be the sixth competition event aimed at comparison of multimedia processing and machine learning methods for automatic audio, visual and…

Computer Vision and Pattern Recognition · Computer Science 2016-11-23 Michel Valstar , Jonathan Gratch , Bjorn Schuller , Fabien Ringeval , Denis Lalanne , Mercedes Torres Torres , Stefan Scherer , Guiota Stratou , Roddy Cowie , Maja Pantic

In this work, we present a lightweight and privacy-preserving Multimodal Emotion Recognition (MER) framework designed for deployment on edge devices. To demonstrate framework's versatility, our implementation uses three modalities - speech,…

Artificial Intelligence · Computer Science 2026-02-11 Rémi Grzeczkowicz , Eric Soriano , Ali Janati , Miyu Zhang , Gerard Comas-Quiles , Victor Carballo Araruna , Aneesh Jonelagadda

Emotion recognition in conversation (ERC) is a crucial component in affective dialogue systems, which helps the system understand users' emotions and generate empathetic responses. However, most works focus on modeling speaker and…

Computation and Language · Computer Science 2021-07-15 Jingwen Hu , Yuchen Liu , Jinming Zhao , Qin Jin

Depression is a common mental disorder worldwide which causes a range of serious outcomes. The diagnosis of depression relies on patient-reported scales and psychiatrist interview which may lead to subjective bias. In recent years, more and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Zhenyu Liu , Dongyu Wang , Lan Zhang , Bin Hu

With the rapid advancement of Multimodal Large Language Models (MLLMs), they have demonstrated exceptional capabilities across a variety of vision-language tasks. However, current evaluation benchmarks predominantly focus on objective…

Computation and Language · Computer Science 2025-09-24 Haokun Li , Yazhou Zhang , Jizhi Ding , Qiuchi Li , Peng Zhang

Multimodal emotion recognition in conversation (MERC), the task of identifying the emotion label for each utterance in a conversation, is vital for developing empathetic machines. Current MLLM-based MERC studies focus mainly on capturing…

Computation and Language · Computer Science 2025-04-01 Yumeng Fu , Junjie Wu , Zhongjie Wang , Meishan Zhang , Yulin Wu , Bingquan Liu

Speech-based depression detection has shown promise as an objective diagnostic tool, yet the cross-linguistic robustness of acoustic markers and their neurobiological underpinnings remain underexplored. This study extends Cross-Data…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Fuxiang Tao , Dongwei Li , Shuning Tang , Xuri Ge , Wei Ma , Anna Esposito , Alessandro Vinciarelli

With the acceleration of the pace of work and life, people have to face more and more pressure, which increases the possibility of suffering from depression. However, many patients may fail to get a timely diagnosis due to the serious…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Lang He , Mingyue Niu , Prayag Tiwari , Pekka Marttinen , Rui Su , Jiewei Jiang , Chenguang Guo , Hongyu Wang , Songtao Ding , Zhongmin Wang , Wei Dang , Xiaoying Pan

Accurate and interpretable detection of depressive language in social media is useful for early interventions of mental health conditions, and has important implications for both clinical practice and broader public health efforts. In this…

Computation and Language · Computer Science 2025-06-10 Samuel Kim , Oghenemaro Imieye , Yunting Yin

Accurate and interpretable prediction of estimated glomerular filtration rate (eGFR) is essential for managing chronic kidney disease (CKD) and supporting clinical decisions. Recent advances in Large Multimodal Models (LMMs) have shown…

Machine Learning · Computer Science 2025-07-31 Peng-Yi Wu , Pei-Cing Huang , Ting-Yu Chen , Chantung Ku , Ming-Yen Lin , Yihuang Kang

Depression disorder is a serious health condition that has affected the lives of millions of people around the world. Diagnosis of depression is a challenging practice that relies heavily on subjective studies and, in most cases, suffers…

Signal Processing · Electrical Eng. & Systems 2025-03-26 Amir Nassibi , Christos Papavassiliou , Ildar Rakhmatulin , Danilo Mandic , S. Farokh Atashzar

As a critical mental health disorder, depression has severe effects on both human physical and mental well-being. Recent developments in EEG-based depression analysis have shown promise in improving depression detection accuracies. However,…

Machine Learning · Computer Science 2025-11-18 Zhijian Gong , Wenjia Dong , Xueyuan Xu , Fulin Wei , Chunyu Liu , Li Zhuo

Electronic health records (EHR) is an inherently multimodal register of the patient's health status characterized by static data and multivariate time series (MTS). While MTS are a valuable tool for clinical prediction, their fusion with…

Emotion Recognition in Conversations (ERC) has considerable prospects for developing empathetic machines. For multimodal ERC, it is vital to understand context and fuse modality information in conversations. Recent graph-based fusion…

Computation and Language · Computer Science 2022-03-07 Dou Hu , Xiaolong Hou , Lingwei Wei , Lianxin Jiang , Yang Mo

Individual's general well-being is greatly impacted by mental health conditions including depression and Post-Traumatic Stress Disorder (PTSD), underscoring the importance of early detection and precise diagnosis in order to facilitate…

Machine Learning · Computer Science 2025-02-07 Himanshi Singh , Sadhana Tiwari , Sonali Agarwal , Ritesh Chandra , Sanjay Kumar Sonbhadra , Vrijendra Singh

With the advancement of chatbots and the growing demand for automatic depression detection, identifying depression in patient conversations has gained more attention. However, prior methods often assess depression in a binary way or only a…

Computation and Language · Computer Science 2024-10-30 Chaebin Lee , Seungyeon Seo , Heejin Do , Gary Geunbae Lee