English
Related papers

Related papers: Towards Explainable Multimodal Depression Recognit…

200 papers

Depression is a leading cause of death worldwide, and the diagnosis of depression is nontrivial. Multimodal learning is a popular solution for automatic diagnosis of depression, and the existing works suffer two main drawbacks: 1) the…

Multimedia · Computer Science 2023-01-03 Chengbo Yuan , Qianhui Xu , Yong Luo

Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even…

Human-Computer Interaction · Computer Science 2024-12-03 Chayan Tank , Sarthak Pol , Vinayak Katoch , Shaina Mehta , Avinash Anand , Rajiv Ratn Shah

Depression is a widespread mental disorder that affects millions worldwide. While automated depression assessment shows promise, most studies rely on limited or non-clinically validated data, and often prioritize complex model design over…

Computation and Language · Computer Science 2025-08-07 Zhuang Chen , Guanqun Bi , Wen Zhang , Jiawei Hu , Aoyun Wang , Xiyao Xiao , Kun Feng , Minlie Huang

Large language models (LLMs) show promise in automating clinical diagnosis, yet their non-transparent decision-making and limited alignment with diagnostic standards hinder trust and clinical adoption. We address this challenge by proposing…

Artificial Intelligence · Computer Science 2025-11-25 Yining Yuan , J. Ben Tamo , Micky C. Nnamdi , Yifei Wang , May D. Wang

Depression poses serious public health risks, including suicide, underscoring the urgency of timely and scalable screening. Multimodal automatic depression detection (ADD) offers a promising solution; however, widely studied audio- and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiuyi Chen , Mingkui Tan , Haifeng Lu , Qiuna Xu , Zhihua Wang , Runhao Zeng , Xiping Hu

Multimodal depression classification has gained immense popularity over the recent years. We develop a multimodal depression classification system using articulatory coordination features extracted from vocal tract variables and text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Nadee Seneviratne , Carol Espy-Wilson

Emotional and cognitive factors are essential for understanding mental health disorders. However, existing methods often treat multi-modal data as classification tasks, limiting interpretability especially for emotion and cognition.…

Multimedia · Computer Science 2026-03-03 Zhiyuan Zhou , Yanrong Guo , Shijie Hao

While depression has been studied via multimodal non-verbal behavioural cues, head motion behaviour has not received much attention as a biomarker. This study demonstrates the utility of fundamental head-motion units, termed \emph{kinemes},…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Monika Gahalawat , Raul Fernandez Rojas , Tanaya Guha , Ramanathan Subramanian , Roland Goecke

Medical Decision-Making (MDM) is a complex process requiring substantial domain-specific expertise to effectively synthesize heterogeneous and complicated clinical information. While recent advancements in Large Language Models (LLMs) show…

Artificial Intelligence · Computer Science 2025-08-20 Liuxin Bao , Zhihao Peng , Xiaofei Zhou , Runmin Cong , Jiyong Zhang , Yixuan Yuan

Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models'…

Machine Learning · Computer Science 2021-03-24 Yiwen Meng , William Speier , Michael K. Ong , Corey W. Arnold

Depression is one of the leading causes of disability worldwide, posing a severe burden on individuals, healthcare systems, and society at large. Recent advancements in Large Language Models (LLMs) have shown promise in addressing mental…

Computation and Language · Computer Science 2025-02-11 Shiyu Teng , Jiaqing Liu , Rahul Kumar Jain , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-wei Chen

Multimodal Large Language Models (MLLMs) have shown remarkable success in comprehension tasks such as visual description and visual question answering. However, their direct application to embedding-based tasks like retrieval remains…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lihao Liu , Yan Wang , Biao Yang , Da Li , Jiangxia Cao , Yuxiao Luo , Xiang Chen , Xiangyu Wu , Wei Yuan , Fan Yang , Guiguang Ding , Tingting Gao , Guorui Zhou

Depression is a widespread mental health disorder, yet its automatic detection remains challenging. Prior work has explored unimodal and multimodal approaches, with multimodal systems showing promise by leveraging complementary signals.…

Artificial Intelligence · Computer Science 2026-03-24 Annisaa Fitri Nurfidausi , Eleonora Mancini , Paolo Torroni

It has been a hot research topic to enable machines to understand human emotions in multimodal contexts under dialogue scenarios, which is tasked with multimodal emotion analysis in conversation (MM-ERC). MM-ERC has received consistent…

Computation and Language · Computer Science 2023-08-15 Bobo Li , Hao Fei , Lizi Liao , Yu Zhao , Chong Teng , Tat-Seng Chua , Donghong Ji , Fei Li

Automatic depression detection provides cues for early clinical intervention by clinicians. Clinical interviews for depression detection involve dialogues centered around multiple themes. Existing studies primarily design end-to-end neural…

Computation and Language · Computer Science 2025-08-12 Xianbing Zhao , Yiqing Lyu , Di Wang , Buzhou Tang

Major depressive disorder (MDD) is a heterogeneous condition; multiple underlying neurobiological substrates could be associated with treatment response variability. Understanding the sources of this variability and predicting outcomes has…

Users of social platforms often perceive these sites as supportive spaces to post about their mental health issues. Those conversations contain important traces about individuals' health risks. Recently, researchers have exploited this…

Computation and Language · Computer Science 2024-08-21 Eliseo Bao , Anxo Pérez , Javier Parapar

On the increase of major depressive disorders (MDD), many researchers paid attention to their recognition and treatment. Existing MDD recognition algorithms always use a single time-frequency domain method method, but the single…

Neurons and Cognition · Quantitative Biology 2021-11-03 Xiaofang Sun , Xiangwei Zheng , Yonghui Xu , Lizhen Cui , Bin Hu

Depression is a serious mental illness that impacts the way people communicate, especially through their emotions, and, allegedly, the way they interact with others. This work examines depression signals in dialogs, a less studied setting…

Computation and Language · Computer Science 2022-08-23 Chuyuan Li , Chloé Braud , Maxime Amblard

In this paper, we aimed at reviewing several different approaches present today in the search for more accurate diagnostic and treatment management in mental healthcare. Our focus is on mood disorders, and in particular on the major…

Neurons and Cognition · Quantitative Biology 2019-03-28 Milena Cukic Radenkovic