English
Related papers

Related papers: It Hears, It Sees too: Multi-Modal LLM for Depress…

200 papers

Depression is a critical concern in global mental health, prompting extensive research into AI-based detection methods. Among various AI technologies, Large Language Models (LLMs) stand out for their versatility in mental healthcare…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Xiangyu Zhang , Hexin Liu , Kaishuai Xu , Qiquan Zhang , Daijiao Liu , Beena Ahmed , Julien Epps

Depression is a growing concern gaining attention in both public discourse and AI research. While deep neural networks (DNNs) have been used for recognition, they still lack real-world effectiveness. Large language models (LLMs) show strong…

Human-Computer Interaction · Computer Science 2025-08-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn W. Schuller

Automated depression diagnosis aims to analyze multimodal information from interview videos to predict participants' depression scores. Previous studies often lack clear explanations of how these scores were determined, limiting their…

Artificial Intelligence · Computer Science 2026-03-19 Wei Zhang , Juan Chen , En Zhu , Wenhong Cheng , YunPeng Li , Yanbo J. Wang

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, developing analysis tools to use this data in clinical…

Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even…

Human-Computer Interaction · Computer Science 2024-12-03 Chayan Tank , Sarthak Pol , Vinayak Katoch , Shaina Mehta , Avinash Anand , Rajiv Ratn Shah

Anxiety and depression are the most common mental health issues worldwide, affecting a non-negligible part of the population. Accordingly, stakeholders, including governments' health systems, are developing new strategies to promote early…

Artificial Intelligence · Computer Science 2024-12-24 Francisco de Arriba-Pérez , Silvia García-Méndez

Depression poses serious public health risks, including suicide, underscoring the urgency of timely and scalable screening. Multimodal automatic depression detection (ADD) offers a promising solution; however, widely studied audio- and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jiuyi Chen , Mingkui Tan , Haifeng Lu , Qiuna Xu , Zhihua Wang , Runhao Zeng , Xiping Hu

Limited access to mental healthcare resources hinders timely depression diagnosis, leading to detrimental outcomes. Social media platforms present a valuable data source for early detection, yet this task faces two significant challenges:…

Computation and Language · Computer Science 2025-10-10 Xiaochong Lan , Zhiguang Han , Yiming Cheng , Li Sheng , Jie Feng , Chen Gao , Yong Li

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

Speech is a noninvasive digital phenotype that can offer valuable insights into mental health conditions, but it is often treated as a single modality. In contrast, we propose the treatment of patient speech data as a trimodal multimedia…

Computation and Language · Computer Science 2025-07-24 Mai Ali , Christopher Lucasius , Tanmay P. Patel , Madison Aitken , Jacob Vorstman , Peter Szatmari , Marco Battaglia , Deepa Kundur

This paper presents our approach to the first Multimodal Personality-Aware Depression Detection Challenge, focusing on multimodal depression detection using machine learning and deep learning models. We explore and compare the performance…

Computation and Language · Computer Science 2025-08-29 Javier Si Zhao Hong , Timothy Zoe Delaya , Sherwyn Chan Yin Kit , Pai Chet Ng , Xiaoxiao Miao

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or neurological disorders. Recent advancements with Large…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Shuning Zhang , Ting Dang , Hong Jia , Flora D. Salim , Wen Hu , Aaron J. Quigley

Background: Depression is a major public health concern, affecting an estimated five percent of the global population. Early and accurate diagnosis is essential to initiate effective treatment, yet recognition remains challenging in many…

Signal Processing · Electrical Eng. & Systems 2025-11-21 Jana Weber , Marcel Weber , Juan Miguel Lopez Alcaraz

Depression remains a pressing global mental health issue, driving considerable research into AI-driven detection approaches. While pre-trained models, particularly speech self-supervised models (SSL Models), have been applied to depression…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-11 Xiangyu Zhang , Beena Ahmed , Julien Epps

Depression, a prominent contributor to global disability, affects a substantial portion of the population. Efforts to detect depression from social media texts have been prevalent, yet only a few works explored depression detection from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 David Gimeno-Gómez , Ana-Maria Bucur , Adrian Cosma , Carlos-David Martínez-Hinarejos , Paolo Rosso

Large language models (LLMs) are increasingly used to assist computational social science research. While prior efforts have focused on text, the potential of leveraging multimodal LLMs (MLLMs) for online video studies remains…

Human-Computer Interaction · Computer Science 2025-03-10 Jiaying "Lizzy" Liu , Yiheng Su , Praneel Seth

Major Depressive Disorder (MDD) is a pervasive mental health condition that affects 300 million people worldwide. This work presents a novel, BiLSTM-based tri-modal model-level fusion architecture for the binary classification of depression…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Santosh V. Patapati
‹ Prev 1 2 3 10 Next ›