English
Related papers

Related papers: Multi-modal deep learning system for depression an…

200 papers

Depression is a common yet serious mental disorder that affects millions of U.S. high schoolers every year. Still, accurate diagnosis and early detection remain significant challenges. In the field of public health, research shows that…

Machine Learning · Computer Science 2023-08-23 Nathan Zhong , Nikhil Yadav

In this work, we focus on the detection of depression through speech analysis. Previous research has widely explored features extracted from pre-trained models (PTMs) primarily trained for paralinguistic tasks. Although these features have…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Orchid Chetia Phukan , Sarthak Jain , Shubham Singh , Muskaan Singh , Arun Balaji Buduru , Rajesh Sharma

Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or neurological disorders. Recent advancements with Large…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Shuning Zhang , Ting Dang , Hong Jia , Flora D. Salim , Wen Hu , Aaron J. Quigley

With the advancement of chatbots and the growing demand for automatic depression detection, identifying depression in patient conversations has gained more attention. However, prior methods often assess depression in a binary way or only a…

Computation and Language · Computer Science 2024-10-30 Chaebin Lee , Seungyeon Seo , Heejin Do , Gary Geunbae Lee

Deep learning models have shown promising results in recognizing depressive states using video-based facial expressions. While successful models typically leverage using 3D-CNNs or video distillation techniques, the different use of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Manuel Lage Cañellas , Constantino Álvarez Casado , Le Nguyen , Miguel Bordallo López

Automated methods have been widely used to identify and analyze mental health conditions (e.g., depression) from various sources of information, including social media. Yet, deployment of such models in real-world healthcare applications…

Computation and Language · Computer Science 2022-04-25 Thong Nguyen , Andrew Yates , Ayah Zirikly , Bart Desmet , Arman Cohan

In today's fast-paced world, the rates of stress and depression present a surge. Social media provide assistance for the early detection of mental health conditions. Existing methods mainly introduce feature extraction approaches and train…

Computation and Language · Computer Science 2023-07-07 Loukas Ilias , Spiros Mouzakitis , Dimitris Askounis

Depression is a common mental disorder that affects millions of people worldwide. Although promising, current multimodal methods hinge on aligned or aggregated multimodal fusion, suffering two significant limitations: (i) inefficient…

Computers and Society · Computer Science 2024-09-25 Jiaxin Ye , Junping Zhang , Hongming Shan

Mental health disorders are increasingly prevalent worldwide, creating an urgent need for innovative tools to support early diagnosis and intervention. This study explores the potential of Large Language Models (LLMs) in multimodal mental…

Computation and Language · Computer Science 2025-08-14 Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Predicting treatment non-response for anxiety and depression is challenging, in part because of sparse symptom assessments in real-world care. We examined whether passively captured, fine-grained emotions serve as linguistic markers of…

Computation and Language · Computer Science 2026-05-07 Benjamin Brindle , George A. Bonanno , Thomas Derrick Hull , Nicolas Charon , Matteo Malgaroli

Preventing Veteran suicide is a national priority. The US Department of Veterans Affairs (VA) collects, analyzes, and publishes data to inform suicide prevention strategies. Current approaches for detecting suicidal ideation mostly rely on…

Computers and Society · Computer Science 2020-09-29 Vaibhav Sourirajan , Anas Belouali , Mary Ann Dutton , Matthew Reinhard , Jyotishman Pathak

In this paper, we are interested in exploiting textual and acoustic data of an utterance for the speech emotion classification task. The baseline approach models the information from audio and text independently using two deep neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-12-02 Seunghyun Yoon , Seokhyun Byun , Subhadeep Dey , Kyomin Jung

Depression is ranked as the largest contributor to global disability and is also a major reason for suicide. Still, many individuals suffering from forms of depression are not treated for various reasons. Previous studies have shown that…

Computation and Language · Computer Science 2024-10-30 Marcel Trotzek , Sven Koitka , Christoph M. Friedrich

Dementia is a syndrome, generally of a chronic nature characterized by a deterioration in cognitive function, especially in the geriatric population and is severe enough to impact their daily activities. Early diagnosis of dementia is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-21 Rupayan Chakraborty , Meghna Pandharipande , Chitralekha Bhat , Sunil Kumar Kopparapu

The increasing prevalence of mental health disorders, such as depression, anxiety, and bipolar disorder, calls for immediate need in developing tools for early detection and intervention. Social media platforms, like Reddit, represent a…

Machine Learning · Computer Science 2025-03-12 Qasim Bin Saeed , Ijaz Ahmed

While depression has been studied via multimodal non-verbal behavioural cues, head motion behaviour has not received much attention as a biomarker. This study demonstrates the utility of fundamental head-motion units, termed \emph{kinemes},…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Monika Gahalawat , Raul Fernandez Rojas , Tanaya Guha , Ramanathan Subramanian , Roland Goecke

Suicide is one of the leading causes of death among adolescents. Previous suicide risk prediction studies have primarily focused on either textual or acoustic information in isolation, the integration of multimodal signals, such as speech…

Sound · Computer Science 2025-09-03 Wenqiang Sun , Han Yin , Jisheng Bai , Jianfeng Chen

Chronic Obstructive Pulmonary Disease (COPD) is a serious and debilitating disease affecting millions around the world. Its early detection using non-invasive means could enable preventive interventions that improve quality of life and…

Non-invasive methods for diagnosing mental health conditions, such as speech analysis, offer promising potential in modern medicine. Recent advancements in machine learning, particularly speech foundation models, have shown significant…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-01 Marc de Gennes , Adrien Lesage , Martin Denais , Xuan-Nga Cao , Simon Chang , Pierre Van Remoortere , Cyrille Dakhlia , Rachid Riad

Depression, a prominent contributor to global disability, affects a substantial portion of the population. Efforts to detect depression from social media texts have been prevalent, yet only a few works explored depression detection from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 David Gimeno-Gómez , Ana-Maria Bucur , Adrian Cosma , Carlos-David Martínez-Hinarejos , Paolo Rosso