English
Related papers

Related papers: Speech as a Multimodal Digital Phenotype for Multi…

200 papers

Embedded in any speech signal is a rich combination of cognitive, neuromuscular and physiological information. This richness makes speech a powerful signal in relation to a range of different health conditions, including major depressive…

Sound · Computer Science 2022-04-04 Salvatore Fara , Stefano Goria , Emilia Molimpakis , Nicholas Cummins

With ubiquity of social media platforms, millions of people are sharing their online persona by expressing their thoughts, moods, emotions, feelings, and even their daily struggles with mental health issues voluntarily and publicly on…

Early detection of depression from social media data offers a valuable opportunity for timely intervention. However, this task poses significant challenges, requiring both professional medical knowledge and the development of accurate and…

Computation and Language · Computer Science 2025-03-20 Xiangyong Chen , Xiaochuan Lin

We propose a cloud-based multimodal dialog platform for the remote assessment and monitoring of Amyotrophic Lateral Sclerosis (ALS) at scale. This paper presents our vision, technology setup, and an initial investigation of the efficacy of…

Self-supervised language and audio models effectively predict brain responses to speech. However, traditional prediction models rely on linear mappings from unimodal features, despite the complex integration of auditory signals with…

Computation and Language · Computer Science 2025-02-19 Danny Dongyeop Han , Yunju Cho , Jiook Cha , Jay-Yoon Lee

Depression is a growing concern gaining attention in both public discourse and AI research. While deep neural networks (DNNs) have been used for recognition, they still lack real-world effectiveness. Large language models (LLMs) show strong…

Human-Computer Interaction · Computer Science 2025-08-27 Yupei Li , Shuaijie Shao , Manuel Milling , Björn W. Schuller

Telehealth is a valuable tool for primary health care (PHC), where depression is a common condition. PHC is the first point of contact for most people with depression, but about 25% of diagnoses made by PHC physicians are inaccurate. Many…

Passively collected behavioral health data from ubiquitous sensors holds significant promise to provide mental health professionals insights from patient's daily lives; however, developing analysis tools to use this data in clinical…

The global increase in mental illness requires innovative detection methods for early intervention. Social media provides a valuable platform to identify mental illness through user-generated content. This systematic review examines machine…

Machine Learning · Computer Science 2025-02-18 Yuchen Cao , Jianglai Dai , Zhongyan Wang , Yeyubei Zhang , Xiaorui Shen , Yunchong Liu , Yexin Tian

Multimodal health sensing offers rich behavioral signals for assessing mental health, yet translating these numerical time-series measurements into natural language remains challenging. Current LLMs cannot natively ingest long-duration…

In this study, we focus on automated approaches to detect depression from clinical interviews using multi-modal machine learning (ML). Our approach differentiates from other successful ML methods such as context-aware analysis through…

Machine Learning · Computer Science 2024-12-30 Genevieve Lam , Huang Dongyan , Weisi Lin

Bipolar disorder is a mental health disorder that causes mood swings that range from depression to mania. Diagnosis of bipolar disorder is usually done based on patient interviews, and reports obtained from the caregivers of the patients.…

Computation and Language · Computer Science 2021-12-20 Pınar Baki

Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications towards…

Depression is a common mental disorder worldwide which causes a range of serious outcomes. The diagnosis of depression relies on patient-reported scales and psychiatrist interview which may lead to subjective bias. In recent years, more and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-02 Zhenyu Liu , Dongyu Wang , Lan Zhang , Bin Hu

Accurate assessment of cognitive decline from spontaneous speech remains challenging due to limited dataset size and class imbalance. In this work, we propose a large language model (LLM)-driven data augmentation framework to improve the…

Computation and Language · Computer Science 2026-05-18 Si-Belkacem Yamine Ketir , Lenard Paulo Tamayo , Shohei Hisada , Shaowen Peng , Shoko Wakamiya , Eiji Aramaki

Dementia is a progressive neurological disorder that profoundly affects the daily lives of older adults, impairing abilities such as verbal communication and cognitive function. Early diagnosis is essential for enhancing both lifespan and…

Computational Engineering, Finance, and Science · Computer Science 2023-11-07 Kaiying Lin , Peter Washington

Depression, a prominent contributor to global disability, affects a substantial portion of the population. Efforts to detect depression from social media texts have been prevalent, yet only a few works explored depression detection from…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 David Gimeno-Gómez , Ana-Maria Bucur , Adrian Cosma , Carlos-David Martínez-Hinarejos , Paolo Rosso

Mental disorders pose a global challenge, aggravated by the shortage of qualified mental health professionals. Mental disorder prediction from social media posts by current LLMs is challenging due to the complexities of sequential text data…

Computation and Language · Computer Science 2024-10-08 Raja Kumar , Kishan Maharaj , Ashita Saxena , Pushpak Bhattacharyya

Smartphone sensing offers an unobtrusive and scalable way to track daily behaviors linked to mental health, capturing changes in sleep, mobility, and phone use that often precede symptoms of stress, anxiety, or depression. While most prior…

Machine Learning · Computer Science 2026-01-14 Kaidong Feng , Zhu Sun , Roy Ka-Wei Lee , Xun Jiang , Yin-Leng Theng , Yi Ding

Mental disorders, such as anxiety and depression, have become a global concern that affects people of all ages. Early detection and treatment are crucial to mitigate the negative effects these disorders can have on daily life. Although…

Computers and Society · Computer Science 2025-02-05 Jinghui Qin , Changsong Liu , Tianchi Tang , Dahuang Liu , Minghao Wang , Qianying Huang , Rumin Zhang