English
Related papers

Related papers: Speech as a Multimodal Digital Phenotype for Multi…

200 papers

We describe the development of a model to detect user-level clinical depression based on a user's temporal social media posts. Our model uses a Depression Symptoms Detection (DSD) classifier, which is trained on the largest existing samples…

Computation and Language · Computer Science 2023-03-31 Nawshad Farruque , Randy Goebel , Sudhakar Sivapalan , Osmar R. Zaïane

In recent years, advancements in deep learning techniques have considerably enhanced the efficiency and accuracy of medical diagnostics. In this work, a novel approach using multi-task learning (MTL) for the simultaneous classification of…

Machine Learning · Computer Science 2024-04-08 Suma K , Deepali Koppad , Preethi Kumar , Neha A Kantikar , Surabhi Ramesh

Depression is a prevalent mental health disorder that is difficult to detect early due to subjective symptom assessments. Recent advancements in large language models have offered efficient and cost-effective approaches for this objective.…

Computation and Language · Computer Science 2025-04-08 Longdi Xian , Jianzhang Ni , Mingzhu Wang

Bipolar disorder (BD) is closely associated with an increased risk of suicide. However, while the prior work has revealed valuable insight into understanding the behavior of BD patients on social media, little attention has been paid to…

Computation and Language · Computer Science 2023-07-06 Daeun Lee , Sejung Son , Hyolim Jeon , Seungbae Kim , Jinyoung Han

Depression is one of the most common mental disorders, which imposes heavy negative impacts on one's daily life. Diagnosing depression based on the interview is usually in the form of questions and answers. In this process, the audio…

Multimedia · Computer Science 2022-06-28 Yanrong Guo , Chenyang Zhu , Shijie Hao , Richang Hong

Mental health disorders remain among the leading cause of disability worldwide, yet conditions such as depression, anxiety, and Post-Traumatic Stress Disorder (PTSD) are frequently underdiagnosed or misdiagnosed due to subjective…

Computation and Language · Computer Science 2025-10-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

Speech emotion recognition (SER) has received a great deal of attention in recent years in the context of spontaneous conversations. While there have been notable results on datasets like the well known corpus of naturalistic dyadic…

Computation and Language · Computer Science 2024-01-02 Alex-Răzvan Ispas , Théo Deschamps-Berger , Laurence Devillers

This study investigates explainable machine learning algorithms for identifying depression from speech. Grounded in evidence from speech production that depression affects motor control and vowel generation, pre-trained vowel-based…

Machine Learning · Computer Science 2024-10-25 Kexin Feng , Theodora Chaspari

Mental health conditions affect hundreds of millions globally, yet early detection remains limited. While large language models (LLMs) have shown promise in mental health applications, their size and computational demands hinder practical…

Artificial Intelligence · Computer Science 2025-12-17 Tianyi Zhang , Xiangyuan Xue , Lingyan Ruan , Shiya Fu , Feng Xia , Simon D'Alfonso , Vassilis Kostakos , Ting Dang , Hong Jia

The people with Major Depressive Disorder (MDD) exhibit the symptoms of tonal variations in their speech compared to the healthy counterparts. However, these tonal variations not only confine to the state of MDD but also on the language,…

Computation and Language · Computer Science 2024-09-24 Sona Binu , Jismi Jose , Fathima Shimna K , Alino Luke Hans , Reni K. Cherian , Starlet Ben Alex , Priyanka Srivastava , Chiranjeevi Yarra

Despite the increasing demand for AI-based mental health monitoring tools, their practical utility for clinicians is limited by the lack of interpretability.The CLPsych 2024 Shared Task (Chim et al., 2024) aims to enhance the…

Computation and Language · Computer Science 2024-02-26 Hyolim Jeon , Dongje Yoo , Daeun Lee , Sejung Son , Seungbae Kim , Jinyoung Han

Depression is one of the most common mental illness problems, and the symptoms shown by patients are not consistent, making it difficult to diagnose in the process of clinical practice and pathological research. Although researchers hope…

Computers and Society · Computer Science 2024-10-08 Xiaohang Xu , Hao Peng , Lichao Sun , Md Zakirul Alam Bhuiyan , Lianzhong Liu , Lifang He

Background:Speech patterns have emerged as potential diagnostic markers for conditions with varying etiologies. Machine learning (ML) presents an opportunity to harness these patterns for accurate disease diagnosis. Objective: This review…

Computation and Language · Computer Science 2025-03-10 Birger Moell , Fredrik Sand Aronsson , Per Östberg , Jonas Beskow

Depression-diagnosis-oriented chat aims to guide patients in self-expression to collect key symptoms for depression detection. Recent work focuses on combining task-oriented dialogue and chitchat to simulate the interview-based depression…

Human-Computer Interaction · Computer Science 2025-08-21 Yiyang Gu , Yougen Zhou , Qin Chen , Ningning Zhou , Jie Zhou , Aimin Zhou , Liang He

The advancement of AI systems for mental health support is hindered by limited access to therapeutic conversation data, particularly for trauma treatment. We present Thousand Voices of Trauma, a synthetic benchmark dataset of 3,000 therapy…

Computers and Society · Computer Science 2025-05-19 Suhas BN , Andrew M. Sherrill , Rosa I. Arriaga , Chris W. Wiese , Saeed Abdullah

Cognitive decline is highly heterogeneous across individuals, which complicates prognosis, trial design, and treatment planning. We present the Personalized Cognitive Decline Assessment Digital Twin (PCD-DT), a multimodal and…

Artificial Intelligence · Computer Science 2026-05-01 Bulent Soykan , Gulsah Hancerliogullari Koksalmis , Hsin-Hsiung Huang , Laura J. Brattain

Dialogue serves as the most natural manner of human-computer interaction (HCI). Recent advancements in speech language models (SLM) have significantly enhanced speech-based conversational AI. However, these models are limited to turn-based…

Computation and Language · Computer Science 2024-08-06 Ziyang Ma , Yakun Song , Chenpeng Du , Jian Cong , Zhuo Chen , Yuping Wang , Yuxuan Wang , Xie Chen

We address a challenging and practical task of labeling questions in speech in real time during telephone calls to emergency medical services in English, which embeds within a broader decision support system for emergency call-takers. We…

Computation and Language · Computer Science 2020-05-13 Jakob D. Havtorn , Jan Latko , Joakim Edin , Lasse Borgholt , Lars Maaløe , Lorenzo Belgrano , Nicolai F. Jacobsen , Regitze Sdun , Željko Agić

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

Sound · Computer Science 2026-04-21 Xingyuan Li , Mengyue Wu

Multimodal deep learning (MDL) has emerged as a transformative approach in computational pathology. By integrating complementary information from multiple data sources, MDL models have demonstrated superior predictive performance across…

Quantitative Methods · Quantitative Biology 2025-11-17 Seth Alain Chang , Muhammad Mueez Amjad , Noorul Wahab , Ethar Alzaid , Nasir Rajpoot , Adam Shephard