English
Related papers

Related papers: Speech as a Multimodal Digital Phenotype for Multi…

200 papers

The delayed access to specialized psychiatric assessments and care for patients at risk of suicidal tendencies in emergency departments creates a notable gap in timely intervention, hindering the provision of adequate mental health support…

Speech large language models (LLMs) observe paralinguistic cues such as prosody, emotion, and non-verbal sounds--crucial for intent understanding. However, leveraging these cues faces challenges: limited training data, annotation…

The increasing use of electronic forms of communication presents new opportunities in the study of mental health, including the ability to investigate the manifestations of psychiatric diseases unobtrusively and in the setting of patients'…

Human-Computer Interaction · Computer Science 2018-03-28 Bokai Cao , Lei Zheng , Chenwei Zhang , Philip S. Yu , Andrea Piscitello , John Zulueta , Olu Ajilore , Kelly Ryan , Alex D. Leow

Social media platforms provide valuable insights into mental health trends by capturing user-generated discussions on conditions such as depression, anxiety, and suicidal ideation. Machine learning (ML) and deep learning (DL) models have…

Computation and Language · Computer Science 2025-04-28 Zhanyi Ding , Zhongyan Wang , Yeyubei Zhang , Yuchen Cao , Yunchong Liu , Xiaorui Shen , Yexin Tian , Jianglai Dai

This paper presents the systems and results for the Multimodal Social Media Data Analysis in Dravidian Languages (MSMDA-DL) shared task at the Fifth Workshop on Speech, Vision, and Language Technologies for Dravidian Languages…

Computation and Language · Computer Science 2025-03-18 Sidney Wong , Andrew Li

Social media has recently emerged as a premier method to disseminate information online. Through these online networks, tens of millions of individuals communicate their thoughts, personal experiences, and social ideals. We therefore…

Social and Information Networks · Computer Science 2016-07-26 Moin Nadeem

Depression is a serious medical condition that is suffered by a large number of people around the world. It significantly affects the way one feels, causing a persistent lowering of mood. In this paper, we propose a novel attention-based…

Computers and Society · Computer Science 2019-04-17 Syed Arbaaz Qureshi , Mohammed Hasanuzzaman , Sriparna Saha , Gaël Dias

Psychiatrists diagnose mental disorders via the linguistic use of patients. Still, due to data privacy, existing passive mental health monitoring systems use alternative features such as activity, app usage, and location via mobile devices.…

Computation and Language · Computer Science 2023-10-26 Jaemin Shin , Hyungjun Yoon , Seungjoo Lee , Sungjoon Park , Yunxin Liu , Jinho D. Choi , Sung-Ju Lee

Chatbots via large language models (LLMs) generate fluent responses but often struggle with when to speak, especially for brief, timely listener reactions during ongoing dialogue. We present a multimodal strategy for LLMs, which leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Zikai Liao , Yi Ouyang , Yi-Lun Lee , Chen-Ping Yu , Yi-Hsuan Tsai , Zhaozheng Yin

Introduction: Alzheimer's disease is a type of dementia in which early diagnosis plays a major rule in the quality of treatment. Among new works in the diagnosis of Alzheimer's disease, there are many of them analyzing the voice stream…

Machine Learning · Computer Science 2019-10-02 S. Soroush Haj Zargarbashi , Bagher Babaali

Preventing Veteran suicide is a national priority. The US Department of Veterans Affairs (VA) collects, analyzes, and publishes data to inform suicide prevention strategies. Current approaches for detecting suicidal ideation mostly rely on…

Computers and Society · Computer Science 2020-09-29 Vaibhav Sourirajan , Anas Belouali , Mary Ann Dutton , Matthew Reinhard , Jyotishman Pathak

We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The LLM is prompted to answer these questionnaires by impersonating…

Computation and Language · Computer Science 2024-06-12 Gony Rosenman , Lior Wolf , Talma Hendler

Depression is a severe mental disorder, and reliable identification plays a critical role in early intervention and treatment. Multimodal depression detection aims to improve diagnostic performance by jointly modeling complementary…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chongxiao Wang , Junjie Liang , Peng Cao , Jinzhu Yang , Osmar R. Zaiane

Over half of US adults with Alzheimer disease and related dementias remain undiagnosed, and speech-based screening offers a scalable detection approach. We compared large language model adaptation strategies for dementia detection using the…

Mental health has attracted substantial attention in recent years and LLM can be an effective technology for alleviating this problem owing to its capability in text understanding and dialogue. However, existing research in this domain…

Computation and Language · Computer Science 2024-12-09 Jinpeng Hu , Tengteng Dong , Luo Gang , Hui Ma , Peng Zou , Xiao Sun , Dan Guo , Xun Yang , Meng Wang

Pre-trained large language models have recently achieved ground-breaking performance in a wide variety of language understanding tasks. However, the same model can not be applied to multimodal behavior understanding tasks (e.g., video…

Computation and Language · Computer Science 2023-03-30 Md Kamrul Hasan , Md Saiful Islam , Sangwu Lee , Wasifur Rahman , Iftekhar Naim , Mohammed Ibrahim Khan , Ehsan Hoque

Multimodal schizophrenia assessment systems have gained traction over the last few years. This work introduces a schizophrenia assessment system to discern between prominent symptom classes of schizophrenia and predict an overall…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-19 Gowtham Premananth , Carol Espy-Wilson

Dementia is a neurodegenerative disease that causes gradual cognitive impairment, which is very common in the world and undergoes a lot of research every year to prevent and cure it. It severely impacts the patient's ability to remember…

Depression is a common mental disorder. Automatic depression detection tools using speech, enabled by machine learning, help early screening of depression. This paper addresses two limitations that may hinder the clinical implementations of…

Computation and Language · Computer Science 2023-10-09 Qingkun Deng , Saturnino Luz , Sofia de la Fuente Garcia

Major depressive disorder is a common mental disorder that affects almost 7% of the adult U.S. population. The 2017 Audio/Visual Emotion Challenge (AVEC) asks participants to build a model to predict depression levels based on the audio,…

Computation and Language · Computer Science 2018-03-29 Yuan Gong , Christian Poellabauer