English
Related papers

Related papers: When LLMs Meets Acoustic Landmarks: An Efficient A…

200 papers

Speech-based depression detection poses significant challenges for automated detection due to its unique manifestation across individuals and data scarcity. Addressing these challenges, we introduce DAAMAudioCNNLSTM and…

Sound · Computer Science 2024-09-04 Georgios Ioannides , Adrian Kieback , Aman Chadha , Aaron Elkins

Large Language Models (LLMs) have demonstrated remarkable success across diverse fields, establishing a powerful paradigm for complex information processing. This has inspired the integration of speech into LLM frameworks, often by…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Xiangyu Zhang , Fuming Fang , Peng Gao , Bin Qin , Beena Ahmed , Julien Epps

Alzheimer's Disease (AD) is an irreversible neurodegenerative disease affecting 50 million people worldwide. Low-cost, accurate identification of key markers of AD is crucial for timely diagnosis and intervention. Language impairment is one…

Computation and Language · Computer Science 2025-05-27 Tingyu Mo , Jacqueline C. K. Lam , Victor O. K. Li , Lawrence Y. L. Cheung

Mental disorders represent a critical global health challenge, and social media is increasingly viewed as a vital resource for real-time digital phenotyping and intervention. To leverage this data, large language models (LLMs) have been…

Computation and Language · Computer Science 2025-12-23 Zhuohan Ge , Darian Li , Yubo Wang , Nicole Hu , Xinyi Zhu , Haoyang Li , Xin Zhang , Mingtao Zhang , Shihao Qi , Yuming Xu , Han Shi , Chen Jason Zhang , Qing Li

With the availability of voice-enabled devices such as smart phones, mental health disorders could be detected and treated earlier, particularly post-pandemic. The current methods involve extracting features directly from audio signals. In…

Machine Learning · Computer Science 2022-05-17 Nasser Ghadiri , Rasoul Samani , Fahime Shahrokh

Patients with diabetes are at increased risk of comorbid depression or anxiety, complicating their management. This study evaluated the performance of large language models (LLMs) in detecting these symptoms from secure patient messages. We…

This study investigates the utility of speech signals for AI-based depression screening across varied interaction scenarios, including psychiatric interviews, chatbot conversations, and text readings. Participants include depressed patients…

Sound · Computer Science 2024-06-13 Yangbin Chen , Chenyang Xu , Chunfeng Liang , Yanbao Tao , Chuan Shi

Major Depressive Disorder (MDD) is a severe illness that affects millions of people, and it is critical to diagnose this disorder as early as possible. Detecting depression from voice signals can be of great help to physicians and can be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Jinhan Wang , Vijay Ravi , Jonathan Flint , Abeer Alwan

Large language models (LLMs) have achieved remarkable performance on diverse benchmarks, yet existing evaluation practices largely rely on coarse summary metrics that obscure underlying reasoning abilities. In this work, we propose novel…

Methodology · Statistics 2026-03-17 Jia Liu , Zhiyu Xu , Yuqi Gu

Depression has proven to be a significant public health issue, profoundly affecting the psychological well-being of individuals. If it remains undiagnosed, depression can lead to severe health issues, which can manifest physically and even…

Human-Computer Interaction · Computer Science 2024-12-03 Chayan Tank , Sarthak Pol , Vinayak Katoch , Shaina Mehta , Avinash Anand , Rajiv Ratn Shah

This study investigates the use of Large Language Models (LLMs) for improved depression detection from users social media data. Through the use of fine-tuned GPT 3.5 Turbo 1106 and LLaMA2-7B models and a sizable dataset from earlier…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Shahid Munir Shah , Syeda Anshrah Gillani , Mirza Samad Ahmed Baig , Muhammad Aamer Saleem , Muhammad Hamzah Siddiqui

Psychological support hotlines provide critical support for individuals experiencing mental health emergencies, yet current assessments largely rely on human operators whose judgments may vary with professional experience and are…

Computation and Language · Computer Science 2026-05-12 Terumi Chiba , Yang Luo , Ziyun Cui , Yongsheng Tong , Chao Zhang

Large language models (LLMs) have shown exceptional versatility in natural language processing, prompting recent efforts to extend their multimodal capabilities to speech processing through the development of audio large language models…

Sound · Computer Science 2025-04-01 Ting Dang , Yan Gao , Hong Jia

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki

Advances in large language models (LLMs) have enabled a wide range of applications. However, depression prediction is hindered by the lack of large-scale, high-quality, and rigorously annotated datasets. This study introduces DepressLLM,…

Computation and Language · Computer Science 2025-08-13 Sehwan Moon , Aram Lee , Jeong Eun Kim , Hee-Ju Kang , Il-Seon Shin , Sung-Wan Kim , Jae-Min Kim , Min Jhon , Ju-Wan Kim

In this work, we study how to best utilize pre-trained LLMs for automatic speech recognition. Specifically, we compare the tight integration of an acoustic model (AM) with the LLM ("speech LLM") to the traditional way of combining AM and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-17 Robin Schmitt , Albert Zeyer , Mohammad Zeineldeen , Ralf Schlüter , Hermann Ney

We employ a Large Language Model (LLM) to convert unstructured psychological interviews into structured questionnaires spanning various psychiatric and personality domains. The LLM is prompted to answer these questionnaires by impersonating…

Computation and Language · Computer Science 2024-06-12 Gony Rosenman , Lior Wolf , Talma Hendler

The rapid advancements in large language models (LLMs) have opened up new opportunities for transforming patient engagement in healthcare through conversational AI. This paper presents an overview of the current landscape of LLMs in…

Artificial Intelligence · Computer Science 2024-11-27 Bo Wen , Raquel Norel , Julia Liu , Thaddeus Stappenbeck , Farhana Zulkernine , Huamin Chen

The shortage of clinical workforce presents significant challenges in mental healthcare, limiting access to formal diagnostics and services. We aim to tackle this shortage by integrating a customized large language model (LLM) into the…

Computation and Language · Computer Science 2025-05-02 Sichang Tu , Abigail Powers , Natalie Merrill , Negar Fani , Sierra Carter , Stephen Doogan , Jinho D. Choi

Automatic speech recognition (ASR) technology can aid in the detection, monitoring, and assessment of depressive symptoms in individuals. ASR systems have been used as a tool to analyze speech patterns and characteristics that are…

Human-Computer Interaction · Computer Science 2023-08-17 Alice Othmani , Muhammad Muzammel