English
Related papers

Related papers: Dementia Insights: A Context-Based MultiModal Appr…

200 papers

This paper presents a novel Natural Language Processing (NLP) framework for enhancing medical diagnosis through the integration of advanced techniques in data augmentation, feature extraction, and classification. The proposed approach…

Computation and Language · Computer Science 2025-02-12 Mohammad Ali Labbaf Khaniki , Sahabeh Saadati , Mohammad Manthouri

Multimodal depression classification has gained immense popularity over the recent years. We develop a multimodal depression classification system using articulatory coordination features extracted from vocal tract variables and text…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-15 Nadee Seneviratne , Carol Espy-Wilson

While Large Language Models (LLMs) have shown strong performance on clinical text understanding, they struggle with longitudinal prediction tasks such as dementia prognosis, which require reasoning over complex, non-monotonic symptom…

Computation and Language · Computer Science 2026-03-23 Choonghan Kim , Hyunmin Hwang , Hangeol Chang , Jaemin Kim , Jinse Park , Jae-Sung Lim , Jong Chul Ye

Automatic detection of Alzheimer's dementia by speech processing is enhanced when features of both the acoustic waveform and the content are extracted. Audio and text transcription have been widely used in health-related tasks, as spectral…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-12 Edward L. Campbell , Laura Docío-Fernández , Javier Jiménez Raboso , Carmen García-Mateo

Deep speaker embeddings have been shown effective for assessing cognitive impairments aside from their original purpose of speaker verification. However, the research found that speaker embeddings encode speaker identity and an array of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-22 Dongseok Heo , Cheul Young Park , Jaemin Cheun , Myung Jin Ko

Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-01 Mahdi Amiri , Hatef Otroshi Shahreza , Ina Kodrasi

Large language models (LLMs) have shown remarkable performance in vision-language tasks, but their application in the medical field remains underexplored, particularly for integrating structured time series data with unstructured clinical…

Computation and Language · Computer Science 2025-06-17 Shuai Niu , Jing Ma , Hongzhan Lin , Liang Bai , Zhihua Wang , Wei Bi , Yida Xu , Guo Li , Xian Yang

Traditional approaches in speech emotion recognition, such as LSTM, CNN, RNN, SVM, and MLP, have limitations such as difficulty capturing long-term dependencies in sequential data, capturing the temporal dynamics, and struggling to capture…

Sound · Computer Science 2023-08-10 Samiul Islam , Md. Maksudul Haque , Abu Jobayer Md. Sadat

In-context learning (ICL) is a few-shot learning paradigm that involves learning mappings through input-output pairs and appropriately applying them to new instances. Despite the remarkable ICL capabilities demonstrated by Large Language…

Computation and Language · Computer Science 2024-08-06 Peng Wang , Xiaobin Wang , Chao Lou , Shengyu Mao , Pengjun Xie , Yong Jiang

Dementia is a syndrome, generally of a chronic nature characterized by a deterioration in cognitive function, especially in the geriatric population and is severe enough to impact their daily activities. Early diagnosis of dementia is…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-21 Rupayan Chakraborty , Meghna Pandharipande , Chitralekha Bhat , Sunil Kumar Kopparapu

This paper presents our submission to the PROCESS Challenge 2025, focusing on spontaneous speech analysis for early dementia detection. For the three-class classification task (Healthy Control, Mild Cognitive Impairment, and Dementia), we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Yin-Long Liu , Yuanchao Li , Rui Feng , Liu He , Jia-Xin Chen , Yi-Ming Wang , Yu-Ang Chen , Yan-Han Peng , Jia-Hong Yuan , Zhen-Hua Ling

Speech pauses, alongside content and structure, offer a valuable and non-invasive biomarker for detecting dementia. This work investigates the use of pause-enriched transcripts in transformer-based language models to differentiate the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-28 Franziska Braun , Sebastian P. Bayerl , Florian Hönig , Hartmut Lehfeld , Thomas Hillemacher , Tobias Bocklet , Korbinian Riedhammer

Early diagnosis of Alzheimer's Disease (AD) faces multiple data-related challenges, including high variability in patient data, limited access to specialized diagnostic tests, and overreliance on single-type indicators. These challenges are…

Quantitative Methods · Quantitative Biology 2025-03-05 Yizong Xing , Dhita Putri Pratama , Yuke Wang , Yufan Zhang , Brian E. Chapman

The automated evaluation of cognitive status utilizing multimedia technologies presents a promising frontier in early dementia diagnosis. However, the development of robust machine learning models for cognitive impairment detection is…

Databases · Computer Science 2026-04-03 Liuyu Wu , Rui Feng , Jie Li , Wentao Xiang , Yi Zhang , Yin Cao , Siyang Song , Xiao Gu , Jianqing Li , Wei Wang

Societies worldwide are rapidly entering a super-aged era, making elderly health a pressing concern. The aging population is increasing the burden on national economies and households. Dementia cases are rising significantly with this…

Artificial Intelligence · Computer Science 2025-06-03 Chanwoo Park , Anna Seo Gyeong Choi , Sunghye Cho , Chanwoo Kim

Dementia is under-recognized in the community, under-diagnosed by healthcare professionals, and under-coded in claims data. Information on cognitive dysfunction, however, is often found in unstructured clinician notes within medical records…

Mental health disorders are increasingly prevalent worldwide, creating an urgent need for innovative tools to support early diagnosis and intervention. This study explores the potential of Large Language Models (LLMs) in multimodal mental…

Computation and Language · Computer Science 2025-08-14 Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to solving complex problems. However, traditional methods, which finetune LLMs with tool demonstration data, can be both costly and restricted…

Computation and Language · Computer Science 2024-01-17 Shibo Hao , Tianyang Liu , Zhen Wang , Zhiting Hu

Early detection of dementia is critical for timely medical intervention and improved patient outcomes. Neuropsychological tests are widely used for cognitive assessment but have traditionally relied on manual scoring. Automatic dementia…

Machine Learning · Computer Science 2025-07-15 Liming Wang , Saurabhchand Bhati , Cody Karjadi , Rhoda Au , James Glass

Speech contains both acoustic and linguistic patterns that reflect cognitive decline, and therefore models describing only one domain cannot fully capture such complexity. This study investigates how early fusion (EF) of speech and its…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-02 Krystof Novotny , Laureano Moro-Velázquez , Jiri Mekyska