English
Related papers

Related papers: Augmenting word2vec with latent Dirichlet allocati…

200 papers

This study presents a novel approach for knowledge distillation (KD) from a BERT teacher model to an automatic speech recognition (ASR) model using intermediate layers. To distil the teacher's knowledge, we use an attention decoder that…

Computation and Language · Computer Science 2024-01-23 Michael Hentschel , Yuta Nishikawa , Tatsuya Komatsu , Yusuke Fujita

For decades, a variety of predictive approaches have been proposed and evaluated in terms of their prediction capability for Alzheimer's Disease (AD) and its precursor - mild cognitive impairment (MCI). Most of them focused on prediction or…

Neurons and Cognition · Quantitative Biology 2022-12-20 Lu Zhang , Li Wang , Tianming Liu , Dajiang Zhu

Alzheimer's disease (AD) progresses heterogeneously across individuals, motivating subject-specific synthesis of follow-up magnetic resonance imaging (MRI) to support progression assessment. While Diffusion Transformers (DiT), an emerging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Juneyong Lee , Geonwoo Baek , Ikbeom Jang

Reliable early detection of Alzheimer's disease (AD) is challenging, particularly due to limited availability of labeled data. While large language models (LLMs) have shown strong transfer capabilities across domains, adapting them to the…

Computation and Language · Computer Science 2026-02-13 Lei Jiang , Yue Zhou , Natalie Parde

In the field of Alzheimer's disease diagnosis, segmentation and classification tasks are inherently interconnected. Sharing knowledge between models for these tasks can significantly improve training efficiency, particularly when training…

Image and Video Processing · Electrical Eng. & Systems 2024-09-13 Ke Chen , Yifeng Wang , Yufei Zhou , Haohan Wang

This paper presents our submission to the PROCESS Challenge 2025, focusing on spontaneous speech analysis for early dementia detection. For the three-class classification task (Healthy Control, Mild Cognitive Impairment, and Dementia), we…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Yin-Long Liu , Yuanchao Li , Rui Feng , Liu He , Jia-Xin Chen , Yi-Ming Wang , Yu-Ang Chen , Yan-Han Peng , Jia-Hong Yuan , Zhen-Hua Ling

Multi-layer models with multiple attention heads per layer provide superior translation quality compared to simpler and shallower models, but determining what source context is most relevant to each target word is more challenging as a…

Computation and Language · Computer Science 2019-02-01 Thomas Zenkel , Joern Wuebker , John DeNero

Standard LDA model suffers the problem that the topic assignment of each word is independent and word correlation hence is neglected. To address this problem, in this paper, we propose a model called Word Related Latent Dirichlet Allocation…

Computation and Language · Computer Science 2014-11-11 Xun Wang

Early detection of cognitive disorders such as Alzheimer's disease is critical for enabling timely clinical intervention and improving patient outcomes. In this work, we introduce CogniAlign, a multimodal architecture for Alzheimer's…

Machine Learning · Computer Science 2025-10-27 David Ortiz-Perez , Manuel Benavent-Lledo , Javier Rodriguez-Juan , Jose Garcia-Rodriguez , David Tomás

We model Alzheimer's disease (AD) progression by combining differential equations (DEs) and reinforcement learning (RL) with domain knowledge. DEs provide relationships between some, but not all, factors relevant to AD. We assume that the…

Machine Learning · Computer Science 2021-11-03 Krishnakant V. Saboo , Anirudh Choudhary , Yurui Cao , Gregory A. Worrell , David T. Jones , Ravishankar K. Iyer

Machine learning has shown promise for automatic detection of Alzheimer's disease (AD) through speech; however, efforts are hampered by a scarcity of data, especially in languages other than English. We propose a method to learn a…

Computation and Language · Computer Science 2019-06-04 Bai Li , Yi-Te Hsu , Frank Rudzicz

Despite many years of research into latent Dirichlet allocation (LDA), applying LDA to collections of non-categorical items is still challenging. Yet many problems with much richer data share a similar structure and could benefit from the…

Machine Learning · Statistics 2020-01-08 Iryna Korshunova , Hanchen Xiong , Mateusz Fedoryszak , Lucas Theis

Speech pause is an effective biomarker in dementia detection. Recent deep learning models have exploited speech pauses to achieve highly accurate dementia detection, but have not exploited the interpretability of speech pauses, i.e., what…

Computation and Language · Computer Science 2021-11-16 Youxiang Zhu , Bang Tran , Xiaohui Liang , John A. Batsis , Robert M. Roth

Using kinematic properties of handwriting to support the diagnosis of neurodegenerative disease is a real challenge: non-invasive detection techniques combined with machine learning approaches promise big steps forward in this research…

Computation and Language · Computer Science 2024-01-08 Nicole Dalia Cilia , Claudio De Stefano , Francesco Fontanella , Sabato Marco Siniscalchi

Alzheimer s disease (AD) is a progressive neurodegenerative disorder characterized by cognitive decline, where early detection is essential for timely intervention and improved patient outcomes. Traditional diagnostic methods are…

Accurate diagnosis of Alzheimer's disease (AD) is both challenging and time consuming. With a systematic approach for early detection and diagnosis of AD, steps can be taken towards the treatment and prevention of the disease. This study…

Machine Learning · Computer Science 2022-12-12 Harshit Parmar , Eric Walden

Augmenting data in image space (eg. flipping, cropping etc) and activation space (eg. dropout) are being widely used to regularise deep neural networks and have been successfully applied on several computer vision tasks. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Binod Bhattarai , Rumeysa Bodur , Tae-Kyun Kim

Contextual word embeddings obtained from pre-trained language model (PLM) have proven effective for various natural language processing tasks at the word level. However, interpreting the hidden aspects within embeddings, such as syntax and…

Computation and Language · Computer Science 2023-10-10 Nayoung Choi

This report provides an overview of the current state of the art deep learning architectures and optimisation techniques, and uses the ADNI hippocampus MRI dataset as an example to compare the effectiveness and efficiency of different…

Machine Learning · Computer Science 2015-05-11 Matthew Lai

Accurate modeling of cognitive decline in Alzheimer's disease is essential for early stratification and personalized management. While tabular predictors provide robust markers of global risk, their ability to capture subtle brain changes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Nathaniel Putera , Daniel Vilet Rodríguez , Noah Videcrantz , Julia Machnio , Mostafa Mehdipour Ghazi