English
Related papers

Related papers: Exploiting prompt learning with pre-trained langua…

200 papers

Alzheimers Disease (AD) is a progressive neurodegenerative disorder that poses significant challenges in its early diagnosis, often leading to delayed treatment and poorer outcomes for patients. Traditional diagnostic methods, typically…

Machine Learning · Computer Science 2025-08-06 Tatwadarshi P Nagarhalli , Sanket Patil , Vishal Pande , Uday Aswalekar , Prafulla Patil

Large Language Models (LLMs) are machine learning models that have seen widespread adoption due to their capability of handling previously difficult tasks. LLMs, due to their training, are sensitive to how exactly a question is presented,…

Software Engineering · Computer Science 2025-12-22 Jae Yong Lee , Sungmin Kang , Shin Yoo

This paper describes a multi-modal approach for the automatic detection of Alzheimer's disease proposed in the context of the INESC-ID Human Language Technology Laboratory participation in the ADReSS 2020 challenge. Our classification…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-01 Anna Pompili , Thomas Rolland , Alberto Abad

Pre-trained Language Models (PLMs) have the potential to transform mental health support by providing accessible and culturally sensitive resources. However, despite this potential, their effectiveness in mental health care and specifically…

Computation and Language · Computer Science 2024-06-25 Hassan Alhuzali , Ashwag Alasmari

This study introduces Reverse-Speech-Finder (RSF), a groundbreaking neural network backtracking architecture designed to enhance Alzheimer's Disease (AD) diagnosis through speech analysis. Leveraging the power of pre-trained large language…

Machine Learning · Computer Science 2025-05-26 Victor OK Li , Yang Han , Jacqueline CK Lam , Lawrence YL Cheung

Masked Language Modeling (MLM) is widely used to pretrain language models. The standard random masking strategy in MLM causes the pre-trained language models (PLMs) to be biased toward high-frequency tokens. Representation learning of rare…

Computation and Language · Computer Science 2023-05-25 Linhan Zhang , Qian Chen , Wen Wang , Chong Deng , Xin Cao , Kongzhang Hao , Yuxin Jiang , Wei Wang

Alzheimer's disease (AD) constitutes a neurodegenerative disease with serious consequences to peoples' everyday lives, if it is not diagnosed early since there is no available cure. Alzheimer's is the most common cause of dementia, which…

Computation and Language · Computer Science 2023-01-18 Loukas Ilias , Dimitris Askounis , John Psarras

Deep learning, a cutting-edge machine learning approach, outperforms traditional machine learning in identifying intricate structures in complex high-dimensional data, particularly in the domain of healthcare. This study focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Nida Nasir , Muneeb Ahmed , Neda Afreen , Mustafa Sameer

Speech-based automatic detection of Alzheimer's disease (AD) and depression has attracted increased attention. Confidence estimation is crucial for a trust-worthy automatic diagnostic system which informs the clinician about the confidence…

Computation and Language · Computer Science 2024-09-10 Wen Wu , Chao Zhang , Philip C. Woodland

Background:Cognitive assessments represent the most common clinical routine for the diagnosis of Alzheimer's Disease (AD). Given a large number of cognitive assessment tools and time-limited office visits, it is important to determine a…

Quantitative Methods · Quantitative Biology 2020-11-16 Bo Peng , Xiaohui Yao , Shannon L. Risacher , Andrew J. Saykin , Li Shen , Xia Ning

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive…

Machine Learning · Computer Science 2024-02-27 Artem Vysogorets , Achintya Gopal

Early and accessible detection of Alzheimer's disease (AD) remains a major challenge, as current diagnostic methods often rely on costly and invasive biomarkers. Speech and language analysis has emerged as a promising non-invasive and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-06 Franziska Braun , Christopher Witzl , Florian Hönig , Elmar Nöth , Tobias Bocklet , Korbinian Riedhammer

In diagnosing challenging conditions such as Alzheimer's disease (AD), imaging is an important reference. Non-imaging patient data such as patient information, genetic data, medication information, cognitive and memory tests also play a…

Machine Learning · Computer Science 2023-06-01 Yingjie Feng , Jun Wang , Xianfeng Gu , Xiaoyin Xu , Min Zhang

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

The ADReSS Challenge at INTERSPEECH 2020 defines a shared task through which different approaches to the automated recognition of Alzheimer's dementia based on spontaneous speech can be compared. ADReSS provides researchers with a benchmark…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Saturnino Luz , Fasih Haider , Sofia de la Fuente , Davida Fromm , Brian MacWhinney

Alzheimer's disease (AD) is a progressive and irreversible neurodegenerative disease. Early and precise diagnosis of AD is crucial for timely intervention and treatment planning to alleviate the progressive neurodegeneration. However, most…

Image and Video Processing · Electrical Eng. & Systems 2025-07-29 Wenlong Hou , Guangqian Yang , Ye Du , Yeung Lau , Lihao Liu , Junjun He , Ling Long , Shujun Wang

Large language models (LLMs) are becoming a popular tool as they have significantly advanced in their capability to tackle a wide range of language-based tasks. However, LLMs applications are highly vulnerable to prompt injection attacks,…

Computation and Language · Computer Science 2024-11-11 Md Abdur Rahman , Fan Wu , Alfredo Cuzzocrea , Sheikh Iqbal Ahamed

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Alzheimer's disease (AD) is known as one of the major causes of dementia and is characterized by slow progression over several years, with no treatments or available medicines. In this regard, there have been efforts to identify the risk of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Wonsik Jung , Eunji Jun , Heung-Il Suk