English
Related papers

Related papers: Leveraging Prompt Learning and Pause Encoding for …

200 papers

Automatic program repair (APR) techniques have the potential to reduce manual efforts in uncovering and repairing program defects during the code review (CR) process. However, the limited accuracy and considerable time costs associated with…

Software Engineering · Computer Science 2024-01-01 Zelin Zhao , Zhaogui Xu , Jialong Zhu , Peng Di , Yuan Yao , Xiaoxing Ma

Diffusion-based large language models (DLLMs) have recently attracted growing interest as an alternative to autoregressive decoders. In this work, we present an empirical study on using the diffusion-based large language model LLaDA for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-02 Mengqi Wang , Zhan Liu , Zengrui Jin , Guangzhi Sun , Chao Zhang , Philip C. Woodland

Large language models (LLMs) have achieved remarkable performance across a wide range of tasks, but their increasing parameter sizes significantly slow down inference. Speculative decoding mitigates this issue by leveraging a smaller draft…

Computation and Language · Computer Science 2026-05-27 Kuan-Wei Lu , Ding-Yong Hong , Pangfeng Liu , Jan-Jan Wu

In this work we explore how language models can be employed to analyze language and discriminate between mentally impaired and healthy subjects through the perplexity metric. Perplexity was originally conceived as an information-theoretic…

Computation and Language · Computer Science 2023-02-03 Davide Colla , Matteo Delsanto , Marco Agosto , Benedetto Vitiello , Daniele Paolo Radicioni

Multi-speaker automatic speech recognition (ASR) aims to transcribe conversational speech involving multiple speakers, requiring the model to capture not only what was said, but also who said it and sometimes when it was spoken. Recent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Li Li , Ming Cheng , Weixin Zhu , Yannan Wang , Juan Liu , Ming Li

Automatic speech recognition (ASR) systems have achieved strong performance on general transcription tasks. However, they continue to struggle with recognizing rare named entities and adapting to domain mismatches. In contrast, large…

Computation and Language · Computer Science 2025-08-21 Shaoshi Ling , Guoli Ye

For sequence transduction tasks like speech recognition, a strong structured prior model encodes rich information about the target space, implicitly ruling out invalid sequences by assigning them low probability. In this work, we propose…

Computation and Language · Computer Science 2020-02-25 Wei-Ning Hsu , Ann Lee , Gabriel Synnaeve , Awni Hannun

Background: Alzheimer's disease (AD) diagnosis heavily relies on amyloid-beta positron emission tomography (Abeta-PET), which is limited by high cost and limited accessibility. This study explores whether Abeta-PET spatial patterns can be…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhengjie Zhang , Xiaoxie Mao , Qihao Guo , Shaoting Zhang , Qi Huang , Mu Zhou , Fang Xie , Mianxin Liu

Automated diagnosis of Alzheimer Disease(AD) from brain imaging, such as magnetic resonance imaging (MRI), has become increasingly important and has attracted the community to contribute many deep learning methods. However, many of these…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Yifeng Wang , Ke Chen , Haohan Wang

Depression is a critical concern in global mental health, prompting extensive research into AI-based detection methods. Among various AI technologies, Large Language Models (LLMs) stand out for their versatility in mental healthcare…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Xiangyu Zhang , Hexin Liu , Kaishuai Xu , Qiquan Zhang , Daijiao Liu , Beena Ahmed , Julien Epps

Deep learning (DL) has been used in the automatic diagnosis of Mild Cognitive Impairment (MCI) and Alzheimer's Disease (AD) with brain imaging data. However, previous methods have not fully exploited the relation between brain image and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Luoyao Kang , Haifan Gong , Xiang Wan , Haofeng Li

A plethora of deep learning models have been developed for the task of Alzheimer's disease classification from brain MRI scans. Many of these models report high performance, achieving three-class classification accuracy of up to 95%.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Ziqiang Guan , Ritesh Kumar , Yi Ren Fung , Yeahuay Wu , Madalina Fiterau

As the global burden of Alzheimer's disease (AD) continues to grow, early and accurate detection has become increasingly critical, especially in regions with limited access to advanced diagnostic tools. We propose BRAINS (Biomedical…

Machine Learning · Computer Science 2025-11-05 Rajan Das Gupta , Md Kishor Morol , Nafiz Fahad , Md Tanzib Hosain , Sumaya Binte Zilani Choya , Md Jakir Hossen

Recently, prompt tuning \cite{lester2021power} has gradually become a new paradigm for NLP, which only depends on the representation of the words by freezing the parameters of pre-trained language models (PLMs) to obtain remarkable…

Computation and Language · Computer Science 2022-01-31 Pan He , Yuxi Chen , Yan Wang , Yanru Zhang

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

The rapid global aging trend has led to an increase in dementia cases, including Alzheimer's disease, underscoring the urgent need for early and accurate diagnostic methods. Traditional diagnostic techniques, such as cognitive tests,…

Machine Learning · Computer Science 2024-09-06 Juan A. Berrios Moya

Speech datasets for identifying Alzheimer's disease (AD) are generally restricted to participants performing a single task, e.g. describing an image shown to them. As a result, models trained on linguistic features derived from such…

Machine Learning · Computer Science 2018-11-30 Aparna Balagopalan , Jekaterina Novikova , Frank Rudzicz , Marzyeh Ghassemi

Alzheimer's disease is a progressive neurodegenerative disorder that primarily affects cognitive functions such as memory, thinking, and behavior. In this disease, there is a critical phase, mild cognitive impairment, that is really…

Signal Processing · Electrical Eng. & Systems 2024-04-02 Arezoo Borji , Taha-Hossein Hejazi , Abbas Seifi

Quality of data plays an important role in most deep learning tasks. In the speech community, transcription of speech recording is indispensable. Since the transcription is usually generated artificially, automatically finding errors in…

Computation and Language · Computer Science 2019-07-23 Xiaofei Wang , Jinyi Yang , Ruizhi Li , Samik Sadhu , Hynek Hermansky

Building on the success of the ADReSS Challenge at Interspeech 2020, which attracted the participation of 34 teams from across the world, the ADReSSo Challenge targets three difficult automatic prediction problems of societal and medical…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-20 Saturnino Luz , Fasih Haider , Sofia de la Fuente , Davida Fromm , Brian MacWhinney