中文
相关论文

相关论文: Augmenting BERT Carefully with Underrepresented Li…

200 篇论文

Research related to automatically detecting Alzheimer's disease (AD) is important, given the high prevalence of AD and the high cost of traditional methods. Since AD significantly affects the content and acoustics of spontaneous speech,…

计算与语言 · 计算机科学 2020-08-05 Aparna Balagopalan , Benjamin Eyre , Frank Rudzicz , Jekaterina Novikova

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

计算与语言 · 计算机科学 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

Alzheimer's disease (AD) is a progressive neurodegenerative disease and recently attracts extensive attention worldwide. Speech technology is considered a promising solution for the early diagnosis of AD and has been enthusiastically…

音频与语音处理 · 电气工程与系统科学 2021-10-05 Ying Qin , Wei Liu , Zhiyuan Peng , Si-Ioi Ng , Jingyu Li , Haibo Hu , Tan Lee

Language model pre-training has proven to be useful in learning universal language representations. As a state-of-the-art language model pre-training model, BERT (Bidirectional Encoder Representations from Transformers) has achieved amazing…

计算与语言 · 计算机科学 2020-02-06 Chi Sun , Xipeng Qiu , Yige Xu , Xuanjing Huang

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

计算与语言 · 计算机科学 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak

Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care and delay progression. Speech based automatic AD screening systems provide a non-intrusive and more scalable alternative to other clinical screening…

机器学习 · 计算机科学 2022-08-09 Yi Wang , Tianzi Wang , Zi Ye , Lingwei Meng , Shoukang Hu , Xixin Wu , Xunying Liu , Helen Meng

Tremendous amounts of multimedia associated with speech information are driving an urgent need to develop efficient and effective automatic summarization methods. To this end, we have seen rapid progress in applying supervised deep neural…

计算与语言 · 计算机科学 2020-06-03 Shi-Yan Weng , Tien-Hong Lo , Berlin Chen

Early diagnosis of Alzheimer's disease (AD) is crucial in facilitating preventive care and to delay further progression. Speech based automatic AD screening systems provide a non-intrusive and more scalable alternative to other clinical…

计算与语言 · 计算机科学 2023-04-03 Yi Wang , Jiajun Deng , Tianzi Wang , Bo Zheng , Shoukang Hu , Xunying Liu , Helen Meng

Alzheimer's disease (AD) stands as the predominant cause of dementia, characterized by a gradual decline in speech and language capabilities. Recent deep-learning advancements have facilitated automated AD detection through spontaneous…

计算与语言 · 计算机科学 2024-09-20 Chin-Po Chen , Jeng-Lin Li

Several studies have been carried out on revealing linguistic features captured by BERT. This is usually achieved by training a diagnostic classifier on the representations obtained from different layers of BERT. The subsequent…

计算与语言 · 计算机科学 2021-09-14 Hosein Mohebbi , Ali Modarressi , Mohammad Taher Pilehvar

Pre-training a transformer-based model for the language modeling task in a large dataset and then fine-tuning it for downstream tasks has been found very useful in recent years. One major advantage of such pre-trained language models is…

计算与语言 · 计算机科学 2020-11-17 Md Tahmid Rahman Laskar , Enamul Hoque , Jimmy Xiangji Huang

More recently, Bidirectional Encoder Representations from Transformers (BERT) was proposed and has achieved impressive success on many natural language processing (NLP) tasks such as question answering and language understanding, due mainly…

计算与语言 · 计算机科学 2021-04-13 Shih-Hsuan Chiu , Berlin Chen

Alzheimers disease is a fatal progressive brain disorder that worsens with time. It is high time we have inexpensive and quick clinical diagnostic techniques for early detection and care. In previous studies, various Machine Learning…

计算与语言 · 计算机科学 2021-09-27 Akshay Valsaraj , Ithihas Madala , Nikhil Garg , Veeky Baths

Dementia is a growing problem as our society ages, and detection methods are often invasive and expensive. Recent deep-learning techniques can offer a faster diagnosis and have shown promising results. However, they require large amounts of…

计算与语言 · 计算机科学 2022-07-19 Anna Hlédiková , Dominika Woszczyk , Alican Akman , Soteris Demetriou , Björn Schuller

Developing high-performance entity normalization algorithms that can alleviate the term variation problem is of great interest to the biomedical community. Although deep learning-based methods have been successfully applied to biomedical…

信息检索 · 计算机科学 2019-08-12 Zongcheng Ji , Qiang Wei , Hua Xu

Alzheimer's Disease (AD) is an irreversible neurodegenerative disease affecting 50 million people worldwide. Low-cost, accurate identification of key markers of AD is crucial for timely diagnosis and intervention. Language impairment is one…

计算与语言 · 计算机科学 2025-05-27 Tingyu Mo , Jacqueline C. K. Lam , Victor O. K. Li , Lawrence Y. L. Cheung

Alzheimer's disease (AD) is the main cause of dementia which is accompanied by loss of memory and may lead to severe consequences in peoples' everyday life if not diagnosed on time. Very few works have exploited transformer-based networks…

计算与语言 · 计算机科学 2022-08-15 Loukas Ilias , Dimitris Askounis

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

声音 · 计算机科学 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

Understanding robustness and sensitivity of BERT models predicting Alzheimer's disease from text is important for both developing better classification models and for understanding their capabilities and limitations. In this paper, we…

计算与语言 · 计算机科学 2021-10-27 Jekaterina Novikova

With the global population aging rapidly, Alzheimer's disease (AD) is particularly prominent in older adults, which has an insidious onset and leads to a gradual, irreversible deterioration in cognitive domains (memory, communication,…

音频与语音处理 · 电气工程与系统科学 2023-03-15 Jinchao Li , Kaitao Song , Junan Li , Bo Zheng , Dongsheng Li , Xixin Wu , Xunying Liu , Helen Meng
‹ 上一页 1 2 3 10 下一页 ›