中文
相关论文

相关论文: MINT: Multimodal Imaging-to-Speech Knowledge Trans…

200 篇论文

Deep learning methods based on Convolutional Neural Networks (CNNs) have shown great potential to improve early and accurate diagnosis of Alzheimer's disease (AD) dementia based on imaging data. However, these methods have yet to be widely…

The prediction of mild cognitive impairment (MCI) conversion to Alzheimer's disease (AD) is important for early treatment to prevent or slow the progression of AD. To accurately predict the MCI conversion to stable MCI or progressive MCI,…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Linfeng Liu , Junyan Lyu , Siyu Liu , Xiaoying Tang , Shekhar S. Chandra , Fatima A. Nasrallah

Deep Learning (DL) in neuroimaging has become increasingly relevant for detecting neurological conditions and neurodegenerative disorders. One of the most predominant biomarkers in neuroimaging is represented by brain age, which has been…

图像与视频处理 · 电气工程与系统科学 2025-11-20 Carlo Alberto Barbano , Matteo Brunello , Benoit Dufumier , Marco Grangetto

Real-time magnetic resonance imaging (rtMRI) of speech production enables non-invasive visualization of dynamic vocal-tract motion and is valuable for speech science and clinical assessment. However, rtMRI is fundamentally constrained by…

Dementia encompasses a group of syndromes that impair cognitive functions such as memory, reasoning, and the ability to perform daily activities. As populations globally age, over 10 million new dementia diagnoses are reported annually.…

音频与语音处理 · 电气工程与系统科学 2026-04-24 Marko Niemelä , Mikaela von Bonsdorff , Sami Äyrämö , Tommi Kärkkäinen

For the first time, we propose using a multiple instance learning based convolution-free transformer model, called Multiple Instance Neuroimage Transformer (MINiT), for the classification of T1weighted (T1w) MRIs. We first present several…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Ayush Singla , Qingyu Zhao , Daniel K. Do , Yuyin Zhou , Kilian M. Pohl , Ehsan Adeli

Exploring the application of deep learning technologies in the field of medical diagnostics, Magnetic Resonance Imaging (MRI) provides a unique perspective for observing and diagnosing complex neurodegenerative diseases such as Alzheimer…

图像与视频处理 · 电气工程与系统科学 2024-03-26 Shaojie Li , Haichen Qu , Xinqi Dong , Bo Dang , Hengyi Zang , Yulu Gong

Collecting and accessing a large amount of medical data is very time-consuming and laborious, not only because it is difficult to find specific patients but also because it is required to resolve the confidentiality of a patient's medical…

声音 · 计算机科学 2021-03-04 Junghyun Koo , Jie Hwan Lee , Jaewoo Pyo , Yujin Jo , Kyogu Lee

Medical vision-language models (Med-VLMs) have shown impressive results in tasks such as report generation and visual question answering, but they still face several limitations. Most notably, they underutilize patient metadata and lack…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Fangqi Cheng , Surajit Ray , Xiaochen Yang

The early diagnosis of Alzheimer's Disease (AD) through non invasive methods remains a significant healthcare challenge. We present NeuroXVocal, a novel dual-component system that not only classifies but also explains potential AD cases…

The detection of Alzheimer's disease (AD) from spontaneous speech has attracted increasing attention while the sparsity of training data remains an important issue. This paper handles the issue by knowledge transfer, specifically from both…

计算与语言 · 计算机科学 2024-04-02 Ziyun Cui , Wen Wu , Wei-Qiang Zhang , Ji Wu , Chao Zhang

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

Automatic detection of Alzheimer's dementia by speech processing is enhanced when features of both the acoustic waveform and the content are extracted. Audio and text transcription have been widely used in health-related tasks, as spectral…

音频与语音处理 · 电气工程与系统科学 2020-08-12 Edward L. Campbell , Laura Docío-Fernández , Javier Jiménez Raboso , Carmen García-Mateo

Subjective cognitive decline (SCD) is a preclinical stage of Alzheimer's disease (AD) which occurs even before mild cognitive impairment (MCI). Progressive SCD will convert to MCI with the potential of further evolving to AD. Therefore,…

计算机视觉与模式识别 · 计算机科学 2023-02-17 Hao Guan , Ling Yue , Pew-Thian Yap , Shifu Xiao , Andrea Bozoki , Mingxia Liu

Reliable Alzheimer's disease (AD) diagnosis increasingly relies on multimodal assessments combining structural Magnetic Resonance Imaging (MRI) and Electronic Health Records (EHR). However, deploying these models is bottlenecked by modality…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Guanchen Wu , Zhe Huang , Yuzhang Xie , Runze Yan , Akul Chopra , Deqiang Qiu , Xiao Hu , Fei Wang , Carl Yang

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

图像与视频处理 · 电气工程与系统科学 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Deep learning has shown significant potential in diagnosing neurodegenerative diseases from MRI data. However, most existing methods rely heavily on large volumes of labeled data and often yield representations that lack interpretability.…

计算机视觉与模式识别 · 计算机科学 2025-09-10 Fangqi Cheng , Yingying Zhao , Xiaochen Yang

Early prognosis of Alzheimer's dementia is hard. Mild cognitive impairment (MCI) typically precedes Alzheimer's dementia, yet only a fraction of MCI individuals will progress to dementia, even when screened using biomarkers. We propose here…

Information from neuroimaging examinations is increasingly used to support diagnoses of dementia, e.g., Alzheimer's disease. While current clinical practice is mainly based on visual inspection and feature engineering, Deep Learning…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Lisa Anita De Santi , Jörg Schlötterer , Michael Scheschenja , Joel Wessendorf , Meike Nauta , Vincenzo Positano , Christin Seifert

Pathology foundation models learn morphological representations through self-supervised pretraining on large-scale whole-slide images, yet they do not explicitly capture the underlying molecular state of the tissue. Spatial transcriptomics…

计算机视觉与模式识别 · 计算机科学 2026-03-10 Minsoo Lee , Jonghyun Kim , Juseung Yun , Sunwoo Yu , Jongseong Jang