中文
相关论文

相关论文: Towards Generalisable Foundation Models for Brain …

200 篇论文

In this study, we present a multimodal framework for predicting neuro-facial disorders by capturing both vocal and facial cues. We hypothesize that explicitly disentangling shared and modality-specific representations within multimodal…

音频与语音处理 · 电气工程与系统科学 2026-01-13 Mohd Mujtaba Akhtar , Girish , Muskaan Singh

Brain imaging analysis is fundamental in neuroscience, providing valuable insights into brain structure and function. Traditional workflows follow a sequential pipeline-brain extraction, registration, segmentation, parcellation, network…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Yao Su , Keqi Han , Mingjie Zeng , Lichao Sun , Liang Zhan , Carl Yang , Lifang He , Xiangnan Kong

Foundation models pre-trained on large-scale natural image datasets offer a powerful paradigm for medical image segmentation. However, effectively transferring their learned representations for precise clinical applications remains a…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Haoyue Li , Yifan Gao , Feng Yuan , Xiaosong Wang , Xin Gao

Neuroscience and artificial intelligence represent distinct yet complementary pathways to general intelligence. However, amid the ongoing boom in AI research and applications, the translational synergy between these two fields has grown…

神经与进化计算 · 计算机科学 2026-01-30 Baiyu Chen , Yujie Wu , Siyuan Xu , Peng Qu , Dehua Wu , Xu Chu , Haodong Bian , Shuo Zhang , Bo Xu , Youhui Zhang , Zhengyu Ma , Guoqi Li

Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and…

图像与视频处理 · 电气工程与系统科学 2025-08-14 Xuanru Zhou , Cheng Li , Shuqiang Wang , Ye Li , Tao Tan , Hairong Zheng , Shanshan Wang

Non-invasive Brain-Computer Interfaces (BCI) offer a safe and accessible means of connecting the human brain to external devices, with broad applications in home and clinical settings to enhance human capabilities. However, the high noise…

机器学习 · 计算机科学 2025-08-06 Jiamin Wu , Zichen Ren , Junyu Wang , Pengyu Zhu , Yonghao Song , Mianxin Liu , Qihao Zheng , Lei Bai , Wanli Ouyang , Chunfeng Song

Diffusion tensor imaging (DTI) provides crucial insights into the microstructure of the human brain, but it can be time-consuming to acquire compared to more readily available T1-weighted (T1w) magnetic resonance imaging (MRI). To address…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Shaorong Zhang , Tamoghna Chattopadhyay , Sophia I. Thomopoulos , Jose-Luis Ambite , Paul M. Thompson , Greg Ver Steeg

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

图像与视频处理 · 电气工程与系统科学 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

Brain foundation models bring the foundation model paradigm to the field of neuroscience. Like language and image foundation models, they are general-purpose AI systems pretrained on large-scale datasets that adapt readily to downstream…

计算机与社会 · 计算机科学 2026-02-04 Margot Hanley , Jiunn-Tyng Yeh , Ryan Rodriguez , Jack Pilkington , Nita Farahany

Cytoarchitectonic mapping provides anatomically grounded parcellations of brain structure and forms a foundation for integrative, multi-modal neuroscience analyses. These parcellations are defined based on the shape, density, and spatial…

图像与视频处理 · 电气工程与系统科学 2026-01-16 Shiqi Zhang , Fang Xu , Pengcheng Zhou

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

图像与视频处理 · 电气工程与系统科学 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

图像与视频处理 · 电气工程与系统科学 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

计算机视觉与模式识别 · 计算机科学 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Foundation vision encoders such as CLIP and DINOv2, trained on web-scale data, exhibit strong transfer performance across tasks and datasets. However, medical imaging foundation models remain constrained by smaller datasets, limiting our…

Accurate left atrium (LA) segmentation from pre-operative scans is crucial for diagnosing atrial fibrillation, treatment planning, and supporting surgical interventions. While deep learning models are key in medical image segmentation, they…

图像与视频处理 · 电气工程与系统科学 2024-11-15 Bipasha Kundu , Bidur Khanal , Richard Simon , Cristian A. Linte

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

图像与视频处理 · 电气工程与系统科学 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

The emergence of foundation models in neuroimaging is driven by the increasing availability of large-scale and heterogeneous brain imaging datasets. Recent advances in self-supervised learning, particularly reconstruction-based objectives,…

Diffeomorphic deformable multi-modal image registration is a challenging task which aims to bring images acquired by different modalities to the same coordinate space and at the same time to preserve the topology and the invertibility of…

图像与视频处理 · 电气工程与系统科学 2022-03-16 Vasiliki Sideri-Lampretsa , Georgios Kaissis , Daniel Rueckert

Deep learning-based models in medical imaging often struggle to generalize effectively to new scans due to data heterogeneity arising from differences in hardware, acquisition parameters, population, and artifacts. This limitation presents…

图像与视频处理 · 电气工程与系统科学 2023-08-09 Sebastian Nørgaard Llambias , Mads Nielsen , Mostafa Mehdipour Ghazi