English
Related papers

Related papers: Towards Generalisable Foundation Models for Brain …

200 papers

In this study, we present a multimodal framework for predicting neuro-facial disorders by capturing both vocal and facial cues. We hypothesize that explicitly disentangling shared and modality-specific representations within multimodal…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-13 Mohd Mujtaba Akhtar , Girish , Muskaan Singh

Brain imaging analysis is fundamental in neuroscience, providing valuable insights into brain structure and function. Traditional workflows follow a sequential pipeline-brain extraction, registration, segmentation, parcellation, network…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Yao Su , Keqi Han , Mingjie Zeng , Lichao Sun , Liang Zhan , Carl Yang , Lifang He , Xiangnan Kong

Foundation models pre-trained on large-scale natural image datasets offer a powerful paradigm for medical image segmentation. However, effectively transferring their learned representations for precise clinical applications remains a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Haoyue Li , Yifan Gao , Feng Yuan , Xiaosong Wang , Xin Gao

Neuroscience and artificial intelligence represent distinct yet complementary pathways to general intelligence. However, amid the ongoing boom in AI research and applications, the translational synergy between these two fields has grown…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Baiyu Chen , Yujie Wu , Siyuan Xu , Peng Qu , Dehua Wu , Xu Chu , Haodong Bian , Shuo Zhang , Bo Xu , Youhui Zhang , Zhengyu Ma , Guoqi Li

Generative artificial intelligence (AI) is rapidly transforming medical imaging by enabling capabilities such as data synthesis, image enhancement, modality translation, and spatiotemporal modeling. This review presents a comprehensive and…

Image and Video Processing · Electrical Eng. & Systems 2025-08-14 Xuanru Zhou , Cheng Li , Shuqiang Wang , Ye Li , Tao Tan , Hairong Zheng , Shanshan Wang

Non-invasive Brain-Computer Interfaces (BCI) offer a safe and accessible means of connecting the human brain to external devices, with broad applications in home and clinical settings to enhance human capabilities. However, the high noise…

Machine Learning · Computer Science 2025-08-06 Jiamin Wu , Zichen Ren , Junyu Wang , Pengyu Zhu , Yonghao Song , Mianxin Liu , Qihao Zheng , Lei Bai , Wanli Ouyang , Chunfeng Song

Diffusion tensor imaging (DTI) provides crucial insights into the microstructure of the human brain, but it can be time-consuming to acquire compared to more readily available T1-weighted (T1w) magnetic resonance imaging (MRI). To address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shaorong Zhang , Tamoghna Chattopadhyay , Sophia I. Thomopoulos , Jose-Luis Ambite , Paul M. Thompson , Greg Ver Steeg

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

Brain foundation models bring the foundation model paradigm to the field of neuroscience. Like language and image foundation models, they are general-purpose AI systems pretrained on large-scale datasets that adapt readily to downstream…

Computers and Society · Computer Science 2026-02-04 Margot Hanley , Jiunn-Tyng Yeh , Ryan Rodriguez , Jack Pilkington , Nita Farahany

Cytoarchitectonic mapping provides anatomically grounded parcellations of brain structure and forms a foundation for integrative, multi-modal neuroscience analyses. These parcellations are defined based on the shape, density, and spatial…

Image and Video Processing · Electrical Eng. & Systems 2026-01-16 Shiqi Zhang , Fang Xu , Pengcheng Zhou

Foundation models are widely employed in medical image analysis, due to their high adaptability and generalizability for downstream tasks. With the increasing number of foundation models being released, model selection has become an…

Image and Video Processing · Electrical Eng. & Systems 2025-01-27 Fuping Wu , Bartlomiej W. Papiez

Using massive datasets, foundation models are large-scale, pre-trained models that perform a wide range of tasks. These models have shown consistently improved results with the introduction of new methods. It is crucial to analyze how these…

Image and Video Processing · Electrical Eng. & Systems 2025-05-27 Mobina Mansoori , Sajjad Shahabodini , Farnoush Bayatmakou , Jamshid Abouei , Konstantinos N. Plataniotis , Arash Mohammadi

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

Foundation vision encoders such as CLIP and DINOv2, trained on web-scale data, exhibit strong transfer performance across tasks and datasets. However, medical imaging foundation models remain constrained by smaller datasets, limiting our…

Accurate left atrium (LA) segmentation from pre-operative scans is crucial for diagnosing atrial fibrillation, treatment planning, and supporting surgical interventions. While deep learning models are key in medical image segmentation, they…

Image and Video Processing · Electrical Eng. & Systems 2024-11-15 Bipasha Kundu , Bidur Khanal , Richard Simon , Cristian A. Linte

Multimodal medical image fusion plays an instrumental role in several areas of medical image processing, particularly in disease recognition and tumor detection. Traditional fusion methods tend to process each modality independently before…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Lin Liu , Xinxin Fan , Chulong Zhang , Jingjing Dai , Yaoqin Xie , Xiaokun Liang

The emergence of foundation models in neuroimaging is driven by the increasing availability of large-scale and heterogeneous brain imaging datasets. Recent advances in self-supervised learning, particularly reconstruction-based objectives,…

Machine Learning · Computer Science 2025-11-04 Ruthwik Reddy Doodipala , Pankaj Pandey , Carolina Torres Rojas , Manob Jyoti Saikia , Ranganatha Sitaram

Diffeomorphic deformable multi-modal image registration is a challenging task which aims to bring images acquired by different modalities to the same coordinate space and at the same time to preserve the topology and the invertibility of…

Image and Video Processing · Electrical Eng. & Systems 2022-03-16 Vasiliki Sideri-Lampretsa , Georgios Kaissis , Daniel Rueckert

Deep learning-based models in medical imaging often struggle to generalize effectively to new scans due to data heterogeneity arising from differences in hardware, acquisition parameters, population, and artifacts. This limitation presents…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Sebastian Nørgaard Llambias , Mads Nielsen , Mostafa Mehdipour Ghazi
‹ Prev 1 4 5 6 7 8 10 Next ›