English
Related papers

Related papers: Towards Generalisable Foundation Models for Brain …

200 papers

2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yik San Cheng , Runkai Zhao , Weidong Cai

Recent advances in MRI have led to the creation of large datasets. With the increase in data volume, it has become difficult to locate previous scans of the same patient within these datasets (a process known as re-identification). To…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Lemuel Puglisi , Frederik Barkhof , Daniel C. Alexander , Geoffrey JM Parker , Arman Eshaghi , Daniele Ravì

Medical image challenges have played a transformative role in advancing the field, catalyzing innovation and establishing new performance benchmarks. Image registration, a foundational task in neuroimaging, has similarly advanced through…

Head computed tomography (CT) imaging is a widely-used imaging modality with multitudes of medical indications, particularly in assessing pathology of the brain, skull, and cerebrovascular system. It is commonly the first-line imaging in…

Brain foundation models have achieved remarkable advances across a wide range of neuroscience tasks. However, most existing models are limited to a single functional modality, restricting their ability to exploit complementary…

Machine Learning · Computer Science 2026-05-18 Hanning Guo , Hanwen Bi , Farah Abdellatif , Andrei Galbenus , Jon. N. Shah , Abigail Morrison , Jürgen Dammers

Accurate compensation of brain deformation is a critical challenge for reliable image-guided neurosurgery, as surgical manipulation and tumor resection induce tissue motion that misaligns preoperative planning images with intraoperative…

The advent of large-scale vision foundation models, pre-trained on diverse natural images, has marked a paradigm shift in computer vision. However, how the frontier vision foundation models' efficacies transfer to specialised domains such…

The deep learning field is converging towards the use of general foundation models that can be easily adapted for diverse tasks. While this paradigm shift has become common practice within the field of natural language processing, progress…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Joana Palés Huix , Adithya Raju Ganeshan , Johan Fredin Haslum , Magnus Söderberg , Christos Matsoukas , Kevin Smith

Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural imaging (e.g., MRI), selectively add sequences such as FLAIR or T2 to refine the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Guangqian Yang , Tong Ding , Wenlong Hou , Yue Xun , Ye Du , Qian Niu , Shujun Wang

Multimodal learning, especially large-scale multimodal pre-training, has developed rapidly over the past few years and led to the greatest advances in artificial intelligence (AI). Despite its effectiveness, understanding the underlying…

Neural and Evolutionary Computing · Computer Science 2022-08-18 Haoyu Lu , Qiongyi Zhou , Nanyi Fei , Zhiwu Lu , Mingyu Ding , Jingyuan Wen , Changde Du , Xin Zhao , Hao Sun , Huiguang He , Ji-Rong Wen

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Peirong Liu , Oula Puonti , Xiaoling Hu , Daniel C. Alexander , Juan E. Iglesias

Foundation vision models are increasingly adopted in medical image analysis. Due to domain shift, these pretrained models misalign with medical image segmentation needs without being fully fine-tuned or lightly adapted. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuonan Liang , Wei Guo , Jie Gan , Yaxuan Song , Runnan Chen , Hang Chang , Weidong Cai

Brain diseases, such as Alzheimer's disease and brain tumors, present profound challenges due to their complexity and societal impact. Recent advancements in brain foundation models have shown significant promise in addressing a range of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Zhongying Deng , Haoyu Wang , Ziyan Huang , Lipei Zhang , Angelica I. Aviles-Rivero , Chaoyu Liu , Junjun He , Zoe Kourtzi , Carola-Bibiane Schönlieb

Integrating deep learning into medical imaging is poised to greatly advance diagnostic methods but it faces challenges with generalizability. Foundation models, based on self-supervised learning, address these issues and improve data…

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

Functional brain network analysis has become an indispensable tool for brain disease analysis. It is profoundly impacted by deep learning methods, which can characterize complex connections between ROIs. However, the research on foundation…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Yifei Tang , Hongjie Jiang , Changhong Jing , Hieu Pham , Shuqiang Wang

Self-supervised learning (SSL) leverages vast unannotated medical datasets, yet steep technical barriers limit adoption by clinical researchers. We introduce Vision Foundry, a code-free, HIPAA-compliant platform that democratizes…

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Peirong Liu , Oula Puonti , Xiaoling Hu , Karthik Gopinath , Annabel Sorby-Adams , Daniel C. Alexander , W. Taylor Kimberly , Juan E. Iglesias