English
Related papers

Related papers: Scaling Vision Transformers for Functional MRI wit…

200 papers

Reconstructing visual stimuli from human brain activity (e.g., fMRI) bridges neuroscience and computer vision by decoding neural representations. However, existing methods often overlook critical brain structure-function relationships,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Sijin Yu , Zijiao Chen , Wenxuan Wu , Shengxian Chen , Zhongliang Liu , Jingxin Nie , Xiaofen Xing , Xiangmin Xu , Xin Zhang

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Self-supervised fMRI foundation models have shown promising transfer performance, yet most rely on predefined region-level parcellations that discard fine-grained voxel information and introduce atlas-dependent biases. We propose Omni-fMRI,…

Computational Engineering, Finance, and Science · Computer Science 2026-02-02 Mo Wang , Wenhao Ye , Junfeng Xia , Junxiang Zhang , Xuanye Pan , Minghao Xu , Haotian Deng , Hongkai Wen , Quanying Liu

Self-supervised pretraining has transformed computer vision by enabling data-efficient fine-tuning, yet high-resolution training typically requires server-scale infrastructure, limiting in-domain foundation model development for many…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 David Smerkous , Zian Wang , Behzad Najafian

The widespread use of Magnetic Resonance Imaging (MRI) in combination with deep learning shows promise for many high-impact automated diagnostic and prognostic tools. However, training new models requires large amounts of labeled data, a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Haoyu Dong , Yuwen Chen , Hanxue Gu , Nicholas Konz , Yaqian Chen , Qihang Li , Maciej A. Mazurowski

Foundation models are emerging as a powerful paradigm for fMRI analysis, but current approaches face a dual bottleneck of data- and training-efficiency. Atlas-based methods aggregate voxel signals into fixed regions of interest, reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Mo Wang , Junfeng Xia , Wenhao Ye , Enyu Liu , Kaining Peng , Jianfeng Feng , Quanying Liu , Hongkai Wen

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

The human brain is a complex, dynamic network, which is commonly studied using functional magnetic resonance imaging (fMRI) and modeled as network of Regions of interest (ROIs) for understanding various brain functions. Recent studies…

Quantitative Methods · Quantitative Biology 2024-06-26 Yifan Yang , Yutong Mao , Xufu Liu , Xiao Liu

In neuroscience, understanding inter-individual differences has recently emerged as a major challenge, for which functional magnetic resonance imaging (fMRI) has proven invaluable. For this, neuroscientists rely on basic methods such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Akrem Sellami , François-Xavier Dupé , Bastien Cagna , Hachem Kadri , Stéphane Ayache , Thierry Artières , Sylvain Takerkart

Clinical deployment of automated brain MRI analysis faces a fundamental challenge: clinical data is heterogeneous and noisy, and high-quality labels are prohibitively costly to obtain. Self-supervised learning (SSL) can address this by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Asbjørn Munk , Stefano Cerri , Vardan Nersesjan , Christian Hedeager Krag , Jakob Ambsdorf , Pablo Rocamora García , Julia Machnio , Peirong Liu , Suhyun Ahn , Nasrin Akbari , Yasmina Al Khalil , Kimberly Amador , Sina Amirrajab , Tal Arbel , Meritxell Bach Cuadra , Ujjwal Baid , Bhakti Baheti , Jaume Banus , Kamil Barbierik , Christoph Brune , Yansong Bu , Baptiste Callard , Yuhan Chen , Cornelius Crijnen , Corentin Dancette , Peter Drotar , Prasad Dutande , Nils D. Forkert , Saurabh Garg , Jakub Gazda , Matej Gazda , Benoît Gérin , Partha Ghosh , Weikang Gong , Pedro M. Gordaliza , Sam Hashemi , Tobias Heimann , Fucang Jia , Jiexin Jiang , Emily Kaczmarek , Chris Kang , Seung Kwan Kang , Mohammad Khazaei , Julien Khlaut , Petros Koutsouvelis , Jae Sung Lee , Yuchong Li , Mengye Lyu , Mingchen Ma , Anant Madabhushi , Klaus H. Maier-Hein , Pierre Manceron , Andrés Martínez Mora , Moona Mazher , Felix Meister , Nataliia Molchanova , Steven A. Niederer , Leonard Nürnberg , Jinah Park , Abdul Qayyum , Jonas Richiardi , Antoine Saporta , Branislav Setlak , Ning Shen , Justin Szeto , Constantin Ulrich , Puru Vaish , Vibujithan Vigneshwaran , Leroy Volmer , Zihao Wang , Siqi Wei , Anthony Winder , Jelmer M. Wolterink , Maxence Wynen , Chang Yang , Si Young Yie , Mostafa Mehdipour Ghazi , Akshay Pai , Espen Jimenez Solem , Sebastian Nørgaard Llambias , Mikael Boesen , Michael Eriksen Benros , Juan Eugenio Iglesias , Mads Nielsen

We present SAE-BrainMap, a novel framework that directly aligns deep learning visual model representations with voxel-level fMRI responses using sparse autoencoders (SAEs). First, we train layer-wise SAEs on model activations and compute…

Neurons and Cognition · Quantitative Biology 2025-06-16 Ziming Mao , Jia Xu , Zeqi Zheng , Haofang Zheng , Dabing Sheng , Yaochu Jin , Guoyuan Yang

Foundation models (FMs) have shown transformative potential in radiology by performing diverse, complex tasks across imaging modalities. Here, we developed CT-FM, a large-scale 3D image-based pre-trained model designed explicitly for…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Suraj Pai , Ibrahim Hadzic , Dennis Bontempi , Keno Bressem , Benjamin H. Kann , Andriy Fedorov , Raymond H. Mak , Hugo J. W. L. Aerts

Developing Foundation Models for medical image analysis is essential to overcome the unique challenges of radiological tasks. The first challenges of this kind for 3D brain MRI, SSL3D and FOMO25, were held at MICCAI 2025. Our solution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Pedro M. Gordaliza , Jaume Banus , Benoît Gérin , Maxence Wynen , Nataliia Molchanova , Jonas Richiardi , Meritxell Bach Cuadra

The development of robust and generalisable models for encoding the spatio-temporal dynamics of human brain activity is crucial for advancing neuroscientific discoveries. However, significant individual variation in the organisation of the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Yourong Guo , Daniel Rueckert , Emma C. Robinson

In the medical field, landmark detection in MRI plays an important role in reducing medical technician efforts in tasks like scan planning, image registration, etc. First, 88 landmarks spread across the brain anatomy in the three respective…

Image and Video Processing · Electrical Eng. & Systems 2021-11-02 Muhammad Ilyas Patel , Shrey Singla , Razeem Ahmad Ali Mattathodi , Sumit Sharma , Deepam Gautam , Srinivasa Rao Kundeti

The advent of foundation models, particularly Vision-Language Models (VLMs) and Multi-modal Large Language Models (MLLMs), has redefined the frontiers of artificial intelligence, enabling remarkable generalization across diverse tasks with…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Redwan Sony , Parisa Farmanifard , Hamzeh Alzwairy , Nitish Shukla , Arun Ross

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

The feature maps of vision encoders are fundamental to myriad modern AI tasks, ranging from core perception algorithms (e.g. semantic segmentation, object detection, depth perception, etc.) to modern multimodal understanding in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Mike Ranzinger , Greg Heinrich , Pavlo Molchanov , Jan Kautz , Bryan Catanzaro , Andrew Tao

Cardiac magnetic resonance imaging (CMR), considered the gold standard for noninvasive cardiac assessment, is a diverse and complex modality requiring a wide variety of image processing tasks for comprehensive assessment of cardiac…

Image and Video Processing · Electrical Eng. & Systems 2025-12-03 Athira J Jacob , Indraneel Borgohain , Teodora Chitiboi , Puneet Sharma , Dorin Comaniciu , Daniel Rueckert

The advent of foundation models has heralded a new era in medical artificial intelligence (AI), enabling the extraction of generalizable representations from large-scale unlabeled datasets. However, current ophthalmic AI paradigms are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Tienyu Chang , Zhen Chen , Renjie Liang , Jinyu Ding , Jie Xu , Sunu Mathew , Amir Reza Hajrasouliha , Andrew J. Saykin , Ruogu Fang , Yu Huang , Jiang Bian , Qingyu Chen
‹ Prev 1 2 3 10 Next ›