English
Related papers

Related papers: Scaling Vision Transformers for Functional MRI wit…

200 papers

Magnetic resonance imaging (MRI) relies on radiofrequency (RF) excitation of proton spin. Clinical diagnosis requires a comprehensive collation of biophysical data via multiple MRI contrasts, acquired using a series of RF sequences that…

Medical Physics · Physics 2025-12-24 Dinor Nagar , Moritz Zaiss , Or Perlman

Functional magnetic resonance imaging (fMRI) is a neuroimaging technique that records neural activations in the brain by capturing the blood oxygen level in different regions based on the task performed by a subject. Given fMRI data, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Fillia Makedon , Glenn Wylie

This paper introduces the Neural Transcoding Vision Transformer (\modelname), a generative model designed to estimate high-resolution functional Magnetic Resonance Imaging (fMRI) samples from simultaneous Electroencephalography (EEG) data.…

Image and Video Processing · Electrical Eng. & Systems 2024-09-19 Romeo Lanzino , Federico Fontana , Luigi Cinque , Francesco Scarcello , Atsuto Maki

The rise of large foundation models, trained on extensive datasets, is revolutionizing the field of AI. Models such as SAM, DALL-E2, and GPT-4 showcase their adaptability by extracting intricate patterns and performing effectively across…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Xu Yan , Haiming Zhang , Yingjie Cai , Jingming Guo , Weichao Qiu , Bin Gao , Kaiqiang Zhou , Yue Zhao , Huan Jin , Jiantao Gao , Zhen Li , Lihui Jiang , Wei Zhang , Hongbo Zhang , Dengxin Dai , Bingbing Liu

Advances on signal, image and video generation underly major breakthroughs on generative medical imaging tasks, including Brain Image Synthesis. Still, the extent to which functional Magnetic Ressonance Imaging (fMRI) can be mapped from the…

Machine Learning · Computer Science 2020-09-30 David Calhas , Rui Henriques

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Philipe Dias , Aristeidis Tsaris , Jordan Bowman , Abhishek Potnis , Jacob Arndt , H. Lexie Yang , Dalton Lunga

Foundation models (FMs) are large-scale deep learning models trained on massive datasets, often using self-supervised learning techniques. These models serve as a versatile base for a wide range of downstream tasks, including those in…

Machine Learning · Computer Science 2025-01-17 Wasif Khan , Seowung Leem , Kyle B. See , Joshua K. Wong , Shaoting Zhang , Ruogu Fang

Foundation models pre-trained on large-scale datasets demonstrate strong transfer learning capabilities; however, their adaptation to complex multi-label diagnostic tasks-such as comprehensive head CT finding detection-remains understudied.…

Recent advances in fMRI-based visual decoding have enabled compelling reconstructions of perceived images. However, most approaches rely on subject-specific training, limiting scalability and practical deployment. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Chenqian Le , Yilin Zhao , Nikasadat Emami , Kushagra Yadav , Xujin "Chris" Liu , Xupeng Chen , Yao Wang

In recent years,the application of deep learning in task functional Magnetic Resonance Imaging (tfMRI) decoding has led to significant advancements. However,most studies remain constrained by assumption of temporal stationarity in neural…

Machine Learning · Computer Science 2025-03-05 Yueyang Wu , Sinan Yang , Yanming Wang , Jiajie He , Muhammad Mohsin Pathan , Bensheng Qiu , Xiaoxiao Wang

We present a keypoint-based foundation model for general purpose brain MRI registration, based on the recently-proposed KeyMorph framework. Our model, called BrainMorph, serves as a tool that supports multi-modal, pairwise, and scalable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Alan Q. Wang , Rachit Saluja , Heejong Kim , Xinzi He , Adrian Dalca , Mert R. Sabuncu

Accurate segmentation of organs and lesions in medical images is essential for clinical applications including diagnosis, prognosis, and treatment planning. While Vision Transformers (ViTs) have shown impressive segmentation performance,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Jin Yang , Xiaobing Yu , Peijie Qiu

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mehdi Bahri , Eimear O' Sullivan , Shunwang Gong , Feng Liu , Xiaoming Liu , Michael M. Bronstein , Stefanos Zafeiriou

There has been a growing interest in using deep learning models for processing long surgical videos, in order to automatically detect clinical/operational activities and extract metrics that can enable workflow efficiency tools and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Muhammad Abdullah Jamal , Omid Mohareri

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

In recent years, functional magnetic resonance imaging (fMRI) has been widely utilized to diagnose neurological disease, by exploiting the region of interest (RoI) nodes as well as their connectivities in human brain. However, most of…

Image and Video Processing · Electrical Eng. & Systems 2023-09-18 Xiangzhu Meng , Qiang Liu , Shu Wu , Liang Wang

Many fMRI analyses examine functional connectivity, or statistical dependencies among remote brain regions. Yet popular methods for studying whole-brain functional connectivity often yield results that are difficult to interpret. Factor…

Methodology · Statistics 2024-09-24 Kyle Stanley , Nicole Lazar , Matthew Reimherr

Generative AI has recently propelled the decoding of images from brain activity. How do these approaches scale with the amount and type of neural recordings? Here, we systematically compare image decoding from four types of non-invasive…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Hubert Banville , Yohann Benchetrit , Stéphane d'Ascoli , Jérémy Rapin , Jean-Rémi King

Although transformers have become the neural architectures of choice for natural language processing, they require orders of magnitude more training data, GPU memory, and computations in order to compete with convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Pranav Jeevan , Amit Sethi

Accurate cortical surface reconstruction from magnetic resonance imaging (MRI) data is crucial for reliable neuroanatomical analyses. Current methods have to contend with complex cortical geometries, strict topological requirements, and…

Image and Video Processing · Electrical Eng. & Systems 2025-10-22 Kaveh Moradkhani , R Jarrett Rushmore , Sylvain Bouix