English
Related papers

Related papers: Scaling Vision Transformers for Functional MRI wit…

200 papers

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

The rapid growth of medical imaging has fueled the development of Foundation Models (FMs) to reduce the growing, unsustainable workload on radiologists. While recent FMs have shown the power of large-scale pre-training to CT and MRI…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Antoine Saporta , Baptiste Callard , Corentin Dancette , Julien Khlaut , Charles Corbière , Leo Butsanets , Amaury Prat , Pierre Manceron

Missing input sequences are common in medical imaging data, posing a challenge for deep learning models reliant on complete input data. In this work, inspired by MultiMAE [2], we develop a masked autoencoder (MAE) paradigm for multi-modal,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Ayhan Can Erdur , Christian Beischl , Daniel Scholz , Jiazhen Pan , Benedikt Wiestler , Daniel Rueckert , Jan C Peeken

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

A reliable foundation model of functional neuroimages is critical to promote clinical applications where the performance of current AI models is significantly impeded by a limited sample size. To that end, tremendous efforts have been made…

Machine Learning · Computer Science 2025-10-23 Ziquan Wei , Tingting Dan , Guorong Wu

Magnetic Resonance Imaging is a critical imaging modality in clinical diagnosis and research, yet its complexity and heterogeneity hinder scalable, generalizable machine learning. Although foundation models have revolutionized language and…

Despite variations in architecture and pretraining strategies, recent studies indicate that large-scale AI models often converge toward similar internal representations that also align with neural activity. We propose that scale-invariance,…

Neurons and Cognition · Quantitative Biology 2025-06-17 Junjie Yu , Wenxiao Ma , Jianyu Zhang , Haotian Deng , Zihan Deng , Yi Guo , Quanying Liu

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

In neuroimaging analysis, fMRI can well assess the function changes for brain diseases with no obvious structural lesions. To date, most deep-learning-based fMRI studies have employed functional connectivity (FC) as the basic feature for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Wei Dai , Ziyao Zhang , Lixia Tian , Shengyuan Yu , Shuhui Wang , Zhao Dong , Hairong Zheng

Human perception plays a vital role in forming beliefs and understanding reality. A deeper understanding of brain functionality will lead to the development of novel deep neural networks. In this work, we introduce a novel framework named…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xuan-Bac Nguyen , Xin Li , Pawan Sinha , Samee U. Khan , Khoa Luu

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in deep learning and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weiyu Guo , Guoying Sun , JianXiang He , Tong Shao , Shaoguang Wang , Ziyang Chen , Meisheng Hong , Ying Sun , Hui Xiong

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

The Transformer model has been pivotal in advancing fields such as natural language processing, speech recognition, and computer vision. However, a critical limitation of this model is its quadratic computational and memory complexity…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Firas Khader , Omar S. M. El Nahhas , Tianyu Han , Gustav Müller-Franzes , Sven Nebelung , Jakob Nikolas Kather , Daniel Truhn

In recent years, analyzing task-based fMRI (tfMRI) data has become an essential tool for understanding brain function and networks. However, due to the sheer size of tfMRI data, its intrinsic complex structure, and lack of ground truth of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-06 Milad Makkie , Heng Huang , Yu Zhao , Athanasios V. Vasilakos , Tianming Liu

Purpose: To develop a self-supervised scan-specific deep learning framework for reconstructing accelerated multiparametric quantitative MRI (qMRI). Methods: We propose REFINE-MORE (REference-Free Implicit NEural representation with MOdel…

Medical Physics · Physics 2025-08-05 Ruimin Feng , Albert Jang , Xingxin He , Fang Liu

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition that encompasses a wide variety of symptoms and degrees of impairment, which makes the diagnosis and treatment challenging. Functional magnetic resonance imaging (fMRI) has…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yinchi Zhou , Peiyu Duan , Yuexi Du , Nicha C. Dvornek

Population imaging markedly increased the size of functional-imaging datasets, shedding new light on the neural basis of inter-individual differences. Analyzing these large data entails new scalability challenges, computational and…