English
Related papers

Related papers: Scaling Vision Transformers for Functional MRI wit…

200 papers

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

Deep learning methods are increasingly being used with neuroimaging data like structural and function magnetic resonance imaging (MRI) to predict the diagnosis of neuropsychiatric and neurological disorders. For psychiatric disorders in…

Neurons and Cognition · Quantitative Biology 2019-07-03 Ahmed El Gazzar , Leonardo Cerliani , Guido van Wingen , Rajat Mani Thomas

Generating whole-brain 4D fMRI sequences conditioned on cognitive tasks remains challenging due to the high-dimensional, heterogeneous BOLD dynamics across subjects/acquisitions and the lack of neuroscience-grounded validation. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jungwoo Seo , David Keetae Park , Shinjae Yoo , Jiook Cha

This paper presents a novel framework for processing volumetric medical information using Visual Transformers (ViTs). First, We extend the state-of-the-art Swin Transformer model to the 3D medical domain. Second, we propose a new approach…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Cristhian Forigua , Maria Escobar , Pablo Arbelaez

In recent years, the rapid development of neuroimaging technology has been providing many powerful tools for cognitive neuroscience research. Among them, the functional magnetic resonance imaging (fMRI), which has high spatial resolution,…

Human-Computer Interaction · Computer Science 2018-08-20 Yang Wang , Dongrui Wu

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

Large efforts are currently under way to systematically map functional connectivity between all pairs of millimeter-scale brain regions using big volumes of neuroimaging data. Functional magnetic resonance imaging (fMRI) can produce these…

Neurons and Cognition · Quantitative Biology 2014-09-24 Enzo Tagliazucchi , Helmut Laufs , Dante R. Chialvo

Accurate classification of brain tumors from magnetic resonance imaging (MRI) plays a critical role in early diagnosis and effective treatment planning. In this study, we propose a deep learning framework based on Vision Transformers (ViT)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Faisal Ahmed

Functional MRI (fMRI) is widely used to examine brain functionality by detecting alteration in oxygenated blood flow that arises with brain activity. In this study, complexity specific image categorization across different visual datasets…

Image and Video Processing · Electrical Eng. & Systems 2023-09-08 Vamshi K. Kancharala , Debanjali Bhattacharya , Neelam Sinha

The study of neurodegenerative diseases relies on the reconstruction and analysis of the brain cortex from magnetic resonance imaging (MRI). Traditional frameworks for this task like FreeSurfer demand lengthy runtimes, while its accelerated…

Image and Video Processing · Electrical Eng. & Systems 2020-10-23 Rodrigo Santa Cruz , Leo Lebrat , Pierrick Bourgeat , Clinton Fookes , Jurgen Fripp , Olivier Salvado

Task functional magnetic resonance imaging (fMRI) is a type of neuroimaging data used to identify areas of the brain that activate during specific tasks or stimuli. These data are conventionally modeled using a massive univariate approach…

Methodology · Statistics 2022-11-04 Daniel A. Spencer , David Bolin , Amanda F. Mejia

The human brain possesses remarkable abilities in visual processing, including image recognition and scene summarization. Efforts have been made to understand the cognitive capacities of the visual brain, but a comprehensive understanding…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Subhrasankar Chatterjee , Debasis Samanta

Latest federated learning (FL) methods started to focus on how to use unlabeled data in clients for training due to users' privacy concerns, high labeling costs, or lack of expertise. However, current Federated…

Machine Learning · Computer Science 2023-03-22 Nan Yang , Xuanyu Chen , Charles Z. Liu , Dong Yuan , Wei Bao , Lizhen Cui

Foundation models, pre-trained on large image datasets and capable of capturing rich feature representations, have recently shown potential for zero-shot image registration. However, their performance has mostly been tested in the context…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Hanxue Gu , Yaqian Chen , Nicholas Konz , Qihang Li , Maciej A. Mazurowski

State-of-the-art results in large language models (LLMs) often rely on scale, which becomes computationally expensive. This has sparked a research agenda to reduce these models' parameter counts and computational costs without significantly…

Computation and Language · Computer Science 2024-11-07 Xiuying Wei , Skander Moalla , Razvan Pascanu , Caglar Gulcehre

Deformable templates, or atlases, are images that represent a prototypical anatomy for a population, and are often enhanced with probabilistic anatomical label maps. They are commonly used in medical image analysis for population studies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Marianne Rakic , Andrew Hoopes , S. Mazdak Abulnaga , Mert R. Sabuncu , John V. Guttag , Adrian V. Dalca

This work explores the effectiveness of masked image modelling for learning representations of retinal OCT images. To this end, we leverage Masked Autoencoders (MAE), a simple and scalable method for self-supervised learning, to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Theodoros Pissas , Pablo Márquez-Neila , Sebastian Wolf , Martin Zinkernagel , Raphael Sznitman

Surface-based cortical analysis is valuable for a variety of neuroimaging tasks, such as spatial normalization, parcellation, and gray matter (GM) thickness estimation. However, most tools for estimating cortical surfaces work exclusively…

Background and objective: Cell-level pathological image analysis requires working with extremely small image patches (40x40 pixels), far below standard ImageNet resolutions. It remains unclear whether modern deep learning architectures and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Hiroki Kagiyama , Toru Nagasaka , Yukari Adachi , Takaaki Tachibana , Ryota Ito , Mitsugu Fujita , Kimihiro Yamashita , Yoshihiro Kakeji

Understanding whether self-supervised learning methods can scale with unlimited data is crucial for training large-scale models. In this work, we conduct an empirical study on the scaling capability of masked image modeling (MIM) methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Cheng-Ze Lu , Xiaojie Jin , Qibin Hou , Jun Hao Liew , Ming-Ming Cheng , Jiashi Feng