English
Related papers

Related papers: SwiFT: Swin 4D fMRI Transformer

200 papers

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

The human brain is a complex and highly dynamic system, and our current knowledge of its functional mechanism is still very limited. Fortunately, with functional magnetic resonance imaging (fMRI), we can observe blood oxygen level-dependent…

Neurons and Cognition · Quantitative Biology 2024-12-31 Yifei Sun , Mariano Cabezas , Jiah Lee , Chenyu Wang , Wei Zhang , Fernando Calamante , Jinglei Lv

Reconstructing images seen by people from their fMRI brain recordings provides a non-invasive window into the human brain. Despite recent progress enabled by diffusion models, current methods often lack faithfulness to the actual seen…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Roman Beliy , Amit Zalcher , Jonathan Kogman , Navve Wasserman , Michal Irani

To maintain a standard in a medical imaging study, images should have necessary image quality for potential diagnostic use. Although CNN-based approaches are used to assess the image quality, their performance can still be improved in terms…

Image and Video Processing · Electrical Eng. & Systems 2022-08-15 Caner Ozer , Arda Guler , Aysel Turkvatan Cansever , Deniz Alis , Ercan Karaarslan , Ilkay Oksuz

Volumetric reconstruction of fetal brains from multiple stacks of MR slices, acquired in the presence of almost unpredictable and often severe subject motion, is a challenging task that is highly sensitive to the initialization of…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Junshen Xu , Daniel Moyer , P. Ellen Grant , Polina Golland , Juan Eugenio Iglesias , Elfar Adalsteinsson

Transfer learning represents a recent paradigm shift in the way we build artificial intelligence (AI) systems. In contrast to training task-specific models, transfer learning involves pre-training deep learning models on a large corpus of…

Accurate 3D medical image segmentation requires a delicate balance between fine-grained local details and global contextual understanding. While spatial-domain models often struggle with long-range dependencies, existing frequency-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Bo Zhang , Yifan Zhang , Shuo Yan , Yu Bai , Zheng Zhang , Wu Liu , Wendong Wang , Yongdong Zhang

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Recent neuroimaging studies have highlighted the importance of network-centric brain analysis, particularly with functional magnetic resonance imaging. The emergence of Deep Neural Networks has fostered a substantial interest in predicting…

Neurons and Cognition · Quantitative Biology 2023-09-06 Xuan Kan , Antonio Aodong Chen Gu , Hejie Cui , Ying Guo , Carl Yang

Streaming long-video generation faces a central challenge in continuous semantic switching, requiring adaptive memory to preserve coherent visual evolution. Current approaches rely on cache rebuilding at prompt boundaries or fixed memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Shanwen Tan , Hao Li , Jingtao Zhang , Xiaosong Jia , Xue Yang , Shaofeng Zhang , Yanyong Zhang

Generating realistic MRIs to accurately predict future changes in the structure of brain is an invaluable tool for clinicians in assessing clinical outcomes and analysing the disease progression at the patient level. However, current…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Mattia Litrico , Francesco Guarnera , Mario Valerio Giuffrida , Daniele Ravì , Sebastiano Battiato

Functional magnetic resonance imaging (fMRI) is an indispensable tool in modern neuroscience, providing a non-invasive window into whole-brain dynamics at millimeter-scale spatial resolution. However, fMRI is constrained by issues such as…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Yamin Li , Ange Lou , Ziyuan Xu , Shengchao Zhang , Shiyu Wang , Dario J. Englot , Soheil Kolouri , Daniel Moyer , Roza G. Bayrak , Catie Chang

Multi-slice magnetic resonance images of the fetal brain are usually contaminated by severe and arbitrary fetal and maternal motion. Hence, stable and robust motion correction is necessary to reconstruct high-resolution 3D fetal brain…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Wen Shi , Haoan Xu , Cong Sun , Jiwei Sun , Yamin Li , Xinyi Xu , Tianshu Zheng , Yi Zhang , Guangbin Wang , Dan Wu

Surface meshes are a favoured domain for representing structural and functional information on the human cortex, but their complex topology and geometry pose significant challenges for deep learning analysis. While Transformers have…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Daniel Rueckert , Emma C. Robinson

Self-supervised pretrain techniques have been widely used to improve the downstream tasks' performance. However, real-world magnetic resonance (MR) studies usually consist of different sets of contrasts due to different acquisition…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Badhan Kumar Das , Ajay Singh , Gengyan Zhao , Han Liu , Thomas J. Re , Dorin Comaniciu , Eli Gibson , Andreas Maier

Brain network analysis provides an interpretable framework for characterizing brain organization and has been widely used for neurological disorder identification. Recent advances in self-supervised learning have motivated the development…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiaxing Xu , Jingying Ma , Xin Lin , Yuxiao Liu , Kai He , Qika Lin , Yiping Ke , Yang Li , Dinggang Shen , Mengling Feng

Standard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Mehdi Bahri , Eimear O' Sullivan , Shunwang Gong , Feng Liu , Xiaoming Liu , Michael M. Bronstein , Stefanos Zafeiriou

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

Neurons and Cognition · Quantitative Biology 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Zhiwen Fan , Liyan Sun , Xinghao Ding , Yue Huang , Congbo Cai , John Paisley