English
Related papers

Related papers: Whole-brain Transferable Representations from Larg…

200 papers

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Understanding how humans process visual information is one of the crucial steps for unraveling the underlying mechanism of brain activity. Recently, this curiosity has motivated the fMRI-to-image reconstruction task; given the fMRI data…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Jaehoon Joo , Taejin Jeong , Seongjae Hwang

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

A reliable foundation model of functional neuroimages is critical to promote clinical applications where the performance of current AI models is significantly impeded by a limited sample size. To that end, tremendous efforts have been made…

Machine Learning · Computer Science 2025-10-23 Ziquan Wei , Tingting Dan , Guorong Wu

Multimodal brain decoding aims to reconstruct semantic information that is consistent with visual stimuli from brain activity signals such as fMRI, and then generate readable natural language descriptions. However, multimodal brain decoding…

Machine Learning · Computer Science 2026-04-21 Xuanyu Hu

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Magnetic resonance imaging (MRI) is critically important for brain mapping in both scientific research and clinical studies. Precise segmentation of brain tumors facilitates clinical diagnosis, evaluations, and surgical planning. Deep…

Image and Video Processing · Electrical Eng. & Systems 2023-05-01 Rui Nian , Guoyao Zhang , Yao Sui , Yuqi Qian , Qiuying Li , Mingzhang Zhao , Jianhui Li , Ali Gholipour , Simon K. Warfield

The past few years have seen remarkable progress in the decoding of speech from brain activity, primarily driven by large single-subject datasets. However, due to individual variation, such as anatomy, and differences in task design and…

Machine Learning · Computer Science 2025-06-03 Dulhan Jayalath , Gilad Landau , Brendan Shillingford , Mark Woolrich , Oiwi Parker Jones

Multi-voxel pattern analysis (MVPA) learns predictive models from task-based functional magnetic resonance imaging (fMRI) data, for distinguishing when subjects are performing different cognitive tasks -- e.g., watching movies or making…

Machine Learning · Computer Science 2020-10-30 Muhammad Yousefnezhad , Alessandro Selvitella , Daoqiang Zhang , Andrew J. Greenshaw , Russell Greiner

Resting-state functional MRI (rs-fMRI) is increasingly employed in multi-site research to aid neurological disorder analysis. Existing studies usually suffer from significant cross-site/domain data heterogeneity caused by site effects such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Yuqi Fang , Jinjian Wu , Qianqian Wang , Shijun Qiu , Andrea Bozoki , Huaicheng Yan , Mingxia Liu

In neuroscience, understanding inter-individual differences has recently emerged as a major challenge, for which functional magnetic resonance imaging (fMRI) has proven invaluable. For this, neuroscientists rely on basic methods such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Akrem Sellami , François-Xavier Dupé , Bastien Cagna , Hachem Kadri , Stéphane Ayache , Thierry Artières , Sylvain Takerkart

Dynamic functional connectivity analysis provides valuable information for understanding brain functional activity underlying different cognitive processes. Besides sliding window based approaches, a variety of methods have been developed…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

High-resolution slice-to-volume reconstruction (SVR) from multiple motion-corrupted low-resolution 2D slices constitutes a critical step in image-based diagnostics of moving subjects, such as fetal brain Magnetic Resonance Imaging (MRI).…

Functional magnetic resonance imaging (fMRI) is an indispensable tool in modern neuroscience, providing a non-invasive window into whole-brain dynamics at millimeter-scale spatial resolution. However, fMRI is constrained by issues such as…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Yamin Li , Ange Lou , Ziyuan Xu , Shengchao Zhang , Shiyu Wang , Dario J. Englot , Soheil Kolouri , Daniel Moyer , Roza G. Bayrak , Catie Chang

Reconstructing human dynamic vision from brain activity is a challenging task with great scientific significance. Although prior video reconstruction methods have made substantial progress, they still suffer from several limitations,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yizhuo Lu , Changde Du , Chong Wang , Xuanliu Zhu , Liuyun Jiang , Xujin Li , Huiguang He

Existing cross-subject fMRI decoding methods typically train a model on multiple scanned subjects and then adapt it to a new subject using substantial paired fMRI-image data. However, in realistic scenarios, new-subject fMRI data are often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Jintao Guo , Lin Wang , Shumeng Li , Jian Zhang , Yulin Zhou , Luyang Cao , Hairong Zheng , Yinghuan Shi

Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal brain representations, neglecting the brain's inherently multimodal processing. Inspired by…

Computation and Language · Computer Science 2025-08-12 Chunyu Ye , Yunhao Zhang , Jingyuan Sun , Chong Li , Chengqing Zong , Shaonan Wang

Objective skill assessment in high-stakes procedural environments requires models that not only decode underlying cognitive and motor processes but also generalize across tasks, individuals, and experimental contexts. While prior work has…

Signal Processing · Electrical Eng. & Systems 2025-07-01 A. Subedi , S. De , L. Cavuoto , S. Schwaitzberg , M. Hackett , J. Norfleet

Image-to-fMRI encoding is important for both neuroscience research and practical applications. However, such "Brain-Encoders" have been typically trained per-subject and per fMRI-dataset, thus restricted to very limited training data. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Roman Beliy , Navve Wasserman , Amit Zalcher , Michal Irani