English
Related papers

Related papers: Brain-optimized inference improves reconstructions…

200 papers

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of language stimuli, recent studies have shown that it is possible to…

Computation and Language · Computer Science 2020-11-12 Nicolas Affolter , Beni Egressy , Damian Pascual , Roger Wattenhofer

Despite significant strides in visual quality assessment, the neural mechanisms underlying visual quality perception remain insufficiently explored. This study employed fMRI to examine brain activity during image quality assessment and…

Multimedia · Computer Science 2024-04-30 Yiming Zhang , Ying Hu , Xiongkuo Min , Yan Zhou , Guangtao Zhai

Recent advances in fMRI-based image reconstruction have achieved remarkable photo-realistic fidelity. Yet, a persistent limitation remains: while reconstructed images often appear naturalistic and holistically similar to the target stimuli,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Lan Yang , Minghan Yang , Ke Li , Honggang Zhang , Kaiyue Pang , Yi-Zhe Song

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Non-invasive methods to measure brain activity are important to understand cognitive processes in the human brain. A prominent example is functional magnetic resonance imaging (fMRI), which is a noisy measurement of a delayed signal that…

Neurons and Cognition · Quantitative Biology 2020-08-17 Hans-Christian Ruiz-Euler , Jose R. Ferreira Marques , Hilbert J. Kappen

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

We present a method to segment MRI scans of the human brain into ischemic stroke lesion and normal tissues. We propose a neural network architecture in the form of a standard encoder-decoder where predictions are guided by a spatial…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Alex Wong , Allison Chen , Yangchao Wu , Safa Cicek , Alexandre Tiard , Byung-Woo Hong , Stefano Soatto

Inferring the functional specificity of brain regions from functional Magnetic Resonance Images (fMRI) data is a challenging statistical problem. While the General Linear Model (GLM) remains the standard approach for brain mapping,…

Machine Learning · Computer Science 2012-07-17 Fabian Pedregosa , Alexandre Gramfort , Gaël Varoquaux , Bertrand Thirion , Christophe Pallier , Elodie Cauvet

Medical imaging systems are commonly assessed and optimized by the use of objective measures of image quality (IQ). The performance of the ideal observer (IO) acting on imaging measurements has long been advocated as a figure-of-merit to…

Medical Physics · Physics 2025-01-17 Kaiyan Li , Prabhat Kc , Hua Li , Kyle J. Myers , Mark A. Anastasio , Rongping Zeng

Reconstructing perceived images from human brain activity forms a crucial link between human and machine learning through Brain-Computer Interfaces. Early methods primarily focused on training separate models for each individual to account…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhibo Tian , Ruijie Quan , Fan Ma , Kun Zhan , Yi Yang

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…

We present MindEye, a novel fMRI-to-image approach to retrieve and reconstruct viewed images from brain activity. Our model comprises two parallel submodules that are specialized for retrieval (using contrastive learning) and reconstruction…

Inverse inference, or "brain reading", is a recent paradigm for analyzing functional magnetic resonance imaging (fMRI) data, based on pattern recognition and statistical learning. By predicting some cognitive variables related to brain…

Functional MRI (fMRI) has become the most common method for investigating the human brain. However, fMRI data present some complications for statistical analysis and modeling. One recently developed approach to these data focuses on…

Applications · Statistics 2015-03-19 Vincent Q. Vu , Pradeep Ravikumar , Thomas Naselaris , Kendrick N. Kay , Jack L. Gallant , Bin Yu

Brain network analysis has emerged as pivotal method for gaining a deeper understanding of brain functions and disease mechanisms. Despite the existence of various network construction approaches, shortcomings persist in the learning of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Yongcheng Zong , Shuqiang Wang

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

Mapping human brain activity to natural images offers a new window into vision and cognition, yet current diffusion-based decoders face a core difficulty: most condition directly on fMRI features without analyzing how visual information is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Guowei Zhang , Yun Zhao , Moein Khajehnejad , Adeel Razi , Levin Kuhlmann

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

Neural encoding and decoding, which aim to characterize the relationship between stimuli and brain activities, have emerged as an important area in cognitive neuroscience. Traditional encoding models, which focus on feature extraction and…

Neurons and Cognition · Quantitative Biology 2019-08-26 Hao Wu , Ziyu Zhu , Jiayi Wang , Nanning Zheng , Badong Chen