English
Related papers

Related papers: MEIcoder: Decoding Visual Stimuli from Neural Acti…

200 papers

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Due to the low signal-to-noise ratio and limited resolution of functional MRI data, and the high complexity of natural images, reconstructing a visual stimulus from human brain fMRI measurements is a challenging task. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zijin Gu , Keith Jamison , Amy Kuceyeski , Mert Sabuncu

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

Neurons and Cognition · Quantitative Biology 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

While computer vision models have made incredible strides in static image recognition, they still do not match human performance in tasks that require the understanding of complex, dynamic motion. This is notably true for real-world…

Neurons and Cognition · Quantitative Biology 2025-04-09 Jacob Yeung , Andrew F. Luo , Gabriel Sarch , Margaret M. Henderson , Deva Ramanan , Michael J. Tarr

Decoding images from brain activity has been a challenge. Owing to the development of deep learning, there are available tools to solve this problem. The decoded image, which aims to map neural spike trains to low-level visual features and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wenyi Li , Shengjie Zheng , Yufan Liao , Rongqi Hong , Weiliang Chen , Chenggnag He , Xiaojian Li

Visual encoding and decoding models act as gateways to understanding the neural mechanisms underlying human visual perception. Typically, visual encoding models that predict brain activity from stimuli and decoding models that reproduce…

Machine Learning · Computer Science 2026-04-14 Weijian Mai , Mu Nan , Yu Zhu , Jiahang Cao , Rui Zhang , Yuqin Dai , Chunfeng Song , Andrew F. Luo , Jiamin Wu

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

Computational Engineering, Finance, and Science · Computer Science 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Primary visual cortex (V1) is the first stage of cortical image processing, and a major effort in systems neuroscience is devoted to understanding how it encodes information about visual stimuli. Within V1, many neurons respond selectively…

Neurons and Cognition · Quantitative Biology 2017-06-21 William F. Kindel , Elijah D. Christensen , Joel Zylberberg

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Enabling effective brain-computer interfaces requires understanding how the human brain encodes stimuli across modalities such as visual, language (or text), etc. Brain encoding aims at constructing fMRI brain activity given a stimulus.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Subba Reddy Oota , Jashn Arora , Vijay Rowtula , Manish Gupta , Raju S. Bapi

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

The ability to perceive and recognize objects is fundamental for the interaction with the external environment. Studies that investigate them and their relationship with brain activity changes have been increasing due to the possible…

Signal Processing · Electrical Eng. & Systems 2020-08-31 Jenifer Kalafatovich , Minji Lee , Seong-Whan Lee

Finding a code to unravel the population of neural responses that leads to a distinct animal behavior has been a long-standing question in the field of neuroscience. With the recent advances in machine learning, it is shown that the…

Neurons and Cognition · Quantitative Biology 2019-11-14 Asim Iqbal , Phil Dong , Christopher M Kim , Heeun Jang

Can artificial intelligence unlock the secrets of the human brain? How do the inner mechanisms of deep learning models relate to our neural circuits? Is it possible to enhance AI by tapping into the power of brain recordings? These…

Neurons and Cognition · Quantitative Biology 2024-12-31 Subba Reddy Oota , Zijiao Chen , Manish Gupta , Raju S. Bapi , Gael Jobard , Frederic Alexandre , Xavier Hinaut

The integration of deep learning and neuroscience has been advancing rapidly, which has led to improvements in the analysis of brain activity and the understanding of deep learning models from a neuroscientific perspective. The…

Neurons and Cognition · Quantitative Biology 2023-06-21 Yu Takagi , Shinji Nishimoto

Reconstructing perceived images from human brain activity monitored by functional magnetic resonance imaging (fMRI) is hard, especially for natural images. Existing methods often result in blurry and unintelligible reconstructions with low…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mali Halac , Murat Isik , Hasan Ayaz , Anup Das