English
Related papers

Related papers: Monkey Perceptogram: Reconstructing Visual Represe…

200 papers

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Experiments that study neural encoding of stimuli at the level of individual neurons typically choose a small set of features present in the world --- contrast and luminance for vision, pitch and intensity for sound --- and assemble a…

Machine Learning · Statistics 2016-11-22 Xin , Chen , Jeffrey M Beck , John M Pearson

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Precise control of neural activity -- modulating target neurons deep in the brain while leaving nearby neurons unaffected -- is an outstanding challenge in neuroscience, generally approached using invasive techniques. This study…

Neurons and Cognition · Quantitative Biology 2025-06-17 Guy Gaziv , Sarah Goulding , Ani Ayvazian-Hancock , Yoon Bai , James J. DiCarlo

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

Seeing is believing, however, the underlying mechanism of how human visual perceptions are intertwined with our cognitions is still a mystery. Thanks to the recent advances in both neuroscience and artificial intelligence, we have been able…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Yu-Ting Lan , Kan Ren , Yansen Wang , Wei-Long Zheng , Dongsheng Li , Bao-Liang Lu , Lili Qiu

Visual reconstruction algorithms are an interpretive tool that map brain activity to pixels. Past reconstruction algorithms employed brute-force search through a massive library to select candidate images that, when passed through an…

Neurons and Cognition · Quantitative Biology 2023-05-03 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney

Extensive literature has drawn comparisons between recordings of biological neurons in the brain and deep neural networks. This comparative analysis aims to advance and interpret deep neural networks and enhance our understanding of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Mai Gamal , Mohamed Rashad , Eman Ehab , Seif Eldawlatly , Mennatullah Siam

Decoding images from brain activity has been a challenge. Owing to the development of deep learning, there are available tools to solve this problem. The decoded image, which aims to map neural spike trains to low-level visual features and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wenyi Li , Shengjie Zheng , Yufan Liao , Rongqi Hong , Weiliang Chen , Chenggnag He , Xiaojian Li

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Computational modeling is becoming a widely used methodology in modern neuroscience. However, as the complexity of the phenomena under study increases, the analysis of the results emerging from the simulations concomitantly becomes more…

Neurons and Cognition · Quantitative Biology 2020-03-16 Sergio E. Galindo , Pablo Toharia , Oscar D. Robles , Eduardo Ros , Luis Pastor , Jesús A. Garrido

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

On basis of functional magnetic resonance imaging (fMRI), researchers are devoted to designing visual encoding models to predict the neuron activity of human in response to presented image stimuli and analyze inner mechanism of human visual…

Computer Vision and Pattern Recognition · Computer Science 2020-03-27 Kai Qiao , Chi Zhang , Jian Chen , Linyuan Wang , Li Tong , Bin Yan

Predicting brain activity in response to naturalistic, multimodal stimuli is a key challenge in computational neuroscience. While encoding models are becoming more powerful, their ability to generalize to truly novel contexts remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Hamid Abdollahi , Amir Hossein Mansouri Majoumerd , Amir Hossein Bagheri Baboukani , Amir Abolfazl Suratgar , Mohammad Bagher Menhaj

Converging evidence suggests that the mammalian ventral visual pathway encodes increasingly complex stimulus features in downstream areas. Using deep convolutional neural networks, we can now quantitatively demonstrate that there is indeed…

Neurons and Cognition · Quantitative Biology 2017-03-13 Umut Güçlü , Marcel A. J. van Gerven

The thesis explores the role machine learning methods play in creating intuitive computational models of neural processing. Combined with interpretability techniques, machine learning could replace human modeler and shift the focus of human…

Neurons and Cognition · Quantitative Biology 2020-10-20 Ilya Kuzovkin

Neurons can code for multiple variables simultaneously and neuroscientists are often interested in classifying neurons based on their receptive field properties. Statistical models provide powerful tools for determining the factors…

Neurons and Cognition · Quantitative Biology 2022-10-28 Mehrad Sarmashghi , Shantanu P. Jadhav , Uri T. Eden

Ample evidence suggests that face processing in human and non-human primates is performed differently compared with other objects. Converging reports, both physiologically and psychophysically, indicate that faces are processed in…

Neurons and Cognition · Quantitative Biology 2016-11-01 Amirhossein Farzmahdi , Karim Rajaei , Masoud Ghodrati , Reza Ebrahimpour , Seyed-Mahdi Khaligh-Razavi