English
Related papers

Related papers: Teaching CORnet Human fMRI Representations for Enh…

200 papers

Human visual object recognition is typically rapid and seemingly effortless, as well as largely independent of viewpoint and object orientation. Until very recently, animate visual systems were the only ones capable of this remarkable…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Robert Geirhos , David H. J. Janssen , Heiko H. Schütt , Jonas Rauber , Matthias Bethge , Felix A. Wichmann

Understanding the hidden mechanisms behind human's visual perception is a fundamental question in neuroscience. To that end, investigating into the neural responses of human mind activities, such as functional Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuankun Yang , Li Zhang , Ziyang Xie , Zhiyuan Yuan , Jianfeng Feng , Xiatian Zhu , Yu-Gang Jiang

Although developed functional magnetic resonance imaging (fMRI) registration algorithms based on deep learning have achieved a certain degree of alignment of functional area, they underutilized fine structural information. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Baolong Li , Yuhu Shi , Lei Wang , Weiming Zeng , Changming Zhu

The widespread use of deep neural networks has achieved substantial success in many tasks. However, there still exists a huge gap between the operating mechanism of deep learning models and human-understandable decision making, so that…

Artificial Intelligence · Computer Science 2021-03-08 Xiaowei Zhou , Jie Yin , Ivor Tsang , Chen Wang

We present several deep learning models for assessing the morphometric fidelity of deep grey matter region models extracted from brain MRI. We test three different convolutional neural net architectures (VGGNet, ResNet and Inception) over…

Backpropagation is the core learning mechanism underlying deep learning. However, whether and how this algorithm is implemented in the brain remains highly debated. In particular, while forward activations of pretrained models reliably map…

Deep neural networks (DNNs) trained on visual tasks develop feature representations that resemble those in the human visual system. Although DNN-based encoding models can accurately predict brain responses to visual stimuli, they offer…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Matthew W. Shinkle , Mark D. Lescroart

Can we ask computers to recognize what we see from brain signals alone? Our paper seeks to utilize the knowledge learnt in the visual domain by popular pre-trained vision models and use it to teach a recurrent model being trained on brain…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Pranay Mukherjee , Abhirup Das , Ayan Kumar Bhunia , Partha Pratim Roy

The human visual system uses two parallel pathways for spatial processing and object recognition. In contrast, computer vision systems tend to use a single feedforward pathway, rendering them less robust, adaptive, or efficient than human…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Minkyu Choi , Kuan Han , Xiaokai Wang , Yizhen Zhang , Zhongming Liu

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

Artificial neural networks trained on visual tasks develop internal representations resembling those of the primate visual system, a discovery that has guided a decade of computational neuroscience. Research on building brain-aligned models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yash Mehta , Michael F. Bonner

Image processing concepts can visualize the different anatomy structure of the human body. Recent advancements in the field of deep learning have made it possible to detect the growth of cancerous tissue just by a patient's brain Magnetic…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Priyansh Saxena , Akshat Maheshwari , Saumil Maheshwari

Advances in optical and electrophysiological recording technologies have made it possible to record the dynamics of thousands of neurons, opening up new possibilities for interpreting and controlling large neural populations in behaving…

Neurons and Cognition · Quantitative Biology 2023-11-20 Fatih Dinc , Adam Shai , Mark Schnitzer , Hidenori Tanaka

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

In recent years, Deep Learning has been successfully applied to multimodal learning problems, with the aim of learning useful joint representations in data fusion applications. When the available modalities consist of time series data such…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Xitong Yang , Palghat Ramesh , Radha Chitta , Sriganesh Madhvanath , Edgar A. Bernal , Jiebo Luo

Deep neural network representations align well with brain activity in the ventral visual stream. However, the primate visual system has a distinct dorsal processing stream with different functional properties. To test if a model trained to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Gabriel Sarch , Hsiao-Yu Fish Tung , Aria Wang , Jacob Prince , Michael Tarr

Deep learning is leading to major advances in the realm of brain decoding from functional Magnetic Resonance Imaging (fMRI). However, the large inter-subject variability in brain characteristics has limited most studies to train models on…

Machine Learning · Computer Science 2023-12-12 Alexis Thual , Yohann Benchetrit , Felix Geilert , Jérémy Rapin , Iurii Makarov , Hubert Banville , Jean-Rémi King

Despite the remarkable similarities between convolutional neural networks (CNN) and the human brain, CNNs still fall behind humans in many visual tasks, indicating that there still exist considerable differences between the two systems.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Chi Zhang , Xiaohan Duan , Linyuan Wang , Yongli Li , Bin Yan , Guoen Hu , Ruyuan Zhang , Li Tong

While brain-inspired artificial intelligence(AI) has demonstrated promising results, current understanding of the parallels between artificial neural networks (ANNs) and human brain processing remains limited: (1) unimodal ANN studies fail…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Yudan Ren , Xinlong Wang , Kexin Wang , Tian Xia , Zihan Ma , Zhaowei Li , Xiangrong Bi , Xiao Li , Xiaowei He