English
Related papers

Related papers: NeuroFlow: Toward Unified Visual Encoding and Deco…

200 papers

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

Extensive literature has drawn comparisons between recordings of biological neurons in the brain and deep neural networks. This comparative analysis aims to advance and interpret deep neural networks and enhance our understanding of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Mai Gamal , Mohamed Rashad , Eman Ehab , Seif Eldawlatly , Mennatullah Siam

Computer graphics seeks to deliver compelling images, generated within a computing budget, targeted at a specific display device, and ultimately viewed by an individual user. The foveated nature of human vision offers an opportunity to…

Graphics · Computer Science 2021-07-27 Rachel Brown , Vasha DuTell , Bruce Walter , Ruth Rosenholtz , Peter Shirley , Morgan McGuire , David Luebke

This work presents DCFlow, a novel unsupervised cross-modal flow estimation framework that integrates a decoupled optimization strategy and a cross-modal consistency constraint. Unlike previous approaches that implicitly learn flow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Runmin Zhang , Jialiang Wang , Si-Yuan Cao , Zhu Yu , Junchen Yu , Guangyi Zhang , Hui-Liang Shen

Visual neural decoding seeks to reconstruct or infer perceived visual stimuli from brain activity patterns, providing critical insights into human cognition and enabling transformative applications in brain-computer interfaces and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Wenjiang Zhang , Sifeng Wang , Yuwei Su , Xinyu Li , Chen Zhang , Suyu Zhong

Visual brain decoding aims to decode visual information from human brain activities. Despite the great progress, one critical limitation of current brain decoding research lies in the lack of generalization capability to unseen subjects.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xiangtao Kong , Kexin Huang , Ping Li , Lei Zhang

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

An electroencephalogram is an effective approach that provides a bidirectional pathway between user and computer in a non-invasive way. In this study, we adopted the visual perception data for training the visual imagery decoding network.…

Human-Computer Interaction · Computer Science 2021-12-14 Byoung-Hee Kwon , Jeong-Hyun Cho , Byeong-Hoo Lee

Real-time decoding of target variables from multiple simultaneously recorded neural time-series modalities, such as discrete spiking activity and continuous field potentials, is important across various neuroscience applications. However, a…

Machine Learning · Computer Science 2025-12-16 Eray Erturk , Maryam M. Shanechi

The success of a specific neural network architecture is closely tied to the dataset and task it tackles; there is no one-size-fits-all solution. Thus, considerable efforts have been made to quickly and accurately estimate the performances…

Machine Learning · Computer Science 2024-03-22 Dongyeong Hwang , Hyunju Kim , Sunwoo Kim , Kijung Shin

Understanding and decoding brain activity into visual representations is a fundamental challenge at the intersection of neuroscience and artificial intelligence. While EEG visual decoding has shown promise due to its non-invasive, and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Minxu Liu , Donghai Guan , Chuhang Zheng , Chunwei Tian , Jie Wen , Qi Zhu

Brain decoding aims to reconstruct original stimuli from fMRI signals, providing insights into interpreting mental content. Current approaches rely heavily on subject-specific models due to the complex brain processing mechanisms and the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zicheng Wang , Zhen Zhao , Luping Zhou , Parashkev Nachev

Decoding approaches are widely used in neuroscience and machine learning to compare stimulus representations across neural systems, such as different brain regions, organisms, and deep learning models. Popular methods include decoding…

Neurons and Cognition · Quantitative Biology 2026-05-08 Johannes Bertram , Luciano Dyballa , T. Anderson Keller , Savik Kinger , Steven W. Zucker

In the pursuit to understand the intricacies of human brain's visual processing, reconstructing dynamic visual experiences from brain activities emerges as a challenging yet fascinating endeavor. While recent advancements have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Marie-Francine Moens

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

Computational Engineering, Finance, and Science · Computer Science 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi