English
Related papers

Related papers: Deep Cross-Subject Mapping of Neural Activity

200 papers

Recent research in neural machine translation has largely focused on two aspects; neural network architectures and end-to-end learning algorithms. The problem of decoding, however, has received relatively little attention from the research…

Computation and Language · Computer Science 2017-02-09 Jiatao Gu , Kyunghyun Cho , Victor O. K. Li

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language models (cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mitja Nikolaus , Milad Mozafari , Nicholas Asher , Leila Reddy , Rufin VanRullen

We investigate the integration of a planning mechanism into an encoder-decoder architecture with an explicit alignment for character-level machine translation. We develop a model that plans ahead when it computes alignments between the…

Computation and Language · Computer Science 2017-06-26 Caglar Gulcehre , Francis Dutil , Adam Trischler , Yoshua Bengio

Understanding how neural activity gives rise to perception is a central challenge in neuroscience. We address the problem of decoding visual information from high-density intracortical recordings in primates, using the THINGS Ventral Stream…

Neurons and Cognition · Quantitative Biology 2026-01-19 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

Computational Engineering, Finance, and Science · Computer Science 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Decoding images from brain activity has been a challenge. Owing to the development of deep learning, there are available tools to solve this problem. The decoded image, which aims to map neural spike trains to low-level visual features and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Wenyi Li , Shengjie Zheng , Yufan Liao , Rongqi Hong , Weiliang Chen , Chenggnag He , Xiaojian Li

Neuroimaging techniques have shown to be useful when studying the brain's activity. This paper uses Magnetoencephalography (MEG) data, provided by the Human Connectome Project (HCP), in combination with various deep artificial neural…

Machine Learning · Computer Science 2020-07-07 Ismail Alaoui Abdellaoui , Jesus Garcia Fernandez , Caner Sahinli , Siamak Mehrkanoon

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…

Decoding stimuli or behaviour from recorded neural activity is a common approach to interrogate brain function in research, and an essential part of brain-computer and brain-machine interfaces. Reliable decoding even from small neural…

Neurons and Cognition · Quantitative Biology 2023-01-06 Justin Jude , Matthew G. Perich , Lee E. Miller , Matthias H. Hennig

Visual brain decoding aims to decode visual information from human brain activities. Despite the great progress, one critical limitation of current brain decoding research lies in the lack of generalization capability to unseen subjects.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xiangtao Kong , Kexin Huang , Ping Li , Lei Zhang

Inter-individual variability in fine-grained functional brain organization poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but typically require paired…

Neurons and Cognition · Quantitative Biology 2024-08-02 Haibao Wang , Jun Kai Ho , Fan L. Cheng , Shuntaro C. Aoki , Yusuke Muraki , Misato Tanaka , Yukiyasu Kamitani

Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models…

Computational Engineering, Finance, and Science · Computer Science 2025-12-01 Xing Gao , Dazhong Rong , Qinming He

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Reconstructing video from brain signals is an important brain decoding task. Existing brain decoding frameworks are primarily built on a subject-dependent paradigm, which requires large amounts of brain data for each subject. However, the…

Multimedia · Computer Science 2025-11-19 Xuan-Hao Liu , Yan-Kai Liu , Tianyi Zhou , Bao-Liang Lu , Wei-Long Zheng

Current brain-computer interfaces primarily decode single motor variables, limiting their ability to support natural, high-bandwidth neural control that requires simultaneous extraction of multiple correlated motor dimensions. We introduce…

Neurons and Cognition · Quantitative Biology 2025-08-13 Kaixi Tian , Shengjia Zhao , Yuhan Zhang , Shan Yu

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney