English
Related papers

Related papers: Brain decoding: toward real-time reconstruction of…

200 papers

Analyzing and predicting brain aging is essential for early prognosis and accurate diagnosis of cognitive diseases. The technique of neuroimaging, such as Magnetic Resonance Imaging (MRI), provides a noninvasive means of observing the aging…

Image and Video Processing · Electrical Eng. & Systems 2022-12-06 Jingru Fu , Antonios Tzortzakakis , José Barroso , Eric Westman , Daniel Ferreira , Rodrigo Moreno

Previous brain decoding research primarily involves single-subject studies, reconstructing stimuli via fMRI activity from the same subject. Our study aims to introduce a generalization technique for cross-subject brain decoding, facilitated…

Neurons and Cognition · Quantitative Biology 2023-09-06 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Current expressive avatar systems rely heavily on visual cues, failing when faces are occluded or when emotions remain internal. We present Mind-to-Face, the first framework that decodes non-invasive electroencephalogram (EEG) signals…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Haolin Xiong , Tianwen Fu , Pratusha Bhuvana Prasad , Yunxuan Cai , Haiwei Chen , Wenbin Teng , Hanyuan Xiao , Yajie Zhao

A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmental features…

Neurons and Cognition · Quantitative Biology 2021-06-14 Pedro F. da Costa , Rianne Haartsen , Elena Throm , Luke Mason , Anna Gui , Robert Leech , Emily J. H. Jones

While capable of segregating visual data, humans take time to examine a single piece, let alone thousands or millions of samples. The deep learning models efficiently process sizeable information with the help of modern-day computing.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Alankrit Mishra , Nikhil Raj , Garima Bajwa

Deep learning is leading to major advances in the realm of brain decoding from functional Magnetic Resonance Imaging (fMRI). However, the large inter-subject variability in brain characteristics has limited most studies to train models on…

Machine Learning · Computer Science 2023-12-12 Alexis Thual , Yohann Benchetrit , Felix Geilert , Jérémy Rapin , Iurii Makarov , Hubert Banville , Jean-Rémi King

Magnetoencephalography (MEG) provides dynamic spatial-temporal insight of neural activities in the cortex. Because the number of possible sources is far greater than the number of MEG detectors, the proposition to localize sources directly…

Quantitative Methods · Quantitative Biology 2009-03-06 Hung-I Pai , Chih-Yuan Tseng , H. C. Lee

Functional magnetic resonance imaging (fMRI) is a neuroimaging modality that captures the blood oxygen level in a subject's brain while the subject either rests or performs a variety of functional tasks under different conditions. Given…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Sam Nguyen , Brenda Ng , Alan D. Kaplan , Priyadip Ray

Magnetoencephalography (MEG) conventionally operates within high-performance magnetic shields due to the extremely weak magnetic field signals from the measured objects and the narrow dynamic range of the magnetic sensors employed for…

Medical Physics · Physics 2024-03-20 Yosuke Ito , Hiroyuki Ueda , Takenori Oida , Takahiro Moriya , Akinori Saito , Motohiro Suyama

Magnetic resonance imaging (MRI) is a crucial medical imaging modality. However, long acquisition times remain a significant challenge, leading to increased costs, and reduced patient comfort. Recent studies have shown the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Amirmohammad Shamaei , Alexander Stebner , Salome , Bosshart , Johanna Ospel , Gouri Ginde , Mariana Bento , Roberto Souza

Visual image reconstruction, the decoding of perceptual content from brain activity into images, has advanced significantly with the integration of deep neural networks (DNNs) and generative models. This review traces the field's evolution…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yukiyasu Kamitani , Misato Tanaka , Ken Shirakawa

Brain signals constitute the information that are processed by millions of brain neurons (nerve cells and brain cells). These brain signals can be recorded and analyzed using various of non-invasive techniques such as the…

Neurons and Cognition · Quantitative Biology 2022-01-13 Almabrok Essa , Hari Kotte

EEG based brain state decoding has numerous applications. State of the art decoding is based on processing of the multivariate sensor space signal, however evidence is mounting that EEG source reconstruction can assist decoding. EEG source…

Neurons and Cognition · Quantitative Biology 2017-04-20 Rasmus S. Andersen , Anders U. Eliasen , Nicolai Pedersen , Michael Riis Andersen , Sofie Therese Hansen , Lars Kai Hansen

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in deep learning and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weiyu Guo , Guoying Sun , JianXiang He , Tong Shao , Shaoguang Wang , Ziyang Chen , Meisheng Hong , Ying Sun , Hui Xiong

Recently, practical brain-computer interface is actively carried out, especially, in an ambulatory environment. However, the electroencephalography signals are distorted by movement artifacts and electromyography signals in ambulatory…

Human-Computer Interaction · Computer Science 2020-02-05 Young-Eun Lee , Minji Lee

Advances on signal, image and video generation underly major breakthroughs on generative medical imaging tasks, including Brain Image Synthesis. Still, the extent to which functional Magnetic Ressonance Imaging (fMRI) can be mapped from the…

Machine Learning · Computer Science 2020-09-30 David Calhas , Rui Henriques

Magnetic resonance imaging (MRI) is the cornerstone technique for diagnostic medicine, biology, and neuroscience. This imaging method is highly innovative, noninvasive and its impact continues to grow. It can be used for measuring changes…

Perceptual similarity is a cognitive judgment that represents the end-stage of a complex cascade of hierarchical processing throughout visual cortex. Previous studies have shown a correspondence between the similarity of coarse-scale fMRI…

Neurons and Cognition · Quantitative Biology 2016-02-11 Susan G. Wardle , Nikolaus Kriegeskorte , Tijl Grootswagers , Seyed-Mahdi Khaligh-Razavi , Thomas A. Carlson

Neural decoding is an important method in cognitive neuroscience that aims to decode brain representations from recorded neural activity using a multivariate machine learning model. The THINGS initiative provides a large EEG dataset of 46…

Machine Learning · Computer Science 2025-08-12 Laurits Dixen , Stefan Heinrich , Paolo Burelli

Recent work has demonstrated that complex visual stimuli can be decoded from human brain activity using deep generative models, offering new ways to probe how the brain represents real-world scenes. However, many existing approaches first…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Pinyuan Feng , Hossein Adeli , Wenxuan Guo , Fan Cheng , Ethan Hwang , Nikolaus Kriegeskorte