English
Related papers

Related papers: Autoregressive Visual Decoding from EEG Signals

200 papers

Autoregressive Transformer models have demonstrated impressive performance in video generation, but their sequential token-by-token decoding process poses a major bottleneck, particularly for long videos represented by tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yang Ye , Junliang Guo , Haoyu Wu , Tianyu He , Tim Pearce , Tabish Rashid , Katja Hofmann , Jiang Bian

Accurately predicting emotions from brain signals has the potential to achieve goals such as improving mental health, human-computer interaction, and affective computing. Emotion prediction through neural signals offers a promising…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Annemarie Hoffsommer , Helen Schneider , Svetlana Pavlitska , J. Marius Zöllner

Recent studies demonstrate the use of a two-stage supervised framework to generate images that depict human perception to visual stimuli from EEG, referring to EEG-visual reconstruction. They are, however, unable to reproduce the exact…

Multimedia · Computer Science 2022-08-19 Zesheng Ye , Lina Yao , Yu Zhang , Sylvia Gustin

Recent advances in self-supervised learning for EEG representation have largely relied on masked reconstruction, where models are trained to recover randomly masked signal segments. While effective at modeling local dependencies, such…

Machine Learning · Computer Science 2026-04-17 Shaocong Wang , Tong Liu , Yihan Li , Ming Li , Kairui Wen , Pei Yang , Wenqi Ji , Minjing Yu , Yong-Jin Liu

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Electroencephalography (EEG) has become one of the key modalities underpinning brain-computer interfaces (BCIs) due to its high temporal resolution, rapid responsiveness, non-invasiveness, low cost, and portability. However, EEG signals are…

Neurons and Cognition · Quantitative Biology 2026-04-17 Yihang Dong , Changhong Jing , Shuqiang Wang

Electroencephalography (EEG) is a widely used non-invasive technique for monitoring brain activity, but low signal-to-noise ratios (SNR) due to various artifacts often compromise its utility. Conventional artifact removal methods require…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Shantanu Sarkar , Piotr Nabrzyski , Saurabh Prasad , Jose Luis Contreras-Vidal

Electroencephalogram (EEG) classification has been widely used in various medical and engineering applications, where it is important for understanding brain function, diagnosing diseases, and assessing mental health conditions. However,…

Signal Processing · Electrical Eng. & Systems 2024-08-20 Mingzhi Chen , Yiyu Gui , Yuqi Su , Yuesheng Zhu , Guibo Luo , Yuchao Yang

A significant challenge in the electroencephalogram EEG lies in the fact that current data representations involve multiple electrode signals, resulting in data redundancy and dominant lead information. However extensive research conducted…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Huyen Ngo , Khoi Do , Duong Nguyen , Viet Dung Nguyen , Lan Dang

Steady-State Visual Evoked Potential is a brain response to visual stimuli flickering at constant frequencies. It is commonly used in brain-computer interfaces for direct brain-device communication due to their simplicity, minimal training…

Human-Computer Interaction · Computer Science 2025-06-03 Chenlong Wang , Jiaao Li , Shuailei Zhang , Wenbo Ding , Xinlei Chen

This paper introduces DreamDiffusion, a novel method for generating high-quality images directly from brain electroencephalogram (EEG) signals, without the need to translate thoughts into text. DreamDiffusion leverages pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yunpeng Bai , Xintao Wang , Yan-pei Cao , Yixiao Ge , Chun Yuan , Ying Shan

Brain-computer interfaces (BCI) offer numerous human-centered application possibilities, particularly affecting people with neurological disorders. Text or speech decoding from brain activities is a relevant domain that could augment the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-10 Jihwan Lee , Tiantian Feng , Aditya Kommineni , Sudarsana Reddy Kadiri , Shrikanth Narayanan

Electroencephalography (EEG) is one of the most common signals used to capture the electrical activity of the brain, and the decoding of EEG, to acquire the user intents, has been at the forefront of brain-computer/machine interfaces…

Machine Learning · Computer Science 2025-07-04 Haodong Zhang , Hongqi Li

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Electroencephalography (EEG) plays a vital role in recording brain activities and is integral to the development of brain-computer interface (BCI) technologies. However, the limited availability and high variability of EEG signals present…

Signal Processing · Electrical Eng. & Systems 2024-02-16 Joshua Park , Priyanshu Mahey , Ore Adeniyi

Generative modeling of high-dimensional data is a key problem in machine learning. Successful approaches include latent variable models and autoregressive models. The complementary strengths of these approaches, to model global and local…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Thomas Lucas , Jakob Verbeek

Electroencephalography (EEG) stands as a crucial tool in neuroscientific research and clinical diagnostics, providing valuable insights into the electrical activities of the brain. Traditional EEG signal processing techniques, predominantly…

Neurons and Cognition · Quantitative Biology 2024-01-12 Aryan Govil , Eric Yao , Christina R. Borao

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Most advanced visual grounding methods rely on Transformers for visual-linguistic feature fusion. However, these Transformer-based approaches encounter a significant drawback: the computational costs escalate quadratically due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Wei Chen , Long Chen , Yu Wu

Autoregressive language modeling (ALM) have been successfully used in self-supervised pre-training in Natural language processing (NLP). However, this paradigm has not achieved comparable results with other self-supervised approach in…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Yu Qi , Fan Yang , Yousong Zhu , Yufei Liu , Liwei Wu , Rui Zhao , Wei Li