English
Related papers

Related papers: Brain3D: EEG-to-3D Decoding of Visual Representati…

200 papers

Human emotions are difficult to convey through words and are often abstracted in the process; however, electroencephalogram (EEG) signals can offer a more direct lens into emotional brain activity. Recent studies show that deep learning…

Neurons and Cognition · Quantitative Biology 2025-11-19 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Decoding human brain activity from electroencephalography (EEG) signals is a central challenge at the intersection of neuroscience and artificial intelligence, enabling diverse applications in mental state assessment, clinical monitoring,…

Human-Computer Interaction · Computer Science 2026-05-12 Weiheng Lu , Zhouheng Yao , Jiamin Wu , Pengyu Zhu , Yuchen Zhou , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

Decoding and expressing brain activity in a comprehensible form is a challenging frontier in AI. This paper presents Thought2Text, which uses instruction-tuned Large Language Models (LLMs) fine-tuned with EEG data to achieve this goal. The…

Computation and Language · Computer Science 2025-12-02 Abhijit Mishra , Shreya Shukla , Jose Torres , Jacek Gwizdka , Shounak Roychowdhury

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Electroencephalography (EEG) has become the most significant input signal for brain computer interface (BCI) based systems. However, it is very difficult to obtain satisfactory classification accuracy due to traditional methods can not…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Chuanqi Tan , Fuchun Sun , Wenchang Zhang , Jianhua Chen , Chunfang Liu

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices, providing critical support for individuals with motor impairments. However, accurate motor imagery (MI) decoding from…

Machine Learning · Computer Science 2026-04-08 Panagiotis Andrikopoulos , Siamak Mehrkanoon

The fusion of rigorous physical laws with flexible data-driven learning represents a new frontier in scientific simulation, yet bridging the gap between physical interpretability and computational efficiency remains a grand challenge. In…

Unveiling visual semantics from neural signals such as EEG, MEG, and fMRI remains a fundamental challenge due to subject variability and the entangled nature of visual features. Existing approaches primarily align neural activity directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Zehui Feng , Chenqi Zhang , Mingru Wang , Minuo Wei , Shiwei Cheng , Cuntai Guan , Ting Han

Reconstructing seeing images from fMRI recordings is an absorbing research area in neuroscience and provides a potential brain-reading technology. The challenge lies in that visual encoding in brain is highly complex and not fully revealed.…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Tao Fang , Yu Qi , Gang Pan

EEG is the most common signal source for noninvasive BCI applications. For such applications, the EEG signal needs to be decoded and translated into appropriate actions. A recently emerging EEG decoding approach is deep learning with…

Signal Processing · Electrical Eng. & Systems 2019-01-25 Felix A. Heilmeyer , Robin T. Schirrmeister , Lukas D. J. Fiederer , Martin Völker , Joos Behncke , Tonio Ball

An electroencephalography (EEG) based Brain Computer Interface (BCI) enables people to communicate with the outside world by interpreting the EEG signals of their brains to interact with devices such as wheelchairs and intelligent robots.…

Human-Computer Interaction · Computer Science 2017-09-27 Xiang Zhang , Lina Yao , Quan Z. Sheng , Salil S. Kanhere , Tao Gu , Dalin Zhang

Recent advancements in multimodal large language models (LLMs) have demonstrated significant potential across various domains, particularly in concept reasoning. However, their applications in understanding 3D environments remain limited,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Kuan-Chih Huang , Xiangtai Li , Lu Qi , Shuicheng Yan , Ming-Hsuan Yang

2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yik San Cheng , Runkai Zhao , Weidong Cai

Foundation models for electroencephalography (EEG) signals have recently demonstrated success in learning generalized representations of EEGs, outperforming specialized models in various downstream tasks. However, many of these models lack…

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Visual stimuli reconstruction from EEG remains challenging due to fidelity loss and representation shift. We propose CognitionCapturerPro, an enhanced framework that integrates EEG with multi-modal priors (images, text, depth, and edges)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Kaifan Zhang , Lihuo He , Junjie Ke , Yuqi Ji , Lukun Wu , Lizi Wang , Xinbo Gao

Despite the remarkable success of large-scale pre-trained image representation models (i.e., vision encoders) across various vision tasks, they are predominantly trained on 2D image data and therefore often fail to capture 3D spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Byungwoo Jeon , Dongyoung Kim , Huiwon Jang , Insoo Kim , Jinwoo Shin

Accurate decoding of lower-limb motion from EEG signals is essential for advancing brain-computer interface (BCI) applications in movement intent recognition and control. This study presents NeuroDyGait, a two-stage, phase-aware EEG-to-gait…

Signal Processing · Electrical Eng. & Systems 2026-02-13 Xi Fu , Weibang Jiang , Rui Liu , Gernot R. Müller-Putz , Cuntai Guan