English
Related papers

Related papers: Brain3D: EEG-to-3D Decoding of Visual Representati…

200 papers

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming…

Computation and Language · Computer Science 2025-12-29 Yiqian Yang , Hyejeong Jo , Yiqun Duan , Qiang Zhang , Jinni Zhou , Xuming Hu , Won Hee Lee , Renjing Xu , Hui Xiong

Reconstructing natural language from non-invasive electroencephalography (EEG) holds great promise as a language decoding technology for brain-computer interfaces (BCIs). However, EEG-based language decoding is still in its nascent stages,…

Computation and Language · Computer Science 2024-09-27 Jiaqi Wang , Zhenxi Song , Zhengyu Ma , Xipeng Qiu , Min Zhang , Zhiguo Zhang

Emotion decoding using Electroencephalography (EEG)-based affective brain-computer interfaces (aBCIs) plays a crucial role in affective computing but is limited by challenges such as EEG's non-stationarity, individual variability, and the…

Human-Computer Interaction · Computer Science 2025-06-25 Ting Luo , Jing Zhang , Yingwei Qiu , Li Zhang , Yaohua Hu , Zhuliang Yu , Zhen Liang

Comprehensive, synapse-resolution imaging of the brain will be crucial for understanding neuronal computations and function. In connectomics, this has been the sole purview of volume electron microscopy (EM), which entails an excruciatingly…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Yicong Li , Yaron Meirovitch , Aaron T. Kuan , Jasper S. Phelps , Alexandra Pacureanu , Wei-Chung Allen Lee , Nir Shavit , Lu Mi

Non-invasive brainwave decoding is usually done using Magneto/Electroencephalography (MEG/EEG) sensor measurements as inputs. This makes combining datasets and building models with inductive biases difficult as most datasets use different…

Signal Processing · Electrical Eng. & Systems 2024-10-29 Yonatan Gideoni , Ryan Charles Timms , Oiwi Parker Jones

EEG-based visual neural decoding aims to align neural responses with visual stimuli for tasks such as image retrieval. However, limited paired data and a fundamental mismatch between high-fidelity digital images and biological visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Jingtao Liu , Peiliang Gong , Chuhang Zheng , Yiheng Liu , Qi Zhu

Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the…

Machine Learning · Computer Science 2026-05-12 Runhe Zhou , Shanglin Li , Guanxiang Huang , Xinliang Zhou , Qibin Zhao , Motoaki Kawanabe , Yi Ding , Cuntai Guan

Electroencephalography (EEG) is a useful way to implicitly monitor the users perceptual state during multimedia consumption. One of the primary challenges for the practical use of EEG-based monitoring is to achieve a satisfactory level of…

Machine Learning · Computer Science 2021-12-07 Soobeom Jang , Seong-Eun Moon , Jong-Seok Lee

While Multimodal Large Language Models (MLLMs) have achieved remarkable success in 2D visual understanding, their ability to reason about 3D space remains limited. To address this gap, we introduce geometrically referenced 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jiangye Yuan , Gowri Kumar , Baoyuan Wang

Electroencephalography (EEG) and Magnetoencephalography (MEG) are pivotal in understanding brain activity but are limited by their poor spatial resolution. EEG/MEG source imaging (ESI) infers the high-resolution electric field distribution…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Song Wang , Chen Wei , Kexin Lou , Dongfeng Gu , Quanying Liu

Current foundation models for electroencephalography (EEG) rely on architectures adapted from computer vision or natural language processing, typically treating neural signals as pixel grids or token sequences. This approach overlooks that…

Signal Processing · Electrical Eng. & Systems 2026-03-05 Zhisheng Chen , Yingwei Zhang , Qizhen Lan , Tianyu Liu , Huacan Wang , Yi Ding , Ziyu Jia , Ronghao Chen , Kun Wang , Xinliang Zhou

3D object reconstructions of transparent and concave structured objects, with inferred material properties, remains an open research problem for robot navigation in unstructured environments. In this paper, we propose a multimodal single-…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Justin Wilson , Ming C. Lin

In modern neuroscience, functional magnetic resonance imaging (fMRI) has been a crucial and irreplaceable tool that provides a non-invasive window into the dynamics of whole-brain activity. Nevertheless, fMRI is limited by hemodynamic…

Signal Processing · Electrical Eng. & Systems 2024-01-26 Yamin Li , Ange Lou , Ziyuan Xu , Shiyu Wang , Catie Chang

Brain-to-image decoding has been recently propelled by the progress in generative AI models and the availability of large ultra-high field functional Magnetic Resonance Imaging (fMRI). However, current approaches depend on complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Marlène Careil , Yohann Benchetrit , Jean-Rémi King

While electroencephalography (EEG) has been a popular modality for neural decoding, it often involves task specific acquisition of the EEG data. This poses challenges for the development of a unified pipeline to learn embeddings for various…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Pushapdeep Singh , Jyoti Nigam , Medicherla Vamsi Krishna , Arnav Bhavsar , Aditya Nigam

We have developed a graphic user interface (GUI), ExBrainable, dedicated to convolutional neural networks (CNN) model training and visualization in electroencephalography (EEG) decoding. Available functions include model training,…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Ya-Lin Huang , Chia-Ying Hsieh , Jian-Xue Huang , Chun-Shu Wei

Electroencephalogram (EEG) has shown a useful approach to produce a brain-computer interface (BCI). One-dimensional (1-D) EEG signal is yet easily disturbed by certain artifacts (a.k.a. noise) due to the high temporal resolution. Thus, it…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Peng Yi , Kecheng Chen , Zhaoqi Ma , Di Zhao , Xiaorong Pu , Yazhou Ren

Cross-modal 3D retrieval is a critical yet challenging task, aiming to achieve bi-directional retrieval between 3D and text modalities. Current methods predominantly rely on a certain 3D representation (e.g., point cloud), with few…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Junlong Ren , Hao Wang

Medical brain imaging relies heavily on image registration to accurately curate structural boundaries of brain features for various healthcare applications. Deep learning models have shown remarkable performance in image registration in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Taha Razzaq , Asim Iqbal

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang