English
Related papers

Related papers: RealMind: Advancing Visual Decoding and Language I…

200 papers

Deep understanding of electromagnetic signals is fundamental to dynamic spectrum management, intelligent transportation, autonomous driving and unmanned vehicle perception. The field faces challenges because electromagnetic signals differ…

Signal Processing · Electrical Eng. & Systems 2025-08-27 Luqing Luo , Wenjin Gui , Yunfei Liu , Ziyue Zhang , Yunxi Zhang , Fengxiang Wang , Zonghao Guo , Zizhi Ma , Xinzhu Liu , Hanxiang He , Jinhai Li , Xin Qiu , Wupeng Xie , Yangang Sun

Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode…

Computation and Language · Computer Science 2024-08-12 Jinzhao Zhou , Yiqun Duan , Ziyi Zhao , Yu-Cheng Chang , Yu-Kai Wang , Thomas Do , Chin-Teng Lin

Decoding visual experience from brain signals offers exciting possibilities for neuroscience and interpretable AI. While EEG is accessible and temporally precise, its limitations in spatial detail hinder image reconstruction. Our model…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Arshak Rezvani , Ali Akbari , Kosar Sanjar Arani , Maryam Mirian , Emad Arasteh , Martin J. McKeown

Rapid Serial Visual Presentation (RSVP)-based Brain-Computer Interfaces (BCIs) facilitate high-throughput target image detection by identifying event-related potentials (ERPs) evoked in EEG signals. The RSVP-BCI systems effectively detect…

Human-Computer Interaction · Computer Science 2026-03-11 Xujin Li , Wei Wei , Kun Zhao , Jiayu Mao , Yizhuo Lu , Shuang Qiu , Huiguang He

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

Reconstructing dynamic visual stimuli from brain EEG recordings is challenging due to the non-stationary and noisy nature of EEG signals and the limited availability of EEG-video datasets. Prior work has largely focused on static image…

Human-Computer Interaction · Computer Science 2025-09-23 Prajwal Singh , Anupam Sharma , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Electroencephalogram (EEG) signals have become a popular medium for decoding visual information due to their cost-effectiveness and high temporal resolution. However, current approaches face significant challenges in bridging the modality…

Machine Learning · Computer Science 2026-03-10 Sicheng Dai , Hongwang Xiao , Shan Yu , Qiwei Ye

The translation of brain dynamics into natural language is pivotal for brain-computer interfaces (BCIs). With the swift advancement of large language models, such as ChatGPT, the need to bridge the gap between the brain and languages…

Human-Computer Interaction · Computer Science 2024-01-04 Yiqun Duan , Jinzhao Zhou , Zhen Wang , Yu-Kai Wang , Chin-Teng Lin

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Rapid Serial Visual Presentation (RSVP)-based Brain-Computer Interface (BCI) is an effective technology used for information detection by detecting Event-Related Potentials (ERPs). The current RSVP decoding methods can perform well in…

Human-Computer Interaction · Computer Science 2026-03-11 Xujin Li , Wei Wei , Shuang Qiu , Xinyi Zhang , Fu Li , Huiguang He

Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function.…

Neurons and Cognition · Quantitative Biology 2021-02-11 Pan Wang , Rui Zhou , Shuo Wang , Ling Li , Wenjia Bai , Jialu Fan , Chunlin Li , Peter Childs , Yike Guo

Recently, electroencephalography (EEG) signals have been actively incorporated to decode brain activity to visual or textual stimuli and achieve object recognition in multi-modal AI. Accordingly, endeavors have been focused on building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xu Zheng , Ling Wang , Kanghao Chen , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Brain-computer interfaces (BCIs) with speech decoding from brain recordings have broad application potential in fields such as clinical rehabilitation and cognitive neuroscience. However, current decoding methods remain limited to…

Neurons and Cognition · Quantitative Biology 2025-06-05 Yi Guo , Yihang Dong , Michael Kwok-Po Ng , Shuqiang Wang

Decoding visual experience from brain activity has advanced substantially, but cur- rent brain-to-text systems largely recover semantic content while discarding affect. Additionally, language models can generate emotional text when prompted…

Machine Learning · Computer Science 2026-05-19 Bilal A. Mohammed , Lin Gu , Ruogo Fang

Understanding how the human brain encodes and processes external visual stimuli has been a fundamental challenge in neuroscience. With advancements in artificial intelligence, sophisticated visual decoding architectures have achieved…

Human-Computer Interaction · Computer Science 2025-07-22 Jiahua Tang , Song Wang , Jiachen Zou , Chen Wei , Quanying Liu

Recent advances in brain-vision decoding have driven significant progress, reconstructing with high fidelity perceived visual stimuli from neural activity, e.g., functional magnetic resonance imaging (fMRI), in the human visual cortex. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Le Xu , Qi Zhang , Qixian Zhang , Hongyun Zhang , Duoqian Miao , Cairong Zhao

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

Computational Engineering, Finance, and Science · Computer Science 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi