English
Related papers

Related papers: Exploring EEG and Eye Movement Fusion for Multi-Cl…

200 papers

In this study, we adopted visual motion imagery, which is a more intuitive brain-computer interface (BCI) paradigm, for decoding the intuitive user intention. We developed a 3-dimensional BCI training platform and applied it to assist the…

Signal Processing · Electrical Eng. & Systems 2020-05-19 Byoung-Hee Kwon , Ji-Hoon Jeong , Jeong-Hyun Cho , Seong-Whan Lee

Robust decoding and classification of brain patterns measured with electroencephalography (EEG) remains a major challenge for real-world (i.e. outside scientific lab and medical facilities) brain-computer interface (BCI) applications due to…

Neurons and Cognition · Quantitative Biology 2025-12-03 Paul Barbaste , Olivier Oullier , Xavier Vasques

Brain-computer interface (BCI) technology facilitates communication between the human brain and computers, primarily utilizing electroencephalography (EEG) signals to discern human intentions. Although EEG-based BCI systems have been…

Signal Processing · Electrical Eng. & Systems 2024-03-07 Young-Min Go , Seong-Hyun Yu , Hyeong-Yeong Park , Minji Lee , Ji-Hoon Jeong

Recent studies have focused on utilizing multi-modal data to develop robust models for facial Action Unit (AU) detection. However, the heterogeneity of multi-modal data poses challenges in learning effective representations. One such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiang Zhang , Huiyuan Yang , Taoyue Wang , Xiaotian Li , Lijun Yin

This study introduces a pioneering approach in brain-computer interface (BCI) technology, featuring our novel concept of high-level visual imagery for non-invasive electroencephalography (EEG)-based communication. High-level visual imagery,…

Human-Computer Interaction · Computer Science 2025-11-03 Byoung-Hee Kwon , Minji Lee , Seong-Whan Lee

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Motivated by the inconceivable capability of the human brain in simultaneously processing multi-modal signals and its real-time feedback to the outer world events, there has been a surge of interest in establishing a communication bridge…

Signal Processing · Electrical Eng. & Systems 2020-02-04 Soroosh Shahtalebi , Amir Asif , Arash Mohammadi

Electroencephalography (EEG) signal decoding is a key technology that translates brain activity into executable commands, laying the foundation for direct brain-machine interfacing and intelligent interaction. To address the inherent…

Machine Learning · Computer Science 2026-01-05 Xiangrui Cai , Shaocheng Ma , Lei Cao , Jie Li , Tianyu Liu , Yilin Dong

Decoding visual information from electroencephalography (EEG) signals remains a fundamental challenge in brain-computer interfaces and medical rehabilitation. Existing EEG visual decoding methods mainly focus on learning a single global EEG…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Xiang Gao , Hui Tian , Yanming Zhu , Xuefei Yin , Alan Wee-Chung Liew

Steady-State Visual Evoked Potential is a brain response to visual stimuli flickering at constant frequencies. It is commonly used in brain-computer interfaces for direct brain-device communication due to their simplicity, minimal training…

Human-Computer Interaction · Computer Science 2025-06-03 Chenlong Wang , Jiaao Li , Shuailei Zhang , Wenbo Ding , Xinlei Chen

In this work, we propose an innovative framework that integrates EEG, image, and text data, aiming to decode visual neural representations from low signal-to-noise ratio EEG signals. Specifically, we introduce text modality to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Kaili sun , Xingyu Miao , Bing Zhai , Haoran Duan , Yang Long

This study aims to enhance BCI applications for individuals with motor impairments by comparing the effectiveness of tripolar EEG (tEEG) with conventional EEG. The focus is on interpreting and decoding various grasping movements, such as…

Signal Processing · Electrical Eng. & Systems 2025-06-12 Ali Rabiee , Sima Ghafoori , Anna Cetera , Maryam Norouzi , Walter Besio , Reza Abiri

Decoding visual information from time-resolved brain recordings, such as EEG and MEG, plays a pivotal role in real-time brain-computer interfaces. However, existing approaches primarily focus on direct brain-image feature alignment and are…

Human-Computer Interaction · Computer Science 2025-11-12 Chengjian Xu , Yonghao Song , Zelin Liao , Haochuan Zhang , Qiong Wang , Qingqing Zheng

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong

Audio-visual information fusion enables a performance improvement in speech recognition performed in complex acoustic scenarios, e.g., noisy environments. It is required to explore an effective audio-visual fusion strategy for audiovisual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-07 Liangfa Wei , Jie Zhang , Junfeng Hou , Lirong Dai

One of the current issues in Brain-Computer Interface is how to deal with noisy Electroencephalography measurements organized as multidimensional datasets. On the other hand, recently, significant advances have been made in multidimensional…

Quantitative Methods · Quantitative Biology 2018-07-27 Jordi Sole-Casals , Cesar F. Caiafa , Qibin Zhao , Adrzej Cichocki

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

Brain Computer Interface (BCI) technologies have the potential to improve the lives of millions of people around the world, whether through assistive technologies or clinical diagnostic tools. Despite advancements in the field, however, at…

Machine Learning · Computer Science 2023-01-31 Chad Mello , Troy Weingart , Ethan M. Rudd

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

The new perspective in visual classification aims to decode the feature representation of visual objects from human brain activities. Recording electroencephalogram (EEG) from the brain cortex has been seen as a prevalent approach to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xianglin Zheng , Zehong Cao , Quan Bai