English
Related papers

Related papers: MEEDAV: A Synchronous Web Viewer for EEG, Eye-Trac…

200 papers

Robust and interpretable dementia diagnosis from noisy, non-stationary electroencephalography (EEG) is clinically essential yet remains challenging. To this end, we propose SeeGraph, a Sparse-Explanatory dynamic EEG-graph network that…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Fengcheng Wu , Zhenxi Song , Guoyang Xu , Kaisong Hu , Zirui Wang , Yi Guo , Zhiguo Zhang

Electroencephalography (EEG) visual decoding remains challenging due to the modality gap between low-SNR neural signals and highly structured vision--language spaces, making direct cross-modal alignment unstable. To address this, we propose…

Image and Video Processing · Electrical Eng. & Systems 2026-05-28 Jiahe Meng , Weiming Zeng , Yueyang Li , Bo Chai , Hongjie Yan , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

We present a hybrid brain-machine interface (BMI) that integrates steady-state visually evoked potential (SSVEP)-based EEG and facial EMG to improve multimodal control and mitigate fatigue in assistive applications. Traditional BMIs relying…

Neurons and Cognition · Quantitative Biology 2025-02-18 Daniel Wang , Katie Hong , Zachary Sayyah , Malcolm Krolick , Emma Steinberg , Rohan Venkatdas , Sidharth Pavuluri , Yipeng Wang , Zihan Huang

Speech decoding from EEG signals is a challenging task, where brain activity is modeled to estimate salient characteristics of acoustic stimuli. We propose FESDE, a novel framework for Fully-End-to-end Speech Decoding from EEG signals. Our…

Signal Processing · Electrical Eng. & Systems 2024-06-14 Jihwan Lee , Aditya Kommineni , Tiantian Feng , Kleanthis Avramidis , Xuan Shi , Sudarsana Kadiri , Shrikanth Narayanan

Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for emotion regulation and psychological stress relief. However,…

Sound · Computer Science 2026-05-19 Yimeng Zhang , Yueru Sun , Haoyu Gu , Zhanpeng Jin

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

The brain-assisted target speaker extraction (TSE) aims to extract the attended speech from mixed speech by utilizing the brain neural activities, for example Electroencephalography (EEG). However, existing models overlook the issue of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-03 Cunhang Fan , Ying Chen , Jian Zhou , Zexu Pan , Jingjing Zhang , Youdian Gao , Xiaoke Yang , Zhengqi Wen , Zhao Lv

In our research, we attempt to help people recognize their brain state of concentration or relaxation more conveniently and in real time. Considering the inconvenience of wearing traditional multiple electrode electroencephalographs, we…

Human-Computer Interaction · Computer Science 2015-09-28 Zhen Li , Jianjun Xu , Tingshao Zhu

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Auditory attention detection (AAD) aims to detect the target speaker in a multi-talker environment from brain signals, such as electroencephalography (EEG), which has made great progress. However, most AAD methods solely utilize attention…

Human-Computer Interaction · Computer Science 2025-05-22 Lu Li , Cunhang Fan , Hongyu Zhang , Jingjing Zhang , Xiaoke Yang , Jian Zhou , Zhao Lv

There has been a long-standing quest for a unified audio-visual-text model to enable various multimodal understanding tasks, which mimics the listening, seeing and reading process of human beings. Humans tends to represent knowledge using…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-22 Xianghu Yue , Xiaohai Tian , Lu Lu , Malu Zhang , Zhizheng Wu , Haizhou Li

Analyzing stereoelectroencephalography (SEEG) signals is critical for brain-computer interface (BCI) applications and neuroscience research, yet poses significant challenges due to the large number of input channels and their heterogeneous…

Machine Learning · Computer Science 2025-10-16 Chen Wang , Yansen Wang , Dongqi Han , Zilong Wang , Dongsheng Li

As an essential element for the diagnosis and rehabilitation of psychiatric disorders, the electroencephalogram (EEG) based emotion recognition has achieved significant progress due to its high precision and reliability. However, one…

Machine Learning · Computer Science 2021-07-19 Hao Chen , Ming Jin , Zhunan Li , Cunhang Fan , Jinpeng Li , Huiguang He

We are exploring the design and implementation of artificial expressions, kinetic audio-visual representations of real-time physiological data that reflect emotional and cognitive state. In this work, we demonstrate a prototype, the…

Human-Computer Interaction · Computer Science 2020-10-27 Tomohiro Tokunaga , Michael J. Lyons

High-density electroencephalography (HD-EEG) enables fine-grained measurement of cortical activity but requires expensive hardware and lengthy setup times, limiting its clinical and research accessibility. We propose EMAG (EEG Mixture of…

Machine Learning · Computer Science 2026-05-29 Alex Lazarovich , Ofir Itzhak Shahar , Gur Elkin , Ohad Ben-Shahar

In echocardiography (echo), an electrocardiogram (ECG) is conventionally used to temporally align different cardiac views for assessing critical measurements. However, in emergencies or point-of-care situations, acquiring an ECG is often…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Fatemeh Taheri Dezaki , Christina Luong , Tom Ginsberg , Robert Rohling , Ken Gin , Purang Abolmaesumi , Teresa Tsang

The electroencephalogram (EEG) has been the gold standard for quantifying mental workload; however, due to its complexity and non-portability, it can be constraining. ECG signals, which are feasible on wearable equipment pieces such as…

Machine Learning · Computer Science 2026-01-13 Malavika Pradeep , Akshay Sasi , Nusaibah Farrukh , Rahul Venugopal , Elizabeth Sherly

We propose the notion of Attention-Aware Visualizations (AAVs) that track the user's perception of a visual representation over time and feed this information back to the visualization. Such context awareness is particularly useful for…

Human-Computer Interaction · Computer Science 2025-01-16 Arvind Srinivasan , Johannes Ellemose , Peter W. S. Butcher , Panagiotis D. Ritsos , Niklas Elmqvist

In real-world applications of noninvasive electroencephalography (EEG), specialized decoders often show limited generalizability across diverse tasks under subject-independent settings. One central challenge is that task-relevant EEG…

Artificial Intelligence · Computer Science 2026-04-21 Zhiyuan Ma , Zeyuan Li , Zihao Qiu , Jinhao Li , Lingqin Meng , Xinche Zhang , Yixuan Liu , Xinke Shen , Sen Song

This work presents MAD (Multimodal Affection Dataset), a multimodal emotion dataset designed for affective computing and neurophysiological modeling. MAD is built upon synchronous collection of diverse physiological signals (EEG, ECG, EOG,…

Signal Processing · Electrical Eng. & Systems 2026-03-09 Shengwei Guo , Yunqing Qiao , Wenzhan Zhang , Bo Liu , Yong Wang , Guobing Sun