English
Related papers

Related papers: ChineseEEG-2: An EEG Dataset for Multimodal Semant…

200 papers

In this study, we propose an ensemble learning framework for electroencephalogram-based overt speech classification, leveraging denoising diffusion probabilistic models with varying convolutional kernel sizes. The ensemble comprises three…

Sound · Computer Science 2024-11-15 Soowon Kim , Ha-Na Jo , Eunyeong Ko

Visual neural decoding aims to extract and interpret original visual experiences directly from human brain activity. Recent studies have demonstrated the feasibility of decoding visual semantic categories from electroencephalography (EEG)…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Hongzhou Chen , Lianghua He , Yihang Liu , Longzhen Yang , Shaohua Shang , MengChu Zhou

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

Dementia (DEM) is a growing global health challenge, underscoring the need for early and accurate diagnosis. Electroencephalography (EEG) provides a non-invasive window into brain activity, but conventional methods struggle to capture its…

Signal Processing · Electrical Eng. & Systems 2025-09-04 Mohammad Mehedi Hasan , Pedro G. Lind , Hernando Ombao , Anis Yazidi , Rabindra Khadka

Decoding speech from non-invasive brain signals, such as electroencephalography (EEG), has the potential to advance brain-computer interfaces (BCIs), with applications in silent communication and assistive technologies for individuals with…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-30 Terrance Yu-Hao Chen , Yulin Chen , Pontus Soederhaell , Sadrishya Agrawal , Kateryna Shapovalenko

Decoding human brain activity from electroencephalography (EEG) signals is a central challenge at the intersection of neuroscience and artificial intelligence, enabling diverse applications in mental state assessment, clinical monitoring,…

Human-Computer Interaction · Computer Science 2026-05-12 Weiheng Lu , Zhouheng Yao , Jiamin Wu , Pengyu Zhu , Yuchen Zhou , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

Deep networks for electroencephalogram (EEG) decoding are often only trained to solve one specific task, such as pathology or age decoding. A more general task-agnostic approach is to train deep networks to match a (clinical) EEG recording…

Computation and Language · Computer Science 2025-07-30 Tidiane Camaret Ndir , Robin Tibor Schirrmeister , Tonio Ball

Electroencephalography (EEG) is commonly used by physicians for the diagnosis of numerous neurological disorders. Due to the large volume of EEGs requiring interpretation and the specific expertise involved, artificial intelligence-based…

Modeling the relationship between natural speech and a recorded electroencephalogram (EEG) helps us understand how the brain processes speech and has various applications in neuroscience and brain-computer interfaces. In this context, so…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Mohammad Jalilpour Monesi , Bernd Accou , Jair Montoya-Martinez , Tom Francart , Hugo Van Hamme

Machine learning (ML) methods have the potential to automate clinical EEG analysis. They can be categorized into feature-based (with handcrafted features), and end-to-end approaches (with learned features). Previous studies on EEG pathology…

Everyday communication is dynamic and multisensory, often involving shifting attention, overlapping speech and visual cues. Yet, most neural attention tracking studies are still limited to highly controlled lab settings, using clean, often…

Signal Processing · Electrical Eng. & Systems 2026-01-22 Johanna Wilroth , Oskar Keding , Martin A. Skoglund , Maria Sandsten , Martin Enqvist , Emina Alickovic

Large Language Models (LLMs), such as ChatGPT and GPT-4, have dramatically transformed natural language processing research and shown promising strides towards Artificial General Intelligence (AGI). Nonetheless, the high costs associated…

Computation and Language · Computer Science 2024-02-26 Yiming Cui , Ziqing Yang , Xin Yao

Dysarthria impairs motor control of speech, often resulting in reduced intelligibility and frequent misarticulations. Although interest in brain-computer interface technologies is growing, electroencephalogram (EEG)-based communication…

Artificial Intelligence · Computer Science 2025-12-15 Ha-Na Jo , Jung-Sun Lee , Eunyeong Ko

Previous audio-visual speech separation methods use the synchronization of the speaker's facial movement and speech in the video to supervise the speech separation in a self-supervised way. In this paper, we propose a model to solve the…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-06 Jiasong Wu , Xuan Li , Taotao Li , Fanman Meng , Youyong Kong , Guanyu Yang , Lotfi Senhadji , Huazhong Shu

Electroencephalography (EEG) plays a crucial role in brain-computer interfaces (BCIs) and neurological diagnostics, but its real-world deployment faces challenges due to noise artifacts, missing data, and high annotation costs. We introduce…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Meghna Roy Chowdhury , Yi Ding , Shreyas Sen

Humans exhibit a remarkable ability to focus auditory attention in complex acoustic environments, such as cocktail parties. Auditory attention detection (AAD) aims to identify the attended speaker by analyzing brain signals, such as…

Signal Processing · Electrical Eng. & Systems 2025-03-07 Yuan Liao , Yuhong Zhang , Qiushi Han , Yuhang Yang , Weiwei Ding , Yuzhe Gu , Hengxin Yang , Liya Huang

Understanding and decoding brain activity from electroencephalography (EEG) signals is a fundamental challenge in neuroscience and AI, with applications in cognition, emotion recognition, diagnosis, and brain-computer interfaces. While…

Human-Computer Interaction · Computer Science 2025-07-01 Yuchen Zhou , Jiamin Wu , Zichen Ren , Zhouheng Yao , Weiheng Lu , Kunyu Peng , Qihao Zheng , Chunfeng Song , Wanli Ouyang , Chao Gou

With the rapid advancement of large language models like Gemini, GPT, and others, bridging the gap between the human brain and language processing has become an important area of focus. To address this challenge, researchers have developed…

Computation and Language · Computer Science 2025-12-10 Saydul Akbar Murad , Ashim Dahal , Nick Rahimi

The normalization of brain recordings from multiple subjects responding to the natural stimuli is one of the key challenges in auditory neuroscience. The objective of this normalization is to transform the brain data in such a way as to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Jaswanth Reddy Katthi , Sriram Ganapathy

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang