English
Related papers

Related papers: ETS: Open Vocabulary Electroencephalography-To-Tex…

200 papers

A language is constructed of a finite/infinite set of sentences composing of words. Similar to natural languages, Electrocardiogram (ECG) signal, the most common noninvasive tool to study the functionality of the heart and diagnose several…

Signal Processing · Electrical Eng. & Systems 2020-06-17 Sajad Mousavi , Fatemeh Afghah , Fatemeh Khadem , U. Rajendra Acharya

Relating speech to EEG holds considerable importance but is challenging. In this study, a deep convolutional network was employed to extract spatiotemporal features from EEG data. Self-supervised speech representation and contextual text…

Signal Processing · Electrical Eng. & Systems 2024-02-02 Bo Wang , Xiran Xu , Zechen Zhang , Haolin Zhu , YuJie Yan , Xihong Wu , Jing Chen

In real-world applications such as emotion recognition from recorded brain activity, data are captured from electrodes over time. These signals constitute a multidimensional time series. In this paper, Echo State Network (ESN), a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Rahma Fourati , Boudour Ammar , Javier Sanchez-Medina , Adel M. Alimi

Text-to-Speech (TTS) benchmarks often fail to capture how well models handle nuanced and semantically complex text. Building on $\textit{EmergentTTS}$, we introduce $\textit{EmergentTTS-Eval}$, a comprehensive benchmark covering six…

Machine Learning · Computer Science 2025-05-30 Ruskin Raj Manku , Yuzhi Tang , Xingjian Shi , Mu Li , Alex Smola

A novel instance-based method for the classification of electroencephalography (EEG) signals is presented and evaluated in this paper. The non-stationary nature of the EEG signals, coupled with the demanding task of pattern recognition with…

Signal Processing · Electrical Eng. & Systems 2022-01-05 Su Yang , Sanaul Hoque , Farzin Deravi

Emotion recognition using electroencephalogram (EEG) signals has broad potential across various domains. EEG signals have ability to capture rich spatial information related to brain activity, yet effectively modeling and utilizing these…

Human-Computer Interaction · Computer Science 2025-01-28 Yuzhe Zhang , Chengxi Xie , Huan Liu , Yuhan Shi , Dalin Zhang

In human contact, emotion is very crucial. Attributes like words, voice intonation, facial expressions, and kinesics can all be used to portray one's feelings. However, brain-computer interface (BCI) devices have not yet reached the level…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Shashank Joshi , Falak Joshi

Reading comprehension, a fundamental cognitive ability essential for knowledge acquisition, is a complex skill, with a notable number of learners lacking proficiency in this domain. This study introduces innovative tasks for Brain-Computer…

Human-Computer Interaction · Computer Science 2024-01-30 Yuhong Zhang , Shilai Yang , Gert Cauwenberghs , Tzyy-Ping Jung

Electroencephalography (EEG) foundation models have recently emerged as a promising paradigm for brain-computer interfaces (BCIs), aiming to learn transferable neural representations from large-scale heterogeneous recordings. Despite rapid…

Machine Learning · Computer Science 2026-02-06 Dingkun Liu , Yuheng Chen , Zhu Chen , Zhenyao Cui , Yaozhi Wen , Jiayu An , Jingwei Luo , Dongrui Wu

Decoding visual stimuli from neural recordings is a critical challenge in the development of brain-computer interfaces (BCIs). Although recent EEG-based decoding approaches have made progress in tasks such as visual classification,…

Human-Computer Interaction · Computer Science 2024-12-31 Dongyang Li , Haoyang Qin , Mingyang Wu , Jiahua Tang , Yuang Cao , Chen Wei , Quanying Liu

In this paper we introduce attention-regression model to demonstrate predicting acoustic features from electroencephalography (EEG) features recorded in parallel with spoken sentences. First we demonstrate predicting acoustic features…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed Tewfik

Emotion Recognition in Conversation (ERC) involves detecting the underlying emotion behind each utterance within a conversation. Effectively generating representations for utterances remains a significant challenge in this task. Recent…

Computation and Language · Computer Science 2024-04-01 Fangxu Yu , Junjie Guo , Zhen Wu , Xinyu Dai

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remains an open…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Stéphane d'Ascoli , Corentin Bel , Jérémy Rapin , Hubert Banville , Yohann Benchetrit , Christophe Pallier , Jean-Rémi King

Speech-related Brain Computer Interfaces (BCI) aim primarily at finding an alternative vocal communication pathway for people with speaking disabilities. As a step towards full decoding of imagined speech from active thoughts, we present a…

Machine Learning · Computer Science 2019-04-10 Pramit Saha , Muhammad Abdul-Mageed , Sidney Fels

Modeling the relationship between natural speech and a recorded electroencephalogram (EEG) helps us understand how the brain processes speech and has various applications in neuroscience and brain-computer interfaces. In this context, so…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-26 Mohammad Jalilpour Monesi , Bernd Accou , Jair Montoya-Martinez , Tom Francart , Hugo Van Hamme

Many frameworks for emotional text-to-speech (E-TTS) rely on human-annotated emotion labels that are often inaccurate and difficult to obtain. Learning emotional prosody implicitly presents a tough challenge due to the subjective nature of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-21 Shreeram Suresh Chandra , Zongyang Du , Berrak Sisman

Electroencephalography (EEG) is a generally used neuroimaging approach in brain-computer interfaces due to its non-invasive characteristics and convenience, making it an effective tool for understanding human intentions. Therefore, recent…

Signal Processing · Electrical Eng. & Systems 2024-11-19 Sung-Jin Kim , Dae-Hyeok Lee , Hyeon-Taek Han

The electroencephalography classifier is the most important component of brain-computer interface based systems. There are two major problems hindering the improvement of it. First, traditional methods do not fully exploit multimodal…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Chuanqi Tan , Fuchun Sun , Wenchang Zhang

Exploring brain activity in relation to visual perception provides insights into the biological representation of the world. While functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) have enabled effective image…

Multimedia · Computer Science 2025-12-17 Shuqi Zhu , Ziyi Ye , Qingyao Ai , Yiqun Liu

Electroencephalography (EEG) denoising methods typically depend on manual intervention or clean reference signals. This work introduces a task-oriented learning framework for automatic EEG denoising that uses only task labels without clean…

Signal Processing · Electrical Eng. & Systems 2026-03-12 Tian-Yu Xiang , Zheng Lei , Xiao-Hu Zhou , Xiao-Liang Xie , Shi-Qi Liu , Mei-Jiang Gui , Hong-Yun Ou , Xin-Zheng Huang , Xin-Yi Fu , Zeng-Guang Hou