English
Related papers

Related papers: Can Brain Signals Reveal Inner Alignment with Huma…

200 papers

Decoding the speech signal that a person is listening to from the human brain via electroencephalography (EEG) can help us understand how our auditory system works. Linear models have been used to reconstruct the EEG from speech or vice…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-18 Mohammad Jalilpour Monesi , Bernd Accou , Tom Francart , Hugo Van Hamme

Recent advances have increasingly applied large language models (LLMs) to electrocardiogram (ECG) interpretation, giving rise to Electrocardiogram-Language Models (ELMs). Conditioned on an ECG and a textual query, an ELM autoregressively…

Artificial Intelligence · Computer Science 2025-05-27 William Han , Chaojing Duan , Zhepeng Cen , Yihang Yao , Xiaoyu Song , Atharva Mhaskar , Dylan Leong , Michael A. Rosenberg , Emerson Liu , Ding Zhao

When we hear the word "house", we don't just process sound, we imagine walls, doors, memories. The brain builds meaning through layers, moving from raw acoustics to rich, multimodal associations. Inspired by this, we build on recent work…

Machine Learning · Computer Science 2025-11-11 Kateryna Shapovalenko , Quentin Auster

Emotion recognition from electroencephalography (EEG) signals remains challenging due to high inter-subject variability, limited labeled data, and the lack of interpretable reasoning in existing approaches. While recent multimodal large…

Machine Learning · Computer Science 2026-01-14 Fei Ma , Han Lin , Yifan Xie , Hongwei Ren , Xiaoyu Shen , Wenbo Ding , Qi Tian

Recent studies have shown that the underlying neural mechanisms of human speech comprehension can be analyzed using a match-mismatch classification of the speech stimulus and the neural response. However, such studies have been conducted…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-04 Akshara Soman , Vidhi Sinha , Sriram Ganapathy

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain…

Neurons and Cognition · Quantitative Biology 2024-10-01 Dai Shimizu , Ko Watanabe , Andreas Dengel

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

In human contact, emotion is very crucial. Attributes like words, voice intonation, facial expressions, and kinesics can all be used to portray one's feelings. However, brain-computer interface (BCI) devices have not yet reached the level…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Shashank Joshi , Falak Joshi

Cognitive science and neuroscience have long faced the challenge of disentangling representations of language from representations of conceptual meaning. As the same problem arises in today's language models (LMs), we investigate the…

Computation and Language · Computer Science 2025-08-18 Maria Ryskina , Greta Tuckute , Alexander Fung , Ashley Malkin , Evelina Fedorenko

Recently, electroencephalography (EEG) signals have been actively incorporated to decode brain activity to visual or textual stimuli and achieve object recognition in multi-modal AI. Accordingly, endeavors have been focused on building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xu Zheng , Ling Wang , Kanghao Chen , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

Brain connectivity can be estimated through a wide number of analyses applied to electroencephalographic (EEG) data. However, substantial heterogeneity in the implementation of connectivity methods exist. Heterogeneity in conceptualization…

Neurons and Cognition · Quantitative Biology 2021-09-01 Aleksandra Miljevic , Neil W. Bailey , Fidel Vila-Rodriguez , Sally E. Herring , Paul B. Fitzgerald

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Decoding natural language from non-invasive electroencephalography (EEG) remains fundamentally limited by low signal-to-noise ratio and restricted information bandwidth. This raises a fundamental question regarding whether sentence-level…

Computation and Language · Computer Science 2026-04-21 Xiaoli Yang , Huiyuan Tian , Yurui Li , Jianyu Zhang , Shijian Li , Gang Pan

State-of-the-art brain-to-text systems have achieved great success in decoding language directly from brain signals using neural networks. However, current approaches are limited to small closed vocabularies which are far from enough for…

Artificial Intelligence · Computer Science 2024-01-09 Zhenhailong Wang , Heng Ji

The study of Music Cognition and neural responses to music has been invaluable in understanding human emotions. Brain signals, though, manifest a highly complex structure that makes processing and retrieving meaningful features challenging,…

Sound · Computer Science 2022-02-22 Kleanthis Avramidis , Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Sleep stage classification based on electroencephalography (EEG) is fundamental for assessing sleep quality and diagnosing sleep-related disorders. However, most traditional machine learning methods rely heavily on prior knowledge and…

Artificial Intelligence · Computer Science 2025-11-25 Xihe Qiu , Gengchen Ma , Haoyu Wang , Chen Zhan , Xiaoyu Tan , Shuo Li

Decoding neurophysiological signals into language is of great research interest within brain-computer interface (BCI) applications. Electroencephalography (EEG), known for its non-invasiveness, ease of use, and cost-effectiveness, has been…

Quantitative Methods · Quantitative Biology 2024-09-26 Yitian Tao , Yan Liang , Luoyu Wang , Yongqing Li , Qing Yang , Han Zhang

Electroencephalography (EEG) is an objective tool for emotion recognition and shows promising performance. However, the label scarcity problem is a main challenge in this field, which limits the wide application of EEG-based emotion…

Signal Processing · Electrical Eng. & Systems 2024-09-02 Rushuang Zhou , Weishan Ye , Zhiguo Zhang , Yanyang Luo , Li Zhang , Linling Li , Gan Huang , Yining Dong , Yuan-Ting Zhang , Zhen Liang

Electroencephalography (EEG) recordings of brain activity taken while participants read or listen to language are widely used within the cognitive neuroscience and psycholinguistics communities as a tool to study language comprehension.…

Computation and Language · Computer Science 2019-11-05 Dan Schwartz , Tom Mitchell