English
Related papers

Related papers: Decoding EEG Brain Activity for Multi-Modal Natura…

200 papers

Silent speech decoding, which performs unvocalized human speech recognition from electroencephalography/electromyography (EEG/EMG), increases accessibility for speech-impaired humans. However, data collection is difficult and performed…

Quantitative Methods · Quantitative Biology 2025-06-18 Masakazu Inoue , Motoshige Sato , Kenichi Tomeoka , Nathania Nah , Eri Hatakeyama , Kai Arulkumaran , Ilya Horiguchi , Shuntaro Sasai

Emotion has a significant influence on how one thinks and interacts with others. It serves as a link between how a person feels and the actions one takes, or it could be said that it influences one's life decisions on occasion. Since the…

Signal Processing · Electrical Eng. & Systems 2023-07-12 S. M. Masrur Ahmed , Eshaan Tanzim Sabur

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more…

Machine Learning · Computer Science 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

Recently, electroencephalography (EEG) signals have been actively incorporated to decode brain activity to visual or textual stimuli and achieve object recognition in multi-modal AI. Accordingly, endeavors have been focused on building…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Xu Zheng , Ling Wang , Kanghao Chen , Yuanhuiyi Lyu , Jiazhou Zhou , Lin Wang

The study of Music Cognition and neural responses to music has been invaluable in understanding human emotions. Brain signals, though, manifest a highly complex structure that makes processing and retrieving meaningful features challenging,…

Sound · Computer Science 2022-02-22 Kleanthis Avramidis , Christos Garoufis , Athanasia Zlatintsi , Petros Maragos

Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming…

Computation and Language · Computer Science 2025-12-29 Yiqian Yang , Hyejeong Jo , Yiqun Duan , Qiang Zhang , Jinni Zhou , Xuming Hu , Won Hee Lee , Renjing Xu , Hui Xiong

This study aimed to analyze brain activity during various STEM activities, exploring the feasibility of classifying between different tasks. EEG brain data from twenty subjects engaged in five cognitive tasks were collected and segmented…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Ryan Cho , Mobasshira Zaman , Kyu Taek Cho , Jaejin Hwang

Emotion Recognition from EEG signals has long been researched as it can assist numerous medical and rehabilitative applications. However, their complex and noisy structure has proven to be a serious barrier for traditional modeling methods.…

Signal Processing · Electrical Eng. & Systems 2021-12-15 Kleanthis Avramidis , Athanasia Zlatintsi , Christos Garoufis , Petros Maragos

Electroencephalography (EEG) signals reflect activities on certain brain areas. Effective classification of time-varying EEG signals is still challenging. First, EEG signal processing and feature engineering are time-consuming and highly…

Human-Computer Interaction · Computer Science 2019-08-27 Xiang Zhang , Lina Yao , Xianzhi Wang , Wenjie Zhang , Shuai Zhang , Yunhao Liu

An electroencephalography (EEG) based Brain Computer Interface (BCI) enables people to communicate with the outside world by interpreting the EEG signals of their brains to interact with devices such as wheelchairs and intelligent robots.…

Human-Computer Interaction · Computer Science 2017-09-27 Xiang Zhang , Lina Yao , Quan Z. Sheng , Salil S. Kanhere , Tao Gu , Dalin Zhang

The human brain is constantly processing and integrating information in order to make decisions and interact with the world, for tasks from recognizing a familiar face to playing a game of tennis. These complex cognitive processes require…

Neurons and Cognition · Quantitative Biology 2019-05-14 Thomas A. Carlson , Tijl Grootswagers , Amanda K. Robinson

Emotion estimation in music listening is confronting challenges to capture the emotion variation of listeners. Recent years have witnessed attempts to exploit multimodality fusing information from musical contents and physiological signals…

Artificial Intelligence · Computer Science 2016-12-01 Nattapong Thammasan , Ken-ichi Fukui , Masayuki Numao

Localizing neuronal activity in the brain, both in time and in space, is a central challenge to advance the understanding of brain function. Because of the inability of any single neuroimaging techniques to cover all aspects at once, there…

Neurons and Cognition · Quantitative Biology 2013-07-09 Yaroslav O. Halchenko , Michael Hanke , James V. Haxby , Stephen Jose Hanson , Christoph S. Herrmann

Emotion recognition using electroencephalogram (EEG) signals has broad potential across various domains. EEG signals have ability to capture rich spatial information related to brain activity, yet effectively modeling and utilizing these…

Human-Computer Interaction · Computer Science 2025-01-28 Yuzhe Zhang , Chengxi Xie , Huan Liu , Yuhan Shi , Dalin Zhang

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

Speech cognition bears potential application as a brain computer interface that can improve the quality of life for the otherwise communication impaired people. While speech and resting state EEG are popularly studied, here we attempt to…

Machine Learning · Computer Science 2020-10-13 Rini A Sharon , Hema A Murthy

Deep learning has recently enabled the decoding of language from the neural activity of a few participants with electrodes implanted inside their brain. However, reliably decoding words from non-invasive recordings remains an open…

Signal Processing · Electrical Eng. & Systems 2024-12-25 Stéphane d'Ascoli , Corentin Bel , Jérémy Rapin , Hubert Banville , Yohann Benchetrit , Christophe Pallier , Jean-Rémi King

Brain Signals, such as Electroencephalography (EEG), and human languages have been widely explored independently for many downstream tasks, however, the connection between them has not been well explored. In this study, we explore the…

Neurons and Cognition · Quantitative Biology 2024-05-07 William Han , Jielin Qiu , Jiacheng Zhu , Mengdi Xu , Douglas Weber , Bo Li , Ding Zhao

Multimodal learning has been a popular area of research, yet integrating electroencephalogram (EEG) data poses unique challenges due to its inherent variability and limited availability. In this paper, we introduce a novel multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Kang Yin , Hye-Bin Shin , Dan Li , Seong-Whan Lee

Nowadays, machine and deep learning techniques are widely used in different areas, ranging from economics to biology. In general, these techniques can be used in two ways: trying to adapt well-known models and architectures to the available…

Machine Learning · Computer Science 2022-03-21 Danilo Avola , Marco Cascio , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Marco Raoul Marini , Daniele Pannone