English
Related papers

Related papers: Towards Decoding Brain Activity During Passive Lis…

200 papers

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Decoding human activity from EEG signals has long been a popular research topic. While recent studies have increasingly shifted focus from single-subject to cross-subject analysis, few have explored the model's ability to perform zero-shot…

Neural and Evolutionary Computing · Computer Science 2025-06-18 Yifei Liu , Hengwei Ye , Shuhang Li

Noise reduction techniques based on deep learning have demonstrated impressive performance in enhancing the overall quality of recorded speech. While these approaches are highly performant, their application in audio engineering can be…

Sound · Computer Science 2023-10-18 Christian J. Steinmetz , Thomas Walther , Joshua D. Reiss

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

Probing is widely used to study which features can be decoded from language model representations. However, the common decoding probe approach has two limitations that we aim to solve with our new encoding probe approach: contributions of…

Computation and Language · Computer Science 2026-05-04 Gaofei Shen , Martijn Bentum , Tom Lentz , Afra Alishahi , Grzegorz Chrupała

Our ability to comprehend speech remains, to date, unrivaled by deep learning models. This feat could result from the brain's ability to fine-tune generic sound representations for speech-specific processes. To test this hypothesis, we…

Computation and Language · Computer Science 2021-03-02 Juliette Millet , Jean-Remi King

Speech disorders such as dysarthria and anarthria can severely impair the patient's ability to communicate verbally. Speech decoding brain-computer interfaces (BCIs) offer a potential alternative by directly translating speech intentions…

Human-Computer Interaction · Computer Science 2025-05-27 Hongbin Wang , Zhihong Jia , Yuanzhong Shen , Ziwei Wang , Siyang Li , Kai Shu , Feng Hu , Dongrui Wu

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

Significant challenges exist globally regarding literacy teaching and learning. To address these challenges, key features of how the brain works should be taken into account. First, perception is an active process based in detection of…

Neurons and Cognition · Quantitative Biology 2021-05-25 George Ellis , Carole Bloch

Decoding EEG during motor imagery is pivotal for the Brain-Computer Interface (BCI) system, influencing its overall performance significantly. As end-to-end data-driven learning methods advance, the challenge lies in balancing model…

Human-Computer Interaction · Computer Science 2025-01-28 Param Rajpura , Yogesh Kumar Meena

Computational and human perception are often considered separate approaches for studying sound changes over time; few works have touched on the intersection of both. To fill this research gap, we provide a pioneering review contrasting…

Computation and Language · Computer Science 2024-07-09 Siqi He , Wei Zhao

Research on deep learning-powered voice conversion (VC) in speech-to-speech scenarios is getting increasingly popular. Although many of the works in the field of voice conversion share a common global pipeline, there is a considerable…

Sound · Computer Science 2023-11-15 Anders R. Bargum , Stefania Serafin , Cumhur Erkut

One of the greatest goals of neuroscience in recent decades has been to rehabilitate individuals who no longer have a functional relationship between their mind and their body. Although neuroscience has produced technologies which allow the…

Human-Computer Interaction · Computer Science 2021-07-02 Samuel Kuhn , Nathan George

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

Decoding continuous language from brain activity is a formidable yet promising field of research. It is particularly significant for aiding people with speech disabilities to communicate through brain signals. This field addresses the…

Computation and Language · Computer Science 2024-04-03 Xinpei Zhao , Jingyuan Sun , Shaonan Wang , Jing Ye , Xiaohan Zhang , Chengqing Zong

Decoding neural representations of visual stimuli from electroencephalography (EEG) offers valuable insights into brain activity and cognition. Recent advancements in deep learning have significantly enhanced the field of visual decoding of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Minsuk Choi , Hiroshi Ishikawa

Patterns of brain activity are associated with different brain processes and can be used to identify different brain states and make behavioral predictions. However, the relevant features are not readily apparent and accessible. To mine…

Decoding imagined speech engages complex neural processes that are difficult to interpret due to uncertainty in timing and the limited availability of imagined-response datasets. In this study, we present a Magnetoencephalography (MEG)…

Signal Processing · Electrical Eng. & Systems 2025-12-04 Maryam Maghsoudi , Mohsen Rezaeizadeh , Shihab Shamma

Effectively learning the temporal dynamics in electroencephalogram (EEG) signals is challenging yet essential for decoding brain activities using brain-computer interfaces (BCIs). Although Transformers are popular for their long-term…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Yi Ding , Yong Li , Hao Sun , Rui Liu , Chengxuan Tong , Chenyu Liu , Xinliang Zhou , Cuntai Guan