English
Related papers

Related papers: Deep Representation Learning for Open Vocabulary E…

200 papers

Deep learning based electroencephalography (EEG) signal processing methods are known to suffer from poor test-time generalization due to the changes in data distribution. This becomes a more challenging problem when privacy-preserving…

Recently, many efforts have been made to explore how the brain processes speech using electroencephalographic (EEG) signals, where deep learning-based approaches were shown to be applicable in this field. In order to decode speech signals…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-24 Qiushi Zhu , Xiaoying Zhao , Jie Zhang , Yu Gu , Chao Weng , Yuchen Hu

Patient representation learning refers to learning a dense mathematical representation of a patient that encodes meaningful information from Electronic Health Records (EHRs). This is generally performed using advanced deep learning methods.…

Machine Learning · Computer Science 2021-01-26 Yuqi Si , Jingcheng Du , Zhao Li , Xiaoqian Jiang , Timothy Miller , Fei Wang , W. Jim Zheng , Kirk Roberts

Despite extensive standardization, diagnostic interviews for mental health disorders encompass substantial subjective judgment. Previous studies have demonstrated that EEG-based neural measures can function as reliable objective correlates…

Machine Learning · Computer Science 2020-11-19 Garrett Honke , Irina Higgins , Nina Thigpen , Vladimir Miskovic , Katie Link , Sunny Duan , Pramod Gupta , Julia Klawohn , Greg Hajcak

In this study, we introduce an innovative EEG signal reconstruction sub-module designed to enhance the performance of deep learning models on EEG eye-tracking tasks. This sub-module can integrate with all Encoder-Classifier-based deep…

Human-Computer Interaction · Computer Science 2024-08-13 Weigeng Li , Neng Zhou , Xiaodong Qu

We create a reusable Transformer, BrainBERT, for intracranial recordings bringing modern representation learning approaches to neuroscience. Much like in NLP and speech recognition, this Transformer enables classifying complex concepts,…

Machine Learning · Computer Science 2023-03-01 Christopher Wang , Vighnesh Subramaniam , Adam Uri Yaari , Gabriel Kreiman , Boris Katz , Ignacio Cases , Andrei Barbu

Classifying Electroencephalogram(EEG) signals helps in understanding Brain-Computer Interface (BCI). EEG signals are vital in studying how the human mind functions. In this paper, we have used an Arithmetic Calculation dataset consisting of…

Neurons and Cognition · Quantitative Biology 2022-09-02 Umang Goenka , Param Patil , Kush Gosalia , Aaryan Jagetia

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Deep learning techniques have revolutionized the field of machine learning and were recently successfully applied to various classification problems in noninvasive electroencephalography (EEG). However, these methods were so far only rarely…

An electroencephalography (EEG) based Brain Computer Interface (BCI) enables people to communicate with the outside world by interpreting the EEG signals of their brains to interact with devices such as wheelchairs and intelligent robots.…

Human-Computer Interaction · Computer Science 2017-09-27 Xiang Zhang , Lina Yao , Quan Z. Sheng , Salil S. Kanhere , Tao Gu , Dalin Zhang

This paper introduces a novel algorithm designed for speech synthesis from neural activity recordings obtained using invasive electroencephalography (EEG) techniques. The proposed system offers a promising communication solution for…

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi

Advances in the motor imagery (MI)-based brain-computer interfaces (BCIs) allow control of several applications by decoding neurophysiological phenomena, which are usually recorded by electroencephalography (EEG) using a non-invasive…

The attention-based encoder-decoder modeling paradigm has achieved promising results on a variety of speech processing tasks like automatic speech recognition (ASR), text-to-speech (TTS) and among others. This paradigm takes advantage of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-23 Shi-Yan Weng , Berlin Chen

High-resolution neural datasets enable foundation models for the next generation of brain-computer interfaces and neurological treatments. The community requires rigorous benchmarks to discriminate between competing modeling approaches, yet…

The current electroencephalogram (EEG) based deep learning models are typically designed for specific datasets and applications in brain-computer interaction (BCI), limiting the scale of the models and thus diminishing their perceptual…

Machine Learning · Computer Science 2024-06-06 Wei-Bang Jiang , Li-Ming Zhao , Bao-Liang Lu

Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standard metrics. This remains a barrier to building a…

Machine Learning · Computer Science 2025-05-20 Dulhan Jayalath , Gilad Landau , Oiwi Parker Jones

This paper explores silent speech decoding in active brain-computer interface (BCI) systems, which offer more natural and flexible communication than traditional BCI applications. We collected a new silent speech dataset of over 120 hours…

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

Deep learning based neural decoding from stereotactic electroencephalography (sEEG) would likely benefit from scaling up both dataset and model size. To achieve this, combining data across multiple subjects is crucial. However, in sEEG…