English
Related papers

Related papers: Bridging Brain Signals and Language: A Deep Learni…

200 papers

Decoding brain imaging data are gaining popularity, with applications in brain-computer interfaces and the study of neural representations. Decoding is typicallysubject-specific and does not generalise well over subjects, due to high…

Machine Learning · Computer Science 2024-01-22 Richard Csaky , Mats Van Es , Oiwi Parker Jones , Mark Woolrich

Decoding visual representations from human brain activity has emerged as a thriving research domain, particularly in the context of brain-computer interfaces. Our study presents an innovative method that employs to classify and reconstruct…

Signal Processing · Electrical Eng. & Systems 2023-09-15 Matteo Ferrante , Tommaso Boccato , Stefano Bargione , Nicola Toschi

Robotic arms are increasingly being used in collaborative environments, requiring an accurate understanding of human intentions to ensure both effectiveness and safety. Electroencephalogram (EEG) signals, which measure brain activity,…

Signal Processing · Electrical Eng. & Systems 2024-11-20 Byeong-Hoo Lee , Kang Yin

Recent breakthroughs in deep learning often rely on representation learning and knowledge transfer. In recent years, unsupervised and self-supervised techniques for learning speech representation were developed to foster automatic speech…

Computation and Language · Computer Science 2021-12-15 Pierre Beckmann , Mikolaj Kegler , Milos Cernak

As deep learning has achieved state-of-the-art performance for many tasks of EEG-based BCI, many efforts have been made in recent years trying to understand what have been learned by the models. This is commonly done by generating a heatmap…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Jian Cui , Liqiang Yuan , Zhaoxiang Wang , Ruilin Li , Tianzi Jiang

The past few years have seen remarkable progress in the decoding of speech from brain activity, primarily driven by large single-subject datasets. However, due to individual variation, such as anatomy, and differences in task design and…

Machine Learning · Computer Science 2025-06-03 Dulhan Jayalath , Gilad Landau , Brendan Shillingford , Mark Woolrich , Oiwi Parker Jones

Machine learning can extract information from neural recordings, e.g., surface EEG, ECoG and {\mu}ECoG, and therefore plays an important role in many research and clinical applications. Deep learning with artificial neural networks has…

While capable of segregating visual data, humans take time to examine a single piece, let alone thousands or millions of samples. The deep learning models efficiently process sizeable information with the help of modern-day computing.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Alankrit Mishra , Nikhil Raj , Garima Bajwa

Dysarthria impairs motor control of speech, often resulting in reduced intelligibility and frequent misarticulations. Although interest in brain-computer interface technologies is growing, electroencephalogram (EEG)-based communication…

Artificial Intelligence · Computer Science 2025-12-15 Ha-Na Jo , Jung-Sun Lee , Eunyeong Ko

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Human emotions are difficult to convey through words and are often abstracted in the process; however, electroencephalogram (EEG) signals can offer a more direct lens into emotional brain activity. Recent studies show that deep learning…

Neurons and Cognition · Quantitative Biology 2025-11-19 Nilay Kumar , Priyansh Bhandari , G. Maragatham

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Brain interfaces are cyber-physical systems that aim to harvest information from the (physical) brain through sensing mechanisms, extract information about the underlying processes, and decide/actuate accordingly. Nonetheless, the brain…

Neurons and Cognition · Quantitative Biology 2018-03-29 Gaurav Gupta , Sergio Pequito , Paul Bogdan

Brain computer interface (BCI) has been popular as a key approach to monitor our brains recent year. Mental states monitoring is one of the most important BCI applications and becomes increasingly accessible. However, the mental state…

Signal Processing · Electrical Eng. & Systems 2019-11-14 Dongdong Zhang , Dong Cao , Haibo Chen

Reading comprehension is a complex cognitive process involving many human brain activities. Plenty of works have studied the patterns and attention allocations of reading comprehension in information retrieval related scenarios. However,…

Information Retrieval · Computer Science 2022-08-18 Ziyi Ye , Xiaohui Xie , Yiqun Liu , Zhihong Wang , Xuesong Chen , Min Zhang , Shaoping Ma

Previous initial research has already been carried out to propose speech-based BCI using brain signals (e.g. non-invasive EEG and invasive sEEG / ECoG), but there is a lack of combined methods that investigate non-invasive brain,…

Medical Physics · Physics 2023-10-19 Tamás Gábor Csapó , Frigyes Viktor Arthur , Péter Nagy , Ádám Boncz

Despite major advances in surgical brain-to-text (B2T), i.e. transcribing speech from invasive brain recordings, non-invasive alternatives have yet to surpass even chance on standard metrics. This remains a barrier to building a…

Machine Learning · Computer Science 2025-05-20 Dulhan Jayalath , Gilad Landau , Oiwi Parker Jones

Brain decoding is a data analysis paradigm for neuroimaging experiments that is based on predicting the stimulus presented to the subject from the concurrent brain activity. In order to make inference at the group level, a straightforward…

Machine Learning · Statistics 2014-04-17 Emanuele Olivetti , Seyed Mostafa Kia , Paolo Avesani

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of language stimuli, recent studies have shown that it is possible to…

Computation and Language · Computer Science 2020-11-12 Nicolas Affolter , Beni Egressy , Damian Pascual , Roger Wattenhofer