English
Related papers

Related papers: Robust Evaluation of Neural Encoding Models via gr…

200 papers

Neuroscientists and computer vision researchers use model-brain alignment benchmarks to compare artificial and biological vision systems. These benchmarks rank models according to alignment measures such as the similarity of…

Neurons and Cognition · Quantitative Biology 2026-04-24 Larissa Höfling , Matthias Tangemann , Lotta Piefke , Susanne Keller , Katrin Franke , Matthias Bethge

We describe a method for the neural decoding of memory from EEG data. Using this method, a concept being recalled can be identified from an EEG trace with an average top-1 accuracy of about 78.4% (chance 4%). The method employs deep…

Machine Learning · Computer Science 2023-08-08 Glenn Bruns , Michael Haidar , Federico Rubino

Predictive coding is an influential theory of cortical function which posits that the principal computation the brain performs, which underlies both perception and learning, is the minimization of prediction errors. While motivated by…

Neurons and Cognition · Quantitative Biology 2020-10-13 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher L Buckley

To handle the scarcity and heterogeneity of electroencephalography (EEG) data for Brain-Computer Interface (BCI) tasks, and to harness the power of large publicly available data sets, we propose Neuro-GPT, a foundation model consisting of…

Machine Learning · Computer Science 2024-03-05 Wenhui Cui , Woojae Jeong , Philipp Thölke , Takfarinas Medani , Karim Jerbi , Anand A. Joshi , Richard M. Leahy

Deep predictive coding networks are neuroscience-inspired unsupervised learning models that learn to predict future sensory states. We build upon the PredNet implementation by Lotter, Kreiman, and Cox (2016) to investigate if predictive…

Neurons and Cognition · Quantitative Biology 2019-07-02 Marcio Fonseca

Expectations can substantially influence perception. Predictive coding is a theory of sensory processing that aims to explain the neural mechanisms underlying the effect of expectations in sensory processing. Its main assumption is that…

Neurons and Cognition · Quantitative Biology 2022-11-24 Jasmin Stein , Katharina von Kriegstein , Alejandro Tabas

Evaluating foundation models under appropriate adaptation settings is essential for understanding the quality and transferability of the learned representations. Recent EEG foundation models have demonstrated promising transfer capabilities…

Machine Learning · Computer Science 2026-05-28 Aditya Kommineni , Emily Zhou , Kleanthis Avramidis , Tiantian Feng , Shrikanth Narayanan

Semantic embeddings play a crucial role in natural language-based information retrieval. Embedding models represent words and contexts as vectors whose spatial configuration is derived from the distribution of words in large text corpora.…

Computation and Language · Computer Science 2024-01-09 Silvan David Peter , Shreyan Chowdhury , Carlos Eduardo Cancino-Chacón , Gerhard Widmer

EEG-based analysis of pain perception, enhanced by machine learning, reveals how the brain encodes pain by identifying neural patterns evoked by noxious stimulation. However, a major challenge that remains is the generalization of machine…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Mathis Rezzouk , Fabrice Gagnon , Alyson Champagne , Mathieu Roy , Philippe Albouy , Michel-Pierre Coll , Cem Subakan

We explore whether neural networks can decode brain activity into speech by mapping EEG recordings to audio representations. Using EEG data recorded as subjects listened to natural speech, we train a model with a contrastive CLIP loss to…

Sound · Computer Science 2025-11-10 Quentin Auster , Kateryna Shapovalenko , Chuang Ma , Demaio Sun

This thesis delves into the world of non-invasive electrophysiological brain signals like electroencephalography (EEG) and magnetoencephalography (MEG), focusing on modelling and decoding such data. The research aims to investigate what…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Richard Csaky

Electroencephalography (EEG) recordings of brain activity taken while participants read or listen to language are widely used within the cognitive neuroscience and psycholinguistics communities as a tool to study language comprehension.…

Computation and Language · Computer Science 2019-11-05 Dan Schwartz , Tom Mitchell

In many high-impact applications, it is important to ensure the quality of output of a machine learning algorithm as well as its reliability in comparison with the complexity of the algorithm used. In this paper, we have initiated a…

Machine Learning · Computer Science 2023-03-03 Katarina Doctor , Tong Mao , Hrushikesh Mhaskar

Understanding the neural basis of language comprehension in the brain has been a long-standing goal of various scientific research programs. Recent advances in language modelling and in neuroimaging methodology promise potential…

Computation and Language · Computer Science 2022-03-11 Mostafa Abdou

This study examines the efficacy of various neural network (NN) models in interpreting mental constructs via electroencephalogram (EEG) signals. Through the assessment of 16 prevalent NN models and their variants across four brain-computer…

Neurons and Cognition · Quantitative Biology 2023-09-26 Xia Chen , Xiangbin Teng , Han Chen , Yafeng Pan , Philipp Geyer

The normalization of brain recordings from multiple subjects responding to the natural stimuli is one of the key challenges in auditory neuroscience. The objective of this normalization is to transform the brain data in such a way as to…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-12 Jaswanth Reddy Katthi , Sriram Ganapathy

During speech perception, a listener's electroencephalogram (EEG) reflects acoustic-level processing as well as higher-level cognitive factors such as speech comprehension and attention. However, decoding speech from EEG recordings is…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Mike Thornton , Danilo Mandic , Tobias Reichenbach

Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a…

Human-Computer Interaction · Computer Science 2024-04-05 Yonghao Song , Bingchuan Liu , Xiang Li , Nanlin Shi , Yijun Wang , Xiaorong Gao

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Encoding models that predict brain response patterns to stimuli are one way to capture this relationship between variability in bottom-up neural systems and individual's behavior or pathological state. However, they generally need a large…

Quantitative Methods · Quantitative Biology 2022-05-17 Zijin Gu , Keith Jamison , Mert Sabuncu , Amy Kuceyeski