English
Related papers

Related papers: Decoding multimodal behavior using time difference…

200 papers

A central goal in many brain studies is the identification of those brain regions that are activated during an observation window that may correspond to a motor task, a stimulus, or simply a resting state. While functional MRI is currently…

Numerical Analysis · Mathematics 2025-10-23 Daniela Calvetti , Erkki Somersalo

Real-time decoding of target variables from multiple simultaneously recorded neural time-series modalities, such as discrete spiking activity and continuous field potentials, is important across various neuroscience applications. However, a…

Machine Learning · Computer Science 2025-12-16 Eray Erturk , Maryam M. Shanechi

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language…

Computation and Language · Computer Science 2021-08-11 Nora Hollenstein , Cedric Renggli , Benjamin Glaus , Maria Barrett , Marius Troendle , Nicolas Langer , Ce Zhang

High temporal resolution measurements of human brain activity can be performed by recording the electric potentials on the scalp surface (electroencephalography, EEG), or by recording the magnetic fields near the surface of the head…

Data Analysis, Statistics and Probability · Physics 2015-01-22 Kevin H. Knuth

Despite participants engaging in unimodal stimuli, such as watching images or silent videos, recent work has demonstrated that multi-modal Transformer models can predict visual brain activity impressively well, even with incongruent…

Neurons and Cognition · Quantitative Biology 2025-05-27 Subba Reddy Oota , Khushbu Pahwa , Mounika Marreddy , Maneesh Singh , Manish Gupta , Bapi S. Raju

Understanding the neural mechanisms behind auditory and linguistic processing is key to advancing cognitive neuroscience. In this study, we use Magnetoencephalography (MEG) data to analyze brain responses to spoken language stimuli. We…

Neurons and Cognition · Quantitative Biology 2025-01-08 Matteo Ciferri , Matteo Ferrante , Nicola Toschi

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

Encoding and decoding models are widely used in systems, cognitive, and computational neuroscience to make sense of brain-activity data. However, the interpretation of their results requires care. Decoding models can help reveal whether…

Neurons and Cognition · Quantitative Biology 2019-04-29 Nikolaus Kriegeskorte , Pamela K. Douglas

EEG signals in emotion recognition absorb special attention owing to their high temporal resolution and their information about what happens in the brain. Different regions of brain work together to process information and meanwhile the…

Signal Processing · Electrical Eng. & Systems 2021-12-24 Ensieh Khazaei , Hoda Mohammadzade

Motor imagery (MI) is a well-documented technique used by subjects in BCI (Brain Computer Interface) experiments to modulate brain activity within the motor cortex and surrounding areas of the brain. In our term project, we conducted an…

Human-Computer Interaction · Computer Science 2023-06-14 Giovanni Jana , Corey Karnei , Shuvam Keshari

As a person learns a new skill, distinct synapses, brain regions, and circuits are engaged and change over time. In this paper, we develop methods to examine patterns of correlated activity across a large set of brain regions. Our goal is…

Neurons and Cognition · Quantitative Biology 2013-10-31 Danielle S. Bassett , Nicholas F. Wymbs , M. Puck Rombach , Mason A. Porter , Peter J. Mucha , Scott T. Grafton

In daily life, we encounter diverse external stimuli, such as images, sounds, and videos. As research in multimodal stimuli and neuroscience advances, fMRI-based brain decoding has become a key tool for understanding brain perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pengyu Liu , Guohua Dong , Dan Guo , Kun Li , Fengling Li , Xun Yang , Meng Wang , Xiaomin Ying

In this study we present a kernel based convolution model to characterize neural responses to natural sounds by decoding their time-varying acoustic features. The model allows to decode natural sounds from high-dimensional neural…

Machine Learning · Statistics 2016-11-15 Ali Faisal , Anni Nora , Jaeho Seol , Hanna Renvall , Riitta Salmelin

The brain is a system operating on multiple time scales, and characterisation of dynamics across time scales remains a challenge. One framework to study such dynamics is that of fractal geometry. However, currently there exists no…

Neurons and Cognition · Quantitative Biology 2018-12-12 Lucas G. S. França , José G. V. Miranda , Marco Leite , Niraj K. Sharma , Matthew C. Walker , Louis Lemieux , Yujiang Wang

The time-dependent fields obtained by solving partial differential equations in two and more dimensions quickly overwhelm the analytical capabilities of the human brain. A meaningful insight into the temporal behaviour can be obtained by…

Numerical Analysis · Mathematics 2024-04-04 Miha Rot , Martin Horvat , Gregor Kosec

Frequency discrimination is a fundamental task of the auditory system. The mammalian inner ear, or cochlea, provides a place code in which different frequencies are detected at different spatial locations. However, a temporal code based on…

Neurons and Cognition · Quantitative Biology 2015-06-05 Tobias Reichenbach , A. J. Hudspeth

Predicting and executing a sequence of actions without intermediate replanning, known as action chunking, is increasingly used in robot learning from human demonstrations. Yet, its effects on the learned policy remain inconsistent: some…

Robotics · Computer Science 2025-04-28 Yuejiang Liu , Jubayer Ibn Hamid , Annie Xie , Yoonho Lee , Maximilian Du , Chelsea Finn

Decoding emotional states from human brain activity plays an important role in brain-computer interfaces. Existing emotion decoding methods still have two main limitations: one is only decoding a single emotion category from a brain…

Signal Processing · Electrical Eng. & Systems 2022-11-07 Kaicheng Fu , Changde Du , Shengpei Wang , Huiguang He

The neuromagnetic activity (magnetoencephalogram, MEG) from healthy human brain and from an epileptic patient against chromatic flickering stimuli has been earlier analyzed on the basis of a memory functions formalism (MFF). Information…

Medical Physics · Physics 2010-06-29 O. Yu. Panischev , S. A. Demin , J. Bhattacharya

MEG/EEG are non-invasive imaging techniques that record brain activity with high temporal resolution. However, estimation of brain source currents from surface recordings requires solving an ill-posed inverse problem. Converging lines of…