English
Related papers

Related papers: Encoding and decoding V1 fMRI responses to natural…

200 papers

Despite participants engaging in unimodal stimuli, such as watching images or silent videos, recent work has demonstrated that multi-modal Transformer models can predict visual brain activity impressively well, even with incongruent…

Neurons and Cognition · Quantitative Biology 2025-05-27 Subba Reddy Oota , Khushbu Pahwa , Mounika Marreddy , Maneesh Singh , Manish Gupta , Bapi S. Raju

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language models (cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mitja Nikolaus , Milad Mozafari , Nicholas Asher , Leila Reddy , Rufin VanRullen

fMRI semantic category understanding using linguistic encoding models attempt to learn a forward mapping that relates stimuli to the corresponding brain activation. Classical encoding models use linear multi-variate methods to predict the…

Machine Learning · Computer Science 2018-12-04 Subba Reddy Oota , Adithya Avvaru , Naresh Manwani , Raju S. Bapi

Non-invasive methods to measure brain activity are important to understand cognitive processes in the human brain. A prominent example is functional magnetic resonance imaging (fMRI), which is a noisy measurement of a delayed signal that…

Neurons and Cognition · Quantitative Biology 2020-08-17 Hans-Christian Ruiz-Euler , Jose R. Ferreira Marques , Hilbert J. Kappen

Similar to how differences in the proficiency of the cardiovascular and musculoskeletal system predict an individual's athletic ability, differences in how the same brain region encodes information across individuals may explain their…

Neurons and Cognition · Quantitative Biology 2021-12-14 Jennifer Williams , Leila Wehbe

Despite significant strides in visual quality assessment, the neural mechanisms underlying visual quality perception remain insufficiently explored. This study employed fMRI to examine brain activity during image quality assessment and…

Multimedia · Computer Science 2024-04-30 Yiming Zhang , Ying Hu , Xiongkuo Min , Yan Zhou , Guangtao Zhai

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

Functional Magnetic Resonance Images acquired during resting-state provide information about the functional organization of the brain through measuring correlations between brain areas. Independent components analysis is the reference…

Neurons and Cognition · Quantitative Biology 2014-12-15 Alexandre Abraham , Elvis Dohmatob , Bertrand Thirion , Dimitris Samaras , Gael Varoquaux

Reconstructing visual stimuli from human brain activity (e.g., fMRI) bridges neuroscience and computer vision by decoding neural representations. However, existing methods often overlook critical brain structure-function relationships,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Sijin Yu , Zijiao Chen , Wenxuan Wu , Shengxian Chen , Zhongliang Liu , Jingxin Nie , Xiaofen Xing , Xiangmin Xu , Xin Zhang

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first created a mapping between a subject's fMRI signals elicited by the videos the subjects watched.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Arman Afrasiyabi , Erica Busch , Rahul Singh , Dhananjay Bhaskar , Laurent Caplette , Nicholas Turk-Browne , Smita Krishnaswamy

Graphical models have been used extensively for modeling brain connectivity networks. However, unmeasured confounders and correlations among measurements are often overlooked during model fitting, which may lead to spurious scientific…

Methodology · Statistics 2020-12-10 Yanxin Jin , Yang Ning , Kean Ming Tan

Current non-invasive neuroimaging techniques trade off between spatial resolution and temporal resolution. While magnetoencephalography (MEG) can capture rapid neural dynamics and functional magnetic resonance imaging (fMRI) can spatially…

Neurons and Cognition · Quantitative Biology 2025-10-13 Beige Jerry Jin , Leila Wehbe

Functional neuroimaging can measure the brain?s response to an external stimulus. It is used to perform brain mapping: identifying from these observations the brain regions involved. This problem can be cast into a linear supervised…

Machine Learning · Computer Science 2012-07-03 Gael Varoquaux , Alexandre Gramfort , Bertrand Thirion

The release of large datasets and developments in AI have led to dramatic improvements in decoding methods that reconstruct seen images from human brain activity. We evaluate the prospect of further improving recent decoding methods by…

Neurons and Cognition · Quantitative Biology 2023-12-14 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Functional Magnetic Resonance Imaging (fMRI) maps cerebral activation in response to stimuli but this activation is often difficult to detect, especially in low-signal contexts and single-subject studies. Accurate activation detection can…

Applications · Statistics 2023-10-26 Wei-Chen Chen , Ranjan Maitra

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Brain decoding that classifies cognitive states using the functional fluctuations of the brain can provide insightful information for understanding the brain mechanisms of cognitive functions. Among the common procedures of decoding the…

Human-Computer Interaction · Computer Science 2024-07-12 Jianfei Zhu , Baichun Wei , Jiaru Tian , Feng Jiang , Chunzhi Yi