English
Related papers

Related papers: Deep Neural Encoder-Decoder Model to Relate fMRI B…

200 papers

In recent years,the application of deep learning in task functional Magnetic Resonance Imaging (tfMRI) decoding has led to significant advancements. However,most studies remain constrained by assumption of temporal stationarity in neural…

Machine Learning · Computer Science 2025-03-05 Yueyang Wu , Sinan Yang , Yanming Wang , Jiajie He , Muhammad Mohsin Pathan , Bensheng Qiu , Xiaoxiao Wang

Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of language stimuli, recent studies have shown that it is possible to…

Computation and Language · Computer Science 2020-11-12 Nicolas Affolter , Beni Egressy , Damian Pascual , Roger Wattenhofer

Investigating the mapping between visual stimuli and neural responses in the visual cortex contributes to a deeper understanding of biological visual processing mechanisms. Most existing studies characterize this mapping by training models…

Computational Engineering, Finance, and Science · Computer Science 2025-12-01 Xing Gao , Dazhong Rong , Qinming He

With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zarina Rakhimberdina , Quentin Jodelet , Xin Liu , Tsuyoshi Murata

Reconstructing visual stimulus images is a significant task in neural decoding, and up to now, most studies consider the functional magnetic resonance imaging (fMRI) as the signal source. However, the fMRI-based image reconstruction methods…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Hongguang Pan , Zhuoyi Li , Yunpeng Fu , Xuebin Qin , Jianchen Hu

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ruizhe Zheng , Lichao Sun

We represent the sequence of fMRI (Functional Magnetic Resonance Imaging) brain volumes recorded during a cognitive stimulus by a graph which consists of a set of local meshes. The corresponding cognitive process, encoded in the brain, is…

Machine Learning · Computer Science 2016-03-04 Itir Onal , Mete Ozay , Eda Mizrak , Ilke Oztekin , Fatos T. Yarman Vural

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Maxime Tchibozo , Donggeun Kim , Zijing Wang , Xiaofu He

The comparison of observed brain activity with the statistics generated by artificial intelligence systems is useful to probe brain functional organization under ecological conditions. Here we study fMRI activity in ten subjects watching…

Neural and Evolutionary Computing · Computer Science 2018-09-10 Hugo Richard , Ana Pinho , Bertrand Thirion , Guillaume Charpiat

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney

Recently, visual encoding based on functional magnetic resonance imaging (fMRI) have realized many achievements with the rapid development of deep network computation. Visual encoding model is aimed at predicting brain activity in response…

Neurons and Cognition · Quantitative Biology 2019-07-30 Kai Qiao , Chi Zhang , Jian Chen , Linyuan Wang , Li Tong , Bin Yan

The purpose of this work is to investigate the soundness and utility of a neural network-based approach as a framework for exploring the impact of image enhancement techniques on visual cortex activation. In a preliminary study, we prepare…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Valentyn Piskovskyi , Riccardo Chimisso , Sabrina Patania , Tom Foulsham , Giuseppe Vizzari , Dimitri Ognibene

Functional magnetic resonance imaging (fMRI) aims to locate activated regions in human brains when specific tasks are performed. The conventional tool for analyzing fMRI data applies some variant of the linear model, which is restrictive in…

Statistics Theory · Mathematics 2008-08-08 Chunming Zhang , Tao Yu

Understanding functional representations within higher visual cortex is a fundamental question in computational neuroscience. While artificial neural networks pretrained on large-scale datasets exhibit striking representational alignment…

The human visual system is capable of processing continuous streams of visual information, but how the brain encodes and retrieves recent visual memories during continuous visual processing remains unexplored. This study investigates the…

Computation and Language · Computer Science 2024-10-01 Runze Xia , Congchi Yin , Piji Li

In this work, we explore the decoding of mental imagery from subjects using their fMRI measurements. In order to achieve this decoding, we first created a mapping between a subject's fMRI signals elicited by the videos the subjects watched.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Arman Afrasiyabi , Erica Busch , Rahul Singh , Dhananjay Bhaskar , Laurent Caplette , Nicholas Turk-Browne , Smita Krishnaswamy

Capturing dynamic spatiotemporal neural activity is essential for understanding large-scale brain mechanisms. Functional magnetic resonance imaging (fMRI) provides high-resolution cortical representations that form a strong basis for…

Image and Video Processing · Electrical Eng. & Systems 2026-04-01 Wanying Qu , Jianxiong Gao , Wei Wang , Yanwei Fu

The Algonauts 2025 Challenge called on the community to develop encoding models that predict whole-brain fMRI responses to naturalistic multimodal movies. In this submission, we propose a sequence-to-sequence Transformer that…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Qianyi He , Yuan Chang Leong

A standard approach in functional neuroimaging explores how a particular cognitive task activates a set of brain regions (one task-to-many regions mapping). Importantly though, the same neural system can be activated by inherently different…

Neurons and Cognition · Quantitative Biology 2016-03-23 Romy Lorenz , Ricardo Pio Monti , Ines R. Violante , Christoforos Anagnostopoulos , Aldo A. Faisal , Giovanni Montana , Robert Leech

Neural coding is one of the central questions in systems neuroscience for understanding how the brain processes stimulus from the environment, moreover, it is also a cornerstone for designing algorithms of brain-machine interface, where…

Neurons and Cognition · Quantitative Biology 2020-01-29 Yichen Zhang , Shanshan Jia , Yajing Zheng , Zhaofei Yu , Yonghong Tian , Siwei Ma , Tiejun Huang , Jian K. Liu