English
Related papers

Related papers: Brain decoding from functional MRI using long shor…

200 papers

Convolutional neural networks (CNNs) have shown promising results on several segmentation tasks in magnetic resonance (MR) images. However, the accuracy of CNNs may degrade severely when segmenting images acquired with different scanners…

Machine Learning · Statistics 2018-05-28 Neerav Karani , Krishna Chaitanya , Christian Baumgartner , Ender Konukoglu

Brain function relies on a precisely coordinated and dynamic balance between the functional integration and segregation of distinct neural systems. Characterizing the way in which neural systems reconfigure their interactions to give rise…

Neurons and Cognition · Quantitative Biology 2021-01-28 Lingbin Bian , Tiangang Cui , B. T. Thomas Yeo , Alex Fornito , Adeel Razi , Jonathan Keith

We propose NEURONA, a neuro-symbolic framework for fMRI decoding and concept grounding in neural activity. Leveraging image- and video-based fMRI question-answering datasets, NEURONA learns to decode interacting concepts from visual stimuli…

Neurons and Cognition · Quantitative Biology 2026-03-05 Yanchen Wang , Joy Hsu , Ehsan Adeli , Jiajun Wu

We demonstrate a network visualization technique to analyze the recurrent state inside the LSTMs/GRUs used commonly in language and acoustic models. Interpreting intermediate state and network activations inside end-to-end models remains an…

Computation and Language · Computer Science 2018-02-13 Skanda Koppula , Khe Chai Sim , Kean Chin

Multivariate pattern analysis (MVPA) or brain decoding methods have become standard practice in analysing fMRI data. Although decoding methods have been extensively applied in Brain Computing Interfaces (BCI), these methods have only…

Neurons and Cognition · Quantitative Biology 2021-02-22 Tijl Grootswagers , Susan G. Wardle , Thomas A. Carlson

Aiming to reconstruct visual stimuli from brain signals, brain decoding has recently made significant progress using functional magnetic resonance imaging (fMRI). However, it still has challenging issues such as substantial individual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Shuai Jiang , Zhu Meng , Haiwen Li , Delong Liu , Fei Su , Zhicheng Zhao

Accurate fMRI analysis requires sensitivity to temporal structure across multiple scales, as BOLD signals encode cognitive processes that emerge from fast transient dynamics to slower, large-scale fluctuations. Existing deep learning (DL)…

Signal Processing · Electrical Eng. & Systems 2026-01-06 Furkan Genç , Boran İsmet Macun , Sait Sarper Özaslan , Emine U. Saritas , Tolga Çukur

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Image captioning is a research hotspot where encoder-decoder models combining convolutional neural network (CNN) and long short-term memory (LSTM) achieve promising results. Despite significant progress, these models generate sentences…

Computer Vision and Pattern Recognition · Computer Science 2019-10-16 Hongwei Ge , Zehang Yan , Kai Zhang , Mingde Zhao , Liang Sun

Functional Magnetic Resonance Image (fMRI) is commonly employed to study human brain activity, since it offers insight into the relationship between functional fluctuations and human behavior. To enhance analysis and comprehension of brain…

Artificial Intelligence · Computer Science 2025-02-04 Song Wang , Zhenyu Lei , Zhen Tan , Jiaqi Ding , Xinyu Zhao , Yushun Dong , Guorong Wu , Tianlong Chen , Chen Chen , Aiying Zhang , Jundong Li

Reconstructing visual stimuli from human brain activities provides a promising opportunity to advance our understanding of the brain's visual system and its connection with computer vision models. Although deep generative models have been…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jingyuan Sun , Mingxiao Li , Marie-Francine Moens

In cognitive decoding, researchers aim to characterize a brain region's representations by identifying the cognitive states (e.g., accepting/rejecting a gamble) that can be identified from the region's activity. Deep learning (DL) methods…

Machine Learning · Computer Science 2021-08-17 Armin W. Thomas , Christopher Ré , Russell A. Poldrack

Many recent studies have shown that the perception of speech can be decoded from brain signals and subsequently reconstructed as continuous language. However, there is a lack of neurological basis for how the semantic information embedded…

Computation and Language · Computer Science 2026-04-14 Congchi Yin , Ziyi Ye , Piji Li

Motion artifacts caused by prolonged acquisition time are a significant challenge in Magnetic Resonance Imaging (MRI), hindering accurate tissue segmentation. These artifacts appear as blurred images that mimic tissue-like appearances,…

Image and Video Processing · Electrical Eng. & Systems 2024-12-06 Sunyoung Jung , Yoonseok Choi , Mohammed A. Al-masni , Minyoung Jung , Dong-Hyun Kim

Global brain activity self-organizes into discrete patterns characterized by distinct behavioral observables and modes of information processing. The human thalamocortical system is a densely connected network where local neural activation…

Delineating how animal behavior arises from neural activity is a foundational goal of neuroscience. However, as the computations underlying behavior unfold in networks of thousands of individual neurons across the entire brain, this…

Neurons and Cognition · Quantitative Biology 2025-07-04 Jacob J. Morra , Kaitlyn E. Fouke , Kexin Hang , Zichen He , Owen Traubert , Timothy W. Dunn , Eva A. Naumann

Nowadays, neural network models achieve state-of-the-art results in many areas as computer vision or speech processing. For sequential data, especially for Natural Language Processing (NLP) tasks, Recurrent Neural Networks (RNNs) and their…

Computation and Language · Computer Science 2021-02-23 Elie Azeraf , Emmanuel Monfrini , Emmanuel Vignon , Wojciech Pieczynski

The application of deep learning (DL) models to the decoding of cognitive states from whole-brain functional Magnetic Resonance Imaging (fMRI) data is often hindered by the small sample size and high dimensionality of these datasets.…

Image and Video Processing · Electrical Eng. & Systems 2019-07-04 Armin W. Thomas , Klaus-Robert Müller , Wojciech Samek

Functional magnetic resonance imaging (fMRI) is one of the most popular methods for studying the human brain. Task-related fMRI data processing aims to determine which brain areas are activated when a specific task is performed and is…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Paris A. Karakasis , Athanasios P. Liavas , Nicholas D. Sidiropoulos , Panagiotis G. Simos , Efrosini Papadaki

Brain decoding, a pivotal field in neuroscience, aims to reconstruct stimuli from acquired brain signals, primarily utilizing functional magnetic resonance imaging (fMRI). Currently, brain decoding is confined to a per-subject-per-model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Shizun Wang , Songhua Liu , Zhenxiong Tan , Xinchao Wang