English
Related papers

Related papers: Mind Reader: Reconstructing complex images from br…

200 papers

Functional Magnetic Resonance Imaging (fMRI) data is a widely used kind of four-dimensional biomedical data, which requires effective compression. However, fMRI compressing poses unique challenges due to its intricate temporal dynamics, low…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Ruoran Li , Runzhao Yang , Wenxin Xiang , Yuxiao Cheng , Tingxiong Xiao , Jinli Suo

We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data. Our method builds on a novel, learned feature-based image representation that disentangles different types of features,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Ruiyang Zhao , Fan Lam

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

We demonstrate the possibility of reconstructing images from fNIRS brain activity and start building a prototype to match the required specs. By training an image reconstruction model on downsampled fMRI data, we discovered that cm-scale…

Analyzing and reconstructing visual stimuli from brain signals effectively advances the understanding of human visual system. However, the EEG signals are complex and contain significant noise. This leads to substantial limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Honghao Fu , Zhiqi Shen , Jing Jih Chin , Hao Wang

LLMs have demonstrated remarkable capabilities in linguistic reasoning and are increasingly adept at vision-language tasks. The integration of image tokens into transformers has enabled direct visual input and output, advancing research…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Jonghun Kim , Sinyoung Ra , Hyunjin Park

The application of deep learning (DL) models to neuroimaging data poses several challenges, due to the high dimensionality, low sample size and complex temporo-spatial dependency structure of these datasets. Even further, DL models act as…

Machine Learning · Computer Science 2019-04-08 Armin W. Thomas , Hauke R. Heekeren , Klaus-Robert Müller , Wojciech Samek

fMRI semantic category understanding using linguistic encoding models attempt to learn a forward mapping that relates stimuli to the corresponding brain activation. Classical encoding models use linear multi-variate methods to predict the…

Machine Learning · Computer Science 2018-12-04 Subba Reddy Oota , Adithya Avvaru , Naresh Manwani , Raju S. Bapi

Stimulus decoding of functional Magnetic Resonance Imaging (fMRI) data with machine learning models has provided new insights about neural representational spaces and task-related dynamics. However, the scarcity of labelled (task-related)…

Neurons and Cognition · Quantitative Biology 2023-05-17 Sean Paulsen , Lloyd May , Michael Casey

Fast and accurate reconstruction of magnetic resonance (MR) images from under-sampled data is important in many clinical applications. In recent years, deep learning-based methods have been shown to produce superior performance on MR image…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Pengfei Guo , Puyang Wang , Jinyuan Zhou , Shanshan Jiang , Vishal M. Patel

Drawing inspiration from the hierarchical processing of the human auditory system, which transforms sound from low-level acoustic features to high-level semantic understanding, we introduce a novel coarse-to-fine audio reconstruction…

Sound · Computer Science 2024-05-30 Che Liu , Changde Du , Xiaoyu Chen , Huiguang He

Machine Learning (ML) is increasingly being used for computer aided diagnosis of brain related disorders based on structural magnetic resonance imaging (MRI) data. Most of such work employs biologically and medically meaningful hand-crafted…

Machine Learning · Computer Science 2018-05-04 Ayush Jaiswal , Dong Guo , Cauligi S. Raghavendra , Paul Thompson

Radio interferometry invariably suffers from an incomplete coverage of the spatial Fourier space, which leads to imaging artifacts. The current state-of-the-art technique is to create an image by Fourier-transforming the incomplete…

Instrumentation and Methods for Astrophysics · Physics 2024-12-19 F. Geyer , K. Schmidt , J. Kummer , M. Brüggen , H. W. Edler , D. Elsässer , F. Griese , A. Poggenpohl , L. Rustige , W. Rhode

Functional Magnetic Resonance Imaging (fMRI) is a powerful non-invasive tool for localizing and analyzing brain activity. This study focuses on one very important aspect of the functional properties of human brain, specifically the…

Artificial Intelligence · Computer Science 2014-10-28 Harris V. Georgiou

Understanding how the human brain represents visual concepts, and in which brain regions these representations are encoded, remains a long-standing challenge. Decades of work have advanced our understanding of visual representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Navve Wasserman , Matias Cosarinsky , Yuval Golbari , Aude Oliva , Antonio Torralba , Tamar Rott Shaham , Michal Irani

Reconstructing visual information from brain activity via computer vision technology provides an intuitive understanding of visual neural mechanisms. Despite progress in decoding fMRI data with generative models, achieving accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shiyi Zhang , Dong Liang , Yihang Zhou

The integration of deep learning and neuroscience has been advancing rapidly, which has led to improvements in the analysis of brain activity and the understanding of deep learning models from a neuroscientific perspective. The…

Neurons and Cognition · Quantitative Biology 2023-06-21 Yu Takagi , Shinji Nishimoto

The study of neurocognitive tasks requiring accurate localisation of activity often rely on functional Magnetic Resonance Imaging, a widely adopted technique that makes use of a pipeline of data processing modules, each involving a variety…

Computer Vision and Pattern Recognition · Computer Science 2016-10-14 Albert Vilamala , Kristoffer Hougaard Madsen , Lars Kai Hansen

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…