English
Related papers

Related papers: Mind Reader: Reconstructing complex images from br…

200 papers

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

This article presents a novel undersampled magnetic resonance imaging (MRI) technique that leverages the concept of Neural Radiance Field (NeRF). With radial undersampling, the corresponding imaging problem can be reformulated into an image…

Image and Video Processing · Electrical Eng. & Systems 2024-03-05 Tae Jun Jang , Chang Min Hyun

Decoding brain states from functional magnetic resonance imaging (fMRI) data is vital for advancing neuroscience and clinical applications. While traditional machine learning and deep learning approaches have made strides in leveraging the…

Machine Learning · Computer Science 2025-12-10 Danial Jafarzadeh Jazi , Maryam Hajiesmaeili

Visualizing the perceptual content by analyzing human functional magnetic resonance imaging (fMRI) has been an active research area. However, due to its high dimensionality, complex dimensional structure, and small number of samples…

Computer Vision and Pattern Recognition · Computer Science 2019-01-27 Yunfeng Lin , Jiangbei Li , Hanjing Wang

Decoding continuous language from brain activity is a formidable yet promising field of research. It is particularly significant for aiding people with speech disabilities to communicate through brain signals. This field addresses the…

Computation and Language · Computer Science 2024-04-03 Xinpei Zhao , Jingyuan Sun , Shaonan Wang , Jing Ye , Xiaohan Zhang , Chengqing Zong

Decoding language from the human brain remains a grand challenge for Brain-Computer Interfaces (BCIs). Current approaches typically rely on unimodal brain representations, neglecting the brain's inherently multimodal processing. Inspired by…

Computation and Language · Computer Science 2025-08-12 Chunyu Ye , Yunhao Zhang , Jingyuan Sun , Chong Li , Chengqing Zong , Shaonan Wang

While objects from different categories can be reliably decoded from fMRI brain response patterns, it has proved more difficult to distinguish visually similar inputs, such as different instances of the same category. Here, we apply a…

Human-Computer Interaction · Computer Science 2021-02-23 Rufin VanRullen , Leila Reddy

Magnetic resonance imaging (MRI) is known to have reduced signal-to-noise ratios (SNR) at lower field strengths, leading to signal degradation when producing a low-field MRI image from a high-field one. Therefore, reconstructing a…

Image and Video Processing · Electrical Eng. & Systems 2023-05-05 Zhuo-Xu Cui , Congcong Liu , Chentao Cao , Yuanyuan Liu , Jing Cheng , Qingyong Zhu , Yanjie Zhu , Haifeng Wang , Dong Liang

Reconstructing natural videos from fMRI brain recordings is very challenging, for two main reasons: (i) As fMRI data acquisition is difficult, we only have a limited amount of supervised samples, which is not enough to cover the huge space…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Ganit Kupershmidt , Roman Beliy , Guy Gaziv , Michal Irani

Reconstructing dynamic visual experiences as videos from functional magnetic resonance imaging (fMRI) is pivotal for advancing the understanding of neural processes. However, current fMRI-to-video reconstruction methods are hindered by a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yujie Wei , Chenglong Ma , Jianxiong Gao , Chenhui Wang , Shiwei Zhang , Biao Gong , Shuai Tan , Hangjie Yuan , Hongming Shan

Decoding natural visual scenes from brain activity has flourished, with extensive research in single-subject tasks and, however, less in cross-subject tasks. Reconstructing high-quality images in cross-subject tasks is a challenging problem…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zixuan Gong , Qi Zhang , Guangyin Bao , Lei Zhu , Ke Liu , Liang Hu , Duoqian Miao

Enabling effective brain-computer interfaces requires understanding how the human brain encodes stimuli across modalities such as visual, language (or text), etc. Brain encoding aims at constructing fMRI brain activity given a stimulus.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Subba Reddy Oota , Jashn Arora , Vijay Rowtula , Manish Gupta , Raju S. Bapi

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Decoding visual stimuli from neural population activity is crucial for understanding the brain and for applications in brain-machine interfaces. However, such biological data is often scarce, particularly in primates or humans, where…

Machine Learning · Computer Science 2025-10-24 Jan Sobotka , Luca Baroni , Ján Antolík

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

Brain-to-image decoding has been recently propelled by the progress in generative AI models and the availability of large ultra-high field functional Magnetic Resonance Imaging (fMRI). However, current approaches depend on complicated…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Marlène Careil , Yohann Benchetrit , Jean-Rémi King

Reconstructing high-quality magnetic resonance images (MRI) from undersampled raw data is of great interest from both technical and clinical point of views. To this date, however, it is still a mathematically and computationally challenging…

Numerical Analysis · Mathematics 2021-09-01 T. Schmoderer , A. I Aviles-Rivero , V. Corona , N. Debroux , C-B. Schönlieb

Reconstruction of static visual stimuli from non-invasion brain activity fMRI achieves great success, owning to advanced deep learning models such as CLIP and Stable Diffusion. However, the research on fMRI-to-video reconstruction remains…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Zixuan Gong , Guangyin Bao , Qi Zhang , Zhongwei Wan , Duoqian Miao , Shoujin Wang , Lei Zhu , Changwei Wang , Rongtao Xu , Liang Hu , Ke Liu , Yu Zhang

Inferring the functional specificity of brain regions from functional Magnetic Resonance Images (fMRI) data is a challenging statistical problem. While the General Linear Model (GLM) remains the standard approach for brain mapping,…

Machine Learning · Computer Science 2012-07-17 Fabian Pedregosa , Alexandre Gramfort , Gaël Varoquaux , Bertrand Thirion , Christophe Pallier , Elodie Cauvet
‹ Prev 1 3 4 5 6 7 10 Next ›