English
Related papers

Related papers: Improving visual image reconstruction from human b…

200 papers

Advances in neuroscience and artificial intelligence have enabled preliminary decoding of brain activity. However, despite the progress, the interpretability of neural representations remains limited. A significant challenge arises from the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Hasib Aslam , Muhammad Talal Faiz , Muhammad Imran Malik

Two recent developments have accelerated progress in image reconstruction from human brain activity: large datasets that offer samples of brain activity in response to many thousands of natural scenes, and the open-sourcing of powerful…

Neurons and Cognition · Quantitative Biology 2023-06-02 Reese Kneeland , Jordyn Ojeda , Ghislain St-Yves , Thomas Naselaris

Computed Tomography (CT) is widely used in healthcare for detailed imaging. However, Low-dose CT, despite reducing radiation exposure, often results in images with compromised quality due to increased noise. Traditional methods, including…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Herman Verinaz-Jadan , Su Yan

Reconstructing visual stimuli from measured functional magnetic resonance imaging (fMRI) has been a meaningful and challenging task. Previous studies have successfully achieved reconstructions with structures similar to the original images,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yizhuo Lu , Changde Du , Dianpeng Wang , Huiguang He

Decoding sensory experiences from neural activity to reconstruct human-perceived visual stimuli and semantic content remains a challenge in neuroscience and artificial intelligence. Despite notable progress in current brain decoding models,…

Neurons and Cognition · Quantitative Biology 2025-10-13 Feihan Feng , Jingxin Nie

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

Image denoising and high-level vision tasks are usually handled independently in the conventional practice of computer vision, and their connection is fragile. In this paper, we cope with the two jointly and explore the mutual influence…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Ding Liu , Bihan Wen , Jianbo Jiao , Xianming Liu , Zhangyang Wang , Thomas S. Huang

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

Cognitive brain imaging is accumulating datasets about the neural substrate of many different mental processes. Yet, most studies are based on few subjects and have low statistical power. Analyzing data across studies could bring more…

Machine Learning · Statistics 2021-05-20 Arthur Mensch , Julien Mairal , Bertrand Thirion , Gaël Varoquaux

Decoding the human brain has been a hallmark of neuroscientists and Artificial Intelligence researchers alike. Reconstruction of visual images from brain Electroencephalography (EEG) signals has garnered a lot of interest due to its…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Prajwal Singh , Dwip Dalal , Gautam Vashishtha , Krishna Miyapuram , Shanmuganathan Raman

In the pursuit to understand the intricacies of human brain's visual processing, reconstructing dynamic visual experiences from brain activities emerges as a challenging yet fascinating endeavor. While recent advancements have achieved…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Marie-Francine Moens

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Reconstructing seeing images from fMRI recordings is an absorbing research area in neuroscience and provides a potential brain-reading technology. The challenge lies in that visual encoding in brain is highly complex and not fully revealed.…

Neural and Evolutionary Computing · Computer Science 2021-01-29 Tao Fang , Yu Qi , Gang Pan

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

The study of neurodegenerative diseases relies on the reconstruction and analysis of the brain cortex from magnetic resonance imaging (MRI). Traditional frameworks for this task like FreeSurfer demand lengthy runtimes, while its accelerated…

Image and Video Processing · Electrical Eng. & Systems 2020-10-23 Rodrigo Santa Cruz , Leo Lebrat , Pierrick Bourgeat , Clinton Fookes , Jurgen Fripp , Olivier Salvado

Visual scenes are composed of visual concepts and have the property of combinatorial explosion. An important reason for humans to efficiently learn from diverse visual scenes is the ability of compositional perception, and it is desirable…

Machine Learning · Computer Science 2023-06-16 Jinyang Yuan , Tonglin Chen , Bin Li , Xiangyang Xue

Decoding continuous language from brain activity is a formidable yet promising field of research. It is particularly significant for aiding people with speech disabilities to communicate through brain signals. This field addresses the…

Computation and Language · Computer Science 2024-04-03 Xinpei Zhao , Jingyuan Sun , Shaonan Wang , Jing Ye , Xiaohan Zhang , Chengqing Zong

Reconstructing visual stimulus (image) only from human brain activity measured with functional Magnetic Resonance Imaging (fMRI) is a significant and meaningful task in Human-AI collaboration. However, the inconsistent distribution and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Ziqi Ren , Jie Li , Xuetong Xue , Xin Li , Fan Yang , Zhicheng Jiao , Xinbo Gao

Recent progress in visual brain decoding from fMRI has been enabled by large-scale datasets such as the Natural Scenes Dataset (NSD) and powerful diffusion-based generative models. While current pipelines are primarily optimized for…

Neurons and Cognition · Quantitative Biology 2026-04-20 Fabrizio Spera , Tommaso Boccato , Michal Olak , Sara Cammarota , Matteo Ciferri , Michelangelo Tronti , Nicola Toschi , Matteo Ferrante

While deep learning surpasses human-level performance in narrow and specific vision tasks, it is fragile and over-confident in classification. For example, minor transformations in perspective, illumination, or object deformation in the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Maryam Daniali , Edward Kim