English
Related papers

Related papers: Decoding Realistic Images from Brain Activity with…

200 papers

Three decades ago, Atick et al. suggested that human frequency sensitivity may emerge from the enhancement required for a more efficient analysis of retinal images. Here we reassess the relevance of low-level vision tasks in the explanation…

Neurons and Cognition · Quantitative Biology 2022-05-24 Qiang Li , Alex Gomez-Villa , Marcelo Bertalmio , Jesus Malo

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Generative models have been very popular in the recent years for their image generation capabilities. GAN-based models are highly regarded for their disentangled latent space, which is a key feature contributing to their success in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yusuf Dalva , Pinar Yanardag

Denoising diffusion models produce high-fidelity image samples by capturing the image distribution in a progressive manner while initializing with a simple distribution and compounding the distribution complexity. Although these models have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Ayantika Das , Moitreya Chaudhuri , Koushik Bhat , Keerthi Ram , Mihail Bota , Mohanasankar Sivaprakasam

Contrastive Analysis (CA) detects anomalies by contrasting patterns unique to a target group (e.g., unhealthy subjects) from those in a background group (e.g., healthy subjects). In the context of brain MRIs, existing CA approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Cristiano Patrício , Carlo Alberto Barbano , Attilio Fiandrotti , Riccardo Renzulli , Marco Grangetto , Luis F. Teixeira , João C. Neves

Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a…

Machine Learning · Computer Science 2022-08-18 Sikun Lin , Shuyun Tang , Scott Grafton , Ambuj Singh

Using deep neural networks as computational models to simulate cognitive process can provide key insights into human behavioral dynamics. Challenges arise when environments are highly dynamic, obscuring stimulus-behavior relationships.…

Artificial Intelligence · Computer Science 2025-05-28 Songlin Xu , Xinyu Zhang

High Dynamic Range (HDR) imaging aims to reproduce the wide range of brightness levels present in natural scenes, which the human visual system can perceive but conventional digital cameras often fail to capture due to their limited dynamic…

Image and Video Processing · Electrical Eng. & Systems 2025-10-28 Kumbha Nagaswetha

The recently rising markup-to-image generation poses greater challenges as compared to natural image generation, due to its low tolerance for errors as well as the complex sequence and context correlations between markup and rendered image.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Guojin Zhong , Jin Yuan , Pan Wang , Kailun Yang , Weili Guan , Zhiyong Li

The human visual system is an intricate network of brain regions that enables us to recognize the world around us. Despite its abundant lateral and feedback connections, object processing is commonly viewed and studied as a feedforward…

Neurons and Cognition · Quantitative Biology 2019-10-09 Tim C Kietzmann , Courtney J Spoerer , Lynn Sörensen , Radoslaw M Cichy , Olaf Hauk , Nikolaus Kriegeskorte

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

Recent advances in image generation have made diffusion models powerful tools for creating high-quality images. However, their iterative denoising process makes understanding and interpreting their semantic latent spaces more challenging…

Computation and Language · Computer Science 2024-11-06 E. Zhixuan Zeng , Yuhao Chen , Alexander Wong

We develop a framework for rendering photographic images, taking into account display limitations, so as to optimize perceptual similarity between the rendered image and the original scene. We formulate this as a constrained optimization…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Valero Laparra , Alex Berardino , Johannes Ballé , Eero P. Simoncelli

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Faithful image super-resolution (SR) not only needs to recover images that appear realistic, similar to image generation tasks, but also requires that the restored images maintain fidelity and structural consistency with the input. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Junyang Chen , Jinshan Pan , Jiangxin Dong

Early infancy is a rapid and dynamic neurodevelopmental period for behavior and neurocognition. Longitudinal magnetic resonance imaging (MRI) is an effective tool to investigate such a crucial stage by capturing the developmental…

Image and Video Processing · Electrical Eng. & Systems 2024-02-22 Lianghu Guo , Tianli Tao , Xinyi Cai , Zihao Zhu , Jiawei Huang , Lixuan Zhu , Zhuoyang Gu , Haifeng Tang , Rui Zhou , Siyan Han , Yan Liang , Qing Yang , Dinggang Shen , Han Zhang

Image denoising is always a challenging task in the field of computer vision and image processing. In this paper, we have proposed an encoder-decoder model with direct attention, which is capable of denoising and reconstruct highly…

Machine Learning · Statistics 2018-01-17 Kazi Nazmul Haque , Mohammad Abu Yousuf , Rajib Rana

Recent fMRI-to-image approaches mainly focused on associating fMRI signals with specific conditions of pre-trained diffusion models. These approaches, while producing high-quality images, capture only a limited aspect of the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jingyang Huo , Yikai Wang , Xuelin Qian , Yun Wang , Chong Li , Jianfeng Feng , Yanwei Fu

The use of machine learning in fluid dynamics is becoming more common to expedite the computation when solving forward and inverse problems of partial differential equations. Yet, a notable challenge with existing convolutional neural…

Fluid Dynamics · Physics 2024-05-10 Siming Shan , Pengkai Wang , Song Chen , Jiaxu Liu , Chao Xu , Shengze Cai