English
Related papers

Related papers: Layered Rendering Diffusion Model for Controllable…

200 papers

Light fields (LFs), conducive to comprehensive scene radiance recorded across angular dimensions, find wide applications in 3D reconstruction, virtual reality, and computational photography.However, the LF acquisition is inevitably…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Ruisheng Gao , Yutong Liu , Zeyu Xiao , Zhiwei Xiong

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Scene Text Image Super-Resolution (STISR) aims to enhance the resolution and legibility of text within low-resolution (LR) images, consequently elevating recognition accuracy in Scene Text Recognition (STR). Previous methods predominantly…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Yuxuan Zhou , Liangcai Gao , Zhi Tang , Baole Wei

This paper presents PolyDiffuse, a novel structured reconstruction algorithm that transforms visual sensor data into polygonal shapes with Diffusion Models (DM), an emerging machinery amid exploding generative AI, while formulating…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Jiacheng Chen , Ruizhi Deng , Yasutaka Furukawa

We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image. SinDiffusion significantly improves the quality and diversity of generated samples compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Weilun Wang , Jianmin Bao , Wengang Zhou , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Pansharpening seeks to fuse high-resolution panchromatic (PAN) and low-resolution multispectral (LRMS) images into a single image with both fine spatial and rich spectral detail. Despite progress in deep learning-based approaches, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Hancong Jin , Zihan Cao , Liang-jian Deng , Jingjing Li

Image composition targets at synthesizing a realistic composite image from a pair of foreground and background images. Recently, generative composition methods are built on large pretrained diffusion models to generate composite images,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Bo Zhang , Yuxuan Duan , Jun Lan , Yan Hong , Huijia Zhu , Weiqiang Wang , Li Niu

Recently, GAN inversion methods combined with Contrastive Language-Image Pretraining (CLIP) enables zero-shot image manipulation guided by text prompts. However, their applications to diverse real images are still difficult due to the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Gwanghyun Kim , Taesung Kwon , Jong Chul Ye

We present ControlSR, a new method that can tame Diffusion Models for consistent real-world image super-resolution (Real-ISR). Previous Real-ISR models mostly focus on how to activate more generative priors of text-to-image diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yuhao Wan , Peng-Tao Jiang , Qibin Hou , Hao Zhang , Jinwei Chen , Ming-Ming Cheng , Bo Li

Existing text-to-image editing methods tend to excel either in rigid or non-rigid editing but encounter challenges when combining both, resulting in misaligned outputs with the provided text prompts. In addition, integrating reference…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Jiacheng Wang , Ping Liu , Wei Xu

The generation and enhancement of satellite imagery are critical in remote sensing, requiring high-quality, detailed images for accurate analysis. This research introduces a two-stage diffusion model methodology for synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ahmad Sebaq , Mohamed ElHelw

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

We present a novel method, Aerial Diffusion, for generating aerial views from a single ground-view image using text guidance. Aerial Diffusion leverages a pretrained text-image diffusion model for prior knowledge. We address two main…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Divya Kothandaraman , Tianyi Zhou , Ming Lin , Dinesh Manocha

Recent text-to-image diffusion models have demonstrated an astonishing capacity to generate high-quality images. However, researchers mainly studied the way of synthesizing images with only text prompts. While some works have explored using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jinheng Xie , Yuexiang Li , Yawen Huang , Haozhe Liu , Wentian Zhang , Yefeng Zheng , Mike Zheng Shou

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong

While diffusion models excel at generating high-quality images from text prompts, they struggle with visual consistency when generating image sequences. Existing methods generate each image independently, leading to disjointed narratives -…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Guilherme Fernandes , Vasco Ramos , Regev Cohen , Idan Szpektor , João Magalhães

With the rapid advancement of diffusion models, a variety of fine-tuning methods have been developed, enabling high-fidelity image generation with high similarity to the target content using only 3 to 5 training images. More recently,…

Image and Video Processing · Electrical Eng. & Systems 2025-11-26 Jun Jia , Hongyi Miao , Yingjie Zhou , Linhan Cao , Yanwei Jiang , Wangqiu Zhou , Dandan Zhu , Hua Yang , Wei Sun , Xiongkuo Min , Guangtao Zhai

Exploiting pre-trained diffusion models for restoration has recently become a favored alternative to the traditional task-specific training approach. Previous works have achieved noteworthy success by limiting the solution space using…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Peiqing Yang , Shangchen Zhou , Qingyi Tao , Chen Change Loy

Diffusion models have emerged as a key pillar of foundation models in visual domains. One of their critical applications is to universally solve different downstream inverse tasks via a single diffusion prior without re-training for each…

Machine Learning · Computer Science 2023-10-03 Morteza Mardani , Jiaming Song , Jan Kautz , Arash Vahdat