English
Related papers

Related papers: PromptRR: Diffusion Models as Prompt Generators fo…

200 papers

Removing the undesired reflections from images taken through the glass is of broad application to various computer vision tasks. Non-learning based methods utilize different handcrafted priors such as the separable sparse gradients caused…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Renjie Wan , Boxin Shi , Ling-Yu Duan , Ah-Hwee Tan , Alex C. Kot

The recent advancements in Generative AI have significantly advanced the field of text-to-image generation. The state-of-the-art text-to-image model, Stable Diffusion, is now capable of synthesizing high-quality images with a strong sense…

Human-Computer Interaction · Computer Science 2024-03-08 Zhijie Wang , Yuheng Huang , Da Song , Lei Ma , Tianyi Zhang

A significant research effort is focused on exploiting the amazing capacities of pretrained diffusion models for the editing of images.They either finetune the model, or invert the image in the latent space of the pretrained model. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Senmao Li , Joost van de Weijer , Taihang Hu , Fahad Shahbaz Khan , Qibin Hou , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Diffusion-based image super-resolution (SR) methods are mainly limited by the low inference speed due to the requirements of hundreds or even thousands of sampling steps. Existing acceleration sampling techniques inevitably sacrifice…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Zongsheng Yue , Jianyi Wang , Chen Change Loy

In autoregressive (AR) image generation, models based on the 'next-token prediction' paradigm of LLMs have shown comparable performance to diffusion models by reducing inductive biases. However, directly applying LLMs to complex image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Miaomiao Cai , Guanjie Wang , Wei Li , Zhijun Tu , Hanting Chen , Shaohui Lin , Jie Hu

Single-image super-resolution (SISR) remains challenging due to the inherent difficulty of recovering fine-grained details and preserving perceptual quality from low-resolution inputs. Existing methods often rely on limited image priors,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kangfu Mei , Hossein Talebi , Mojtaba Ardakani , Vishal M. Patel , Peyman Milanfar , Mauricio Delbracio

Diffusion models are well known for their ability to generate a high-fidelity image for an input prompt through an iterative denoising process. Unfortunately, the high fidelity also comes at a high computational cost due the inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Qinchan Li , Kenneth Chen , Changyue Su , Wittawat Jitkrittum , Qi Sun , Patsorn Sangkloy

Single image reflection removal problem aims to divide a reflection-contaminated image into a transmission image and a reflection image. It is a canonical blind source separation problem and is highly ill-posed. In this paper, we present a…

Image and Video Processing · Electrical Eng. & Systems 2022-03-15 Jun-Jie Huang , Tianrui Liu , Zhixiong Yang , Shaojing Fu , Wentao Zhao , Pier Luigi Dragotti

The computational burden of the iterative sampling process remains a major challenge in diffusion-based Low-Light Image Enhancement (LLIE). Current acceleration methods, whether training-based or training-free, often lead to significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Guanzhou Lan , Qianli Ma , Yuqi Yang , Zhigang Wang , Dong Wang , Xuelong Li , Bin Zhao

Personalizing generative models offers a way to guide image generation with user-provided references. Current personalization methods can invert an object or concept into the textual conditioning space and compose new natural sentences for…

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Recent advances in powerful pre-trained diffusion models encourage the development of methods to improve the sampling performance under well-trained diffusion models. This paper introduces Diffusion Rejection Sampling (DiffRS), which uses a…

Machine Learning · Computer Science 2024-05-29 Byeonghu Na , Yeongmin Kim , Minsang Park , Donghyeok Shin , Wanmo Kang , Il-Chul Moon

Reward Feedback Learning (ReFL) has recently shown great potential in aligning model outputs with human preferences across various generative tasks. In this work, we introduce a ReFL framework, named DiffusionReward, to the Blind Face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Bin Wu , Wei Wang , Yahui Liu , Zixiang Li , Yao Zhao

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos

Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive…

Artificial Intelligence · Computer Science 2024-04-09 Shachar Rosenman , Vasudev Lal , Phillip Howard

Flow matching models (FMs) have revolutionized text-to-image (T2I) generation, with reinforcement learning (RL) serving as a critical post-training strategy for alignment with reward objectives. In this research, we show that current RL…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Fu-Yun Wang , Han Zhang , Michael Gharbi , Hongsheng Li , Taesung Park

Recent breakthroughs in diffusion models have exhibited exceptional image-generation capabilities. However, studies show that some outputs are merely replications of training data. Such replications present potential legal challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Yuxin Wen , Yuchen Liu , Chen Chen , Lingjuan Lyu

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Removing undesired reflections from a photo taken in front of glass is of great importance for enhancing visual computing systems' efficiency. Previous learning-based approaches have produced visually plausible results for some reflections…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Sutanu Bera , Prabir Kumar Biswas