English
Related papers

Related papers: NoiseCollage: A Layout-Aware Text-to-Image Diffusi…

200 papers

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

We propose Context Diffusion, a diffusion-based framework that enables image generation models to learn from visual examples presented in context. Recent work tackles such in-context learning for image generation, where a query image is…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Ivona Najdenkoska , Animesh Sinha , Abhimanyu Dubey , Dhruv Mahajan , Vignesh Ramanathan , Filip Radenovic

We present a deep neural network to reduce coherent noise in three-dimensional quantitative phase imaging. Inspired by the cycle generative adversarial network, the denoising network was trained to learn a transform between two image…

Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Siqi Wang , Chau Pham , Bryan A. Plummer

Diffusion methods have been proven to be very effective to generate images while conditioning on a text prompt. However, and although the quality of the generated images is unprecedented, these methods seem to struggle when trying to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Álvaro Barbero Jiménez

There are quite a number of photographs captured under undesirable conditions in the last century. Thus, they are often noisy, regionally incomplete, and grayscale formatted. Conventional approaches mainly focus on one point so that those…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Zhao Yuzhi , Po Lai-Man , Wang Xuehui , Liu Kangcheng , Zhang Yujia , Yu Wing-Yin , Xian Pengfei , Xiong Jingjing

Deep learning-based image denoising techniques often struggle with poor generalization performance to out-of-distribution real-world noise. To tackle this challenge, we propose a novel noise translation framework that performs denoising on…

Image and Video Processing · Electrical Eng. & Systems 2026-04-03 Inju Ha , Donghun Ryou , Seonguk Seo , Bohyung Han

Controllable text-to-image generation synthesizes visual text and objects in images with certain conditions, which are frequently applied to emoji and poster generation. Visual text rendering and layout-to-image generation tasks have been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xiaoran Zhao , Tianhao Wu , Yu Lai , Zhiliang Tian , Zhen Huang , Yahui Liu , Zejiang He , Dongsheng Li

Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Shipeng Cao , Biao Qian , Haipeng Liu , Yang Wang , Meng Wang

We present a one-shot text-to-image diffusion model that can generate high-resolution images from natural language descriptions. Our model employs a layered U-Net architecture that simultaneously synthesizes images at multiple resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Emaad Khwaja , Abdullah Rashwan , Ting Chen , Oliver Wang , Suraj Kothawade , Yeqing Li

In this paper, we jointly combine image classification and image denoising, aiming to enhance human perception of noisy images captured by edge devices, like low-light security cameras. In such settings, it is important to retain the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Thomas C Markhorst , Jan C van Gemert , Osman S Kayhan

Despite recent advancements in text-to-image models, achieving semantically accurate images in text-to-image diffusion models is a persistent challenge. While existing initial latent optimization methods have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Aravindan Sundaram , Ujjayan Pal , Abhimanyu Chauhan , Aishwarya Agarwal , Srikrishna Karanam

Recent advances in conditional generative image models have enabled impressive results. On the one hand, text-based conditional models have achieved remarkable generation quality, by leveraging large-scale datasets of image-text pairs. To…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Arantxa Casanova , Marlène Careil , Adriana Romero-Soriano , Christopher J. Pal , Jakob Verbeek , Michal Drozdzal

Generative diffusion processes are an emerging and effective tool for image and speech generation. In the existing methods, the underline noise distribution of the diffusion process is Gaussian noise. However, fitting distributions with…

Machine Learning · Computer Science 2021-06-17 Eliya Nachmani , Robin San Roman , Lior Wolf

Noise is an important factor which when get added to an image reduces its quality and appearance. So in order to enhance the image qualities, it has to be removed with preserving the textural information and structural features of image.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Vivek Kumar , Atul Samadhiya

Diffusion models have recently emerged as the dominant approach in visual generation tasks. However, the lengthy denoising chains and the computationally intensive noise estimation networks hinder their applicability in low-latency and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qian Zeng , Jie Song , Yuanyu Wan , Huiqiong Wang , Mingli Song

Diffusion models have emerged as the leading approach for text-to-image generation. However, their iterative sampling process, which gradually morphs random noise into coherent images, introduces significant latency that limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Peijie Qiu , Hariharan Ramshankar , Arnau Ramisa , René Vidal , Amit Kumar K C , Vamsi Salaka , Rahul Bhagat

We explore different design choices for injecting noise into generative adversarial networks (GANs) with the goal of disentangling the latent space. Instead of traditional approaches, we propose feeding multiple noise codes through separate…

Computer Vision and Pattern Recognition · Computer Science 2020-05-06 Yazeed Alharbi , Peter Wonka

We propose a new framework called Noise2Blur (N2B) for training robust image denoising models without pre-collected paired noisy/clean images. The training of the model requires only some (or even one) noisy images, some random unpaired…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Huangxing Lin , Weihong Zeng , Xinghao Ding , Xueyang Fu , Yue Huang , John Paisley

We consider the problem of conditional text-to-image synthesis with diffusion models. Most recent works need to either finetune specific parts of the base diffusion model or introduce new trainable parameters, leading to deployment…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Tripti Shukla , Srikrishna Karanam , Balaji Vasan Srinivasan