English
Related papers

Related papers: U-Sketch: An Efficient Approach for Sketch to Imag…

200 papers

Recent advances in diffusion models for image generation have led to detailed examinations of several components within the U-Net architecture for image editing. While previous studies have focused on the bottleneck layer (h-space),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Ludovica Schaerf , Andrea Alfarano , Fabrizio Silvestri , Leonardo Impett

Despite the growing success of Convolution neural networks (CNN) in the recent past in the task of scene segmentation, the standard models lack some of the important features that might result in sub-optimal segmentation outputs. The widely…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Soham Chattopadhyay , Hritam Basak

Diffusion models have recently revolutionized the field of image synthesis due to their ability to generate photorealistic images. However, one of the major drawbacks of diffusion models is that the image generation process is costly. A…

We introduce DiffSketch, a method for generating a variety of stylized sketches from images. Our approach focuses on selecting representative features from the rich semantics of deep features within a pretrained diffusion model. This novel…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Kwan Yun , Youngseo Kim , Kwanggyoon Seo , Chang Wook Seo , Junyong Noh

U-Nets are a go-to, state-of-the-art neural architecture across numerous tasks for continuous signals on a square such as images and Partial Differential Equations (PDE), however their design and architecture is understudied. In this paper,…

Network stream mining is fundamental to many network operations. Sketches, as compact data structures that offer low memory overhead with bounded accuracy, have emerged as a promising solution for network stream mining. Recent studies…

Networking and Internet Architecture · Computer Science 2025-02-12 Yuanpeng Li , Zhen Xu , Zongwei Lv , Yannan Hu , Yong Cui , Tong Yang

Text-to-image diffusion models enable high-quality image generation but are computationally expensive. While prior work optimizes per-inference efficiency, we explore an orthogonal approach: reducing redundancy across correlated prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Dale Decatur , Thibault Groueix , Wang Yifan , Rana Hanocka , Vladimir Kim , Matheus Gadelha

Diffusion models have become the most popular approach for high-quality image generation, but their high computational cost still remains a significant challenge. To address this problem, we propose U-Shape Mamba (USM), a novel diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Alex Ergasti , Filippo Botti , Tomaso Fontanini , Claudio Ferrari , Massimo Bertozzi , Andrea Prati

Diffusion models have recently gained unprecedented attention in the field of image synthesis due to their remarkable generative capabilities. Notwithstanding their prowess, these models often incur substantial computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Xinyin Ma , Gongfan Fang , Xinchao Wang

Diffusion models have recently demonstrated their effectiveness in generating extremely high-quality images and are now utilized in a wide range of applications, including automatic sketch colorization. Although many methods have been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Dingkun Yan , Liang Yuan , Erwin Wu , Yuma Nishioka , Issei Fujishiro , Suguru Saito

Recently, diffusion models have exhibited superior performance in the area of image inpainting. Inpainting methods based on diffusion models can usually generate realistic, high-quality image content for masked areas. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Ruichen Wang , Junliang Zhang , Qingsong Xie , Chen Chen , Haonan Lu

This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distribution. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zipeng Qi , Guoxi Huang , Chenyang Liu , Fei Ye

We apply the U-Net model for compressive light field synthesis. Compared to methods based on stacked CNN and iterative algorithms, this method offers better image quality, uniformity and less computation.

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Chen Gao , Haifeng Li , Xu Liu , Xiaodi Tan

Sketch portrait generation benefits a wide range of applications such as digital entertainment and law enforcement. Although plenty of efforts have been dedicated to this task, several issues still remain unsolved for generating vivid and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Dongyu Zhang , Liang Lin , Tianshui Chen , Xian Wu , Wenwei Tan , Ebroul Izquierdo

The conditional text-to-image diffusion models have garnered significant attention in recent years. However, the precision of these models is often compromised mainly for two reasons, ambiguous condition input and inadequate condition…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sicheng Li , Keqiang Sun , Zhixin Lai , Xiaoshi Wu , Feng Qiu , Haoran Xie , Kazunori Miyata , Hongsheng Li

Controllable image synthesis with user scribbles has gained huge public interest with the recent advent of text-conditioned latent diffusion models. The user scribbles control the color composition while the text prompt provides control…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Jaskirat Singh , Stephen Gould , Liang Zheng

Image dehazing is a critical challenge in computer vision, essential for enhancing image clarity in hazy conditions. Traditional methods often rely on atmospheric scattering models, while recent deep learning techniques, specifically…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Huibin Li , Haoran Liu , Mingzhe Liu , Yulong Xiao , Peng Li , Guibin Zan

Recently, Conditional Generative Adversarial Network (Conditional GAN) have shown very promising performance in several image-to-image translation applications. However, the uses of these conditional GANs are quite limited to low-resolution…

Image and Video Processing · Electrical Eng. & Systems 2021-05-28 Kumarapu Laxman , Shiv Ram Dubey , Baddam Kalyan , Satya Raj Vineel Kojjarapu

In this work we propose a neural network based image descriptor suitable for image patch matching, which is an important task in many computer vision applications. Our approach is influenced by recent success of deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Iaroslav Melekhov , Juho Kannala , Esa Rahtu

Diffusion models (DMs) have achieved state-of-the-art results for image synthesis tasks as well as density estimation. Applied in the latent space of a powerful pretrained autoencoder (LDM), their immense computational requirements can be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Jeremias Traub