English
Related papers

Related papers: Nested Scale Editing for Conditional Image Synthes…

200 papers

Rectified flow models have emerged as a dominant approach in image generation, showcasing impressive capabilities in high-quality image synthesis. However, despite their effectiveness in visual generation, rectified flow models often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yusuf Dalva , Kavana Venkatesh , Pinar Yanardag

In this work, we present a multiscale kinetic framework for consensus-based image segmentation. By interpreting an image as a system of interacting particles, each pixel is characterised by its spatial position and an internal feature…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Horacio Tettamanti , Giulia Guicciardi , Mattia Zanella

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Recent generative data augmentation methods conditioned on both image and text prompts struggle to balance between fidelity and diversity, as it is challenging to preserve essential image details while aligning with varied text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Tianchen Zhao , Xuanbai Chen , Zhihua Li , Jun Fang , Dongsheng An , Xiang Xu , Zhuowen Tu , Yifan Xing

We introduce a novel approach that takes a single semantic mask as input to synthesize multi-view consistent color images of natural scenes, trained with a collection of single images from the Internet. Prior works on 3D-aware image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tianrun Chen , Linzhan Mou , Haotong Lin , Kaicheng Yu , Yiyi Liao , Xiaowei Zhou

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Text-to-image synthesis aims to automatically generate images according to text descriptions given by users, which is a highly challenging task. The main issues of text-to-image synthesis lie in two gaps: the heterogeneous and homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Mingkuan Yuan , Yuxin Peng

While score based generative models, or diffusion models, have found success in image synthesis, they are often coupled with text data or image label to be able to manipulate and conditionally generate images. Even though manipulation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Sandesh Ghimire , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

Diffusion Transformers (DiTs) have achieved remarkable success in diverse and high-quality text-to-image(T2I) generation. However, how text and image latents individually and jointly contribute to the semantics of generated images, remain…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zitao Shuai , Chenwei Wu , Zhengxu Tang , Bowen Song , Liyue Shen

Most state-of-the-art semantic segmentation approaches only achieve high accuracy in good conditions. In practically-common but less-discussed adverse environmental conditions, their performance can decrease enormously. Existing studies…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Weihao Xia , Zhanglin Cheng , Yujiu Yang , Jing-Hao Xue

In this paper, we propose a neural network architecture for scale-invariant semantic segmentation using RGB-D images. We utilize depth information as an additional modality apart from color images only. Especially in an outdoor scene which…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Mohammad Dawud Ansari , Alwi Husada , Didier Stricker

A new statistical model designed for regression analysis with a sparse design matrix is proposed. This new model utilizes the positions of the limited non-zero elements in the design matrix to decompose the regression model into…

Applications · Statistics 2022-01-17 Hsien-Wei Chen

Recently, neural network (NN)-based image compression studies have actively been made and has shown impressive performance in comparison to traditional methods. However, most of the works have focused on non-scalable image compression…

Image and Video Processing · Electrical Eng. & Systems 2026-01-06 Jongmin Park , Jooyoung Lee , Munchurl Kim

This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distribution. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zipeng Qi , Guoxi Huang , Chenyang Liu , Fei Ye

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

In this work, we address an important problem of optical see through (OST) augmented reality: non-negative image synthesis. Most of the image generation methods fail under this condition, since they assume full control over each pixel and…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Flora Yu Shen , Katie Luo , Guandao Yang , Harald Haraldsson , Serge Belongie

This paper introduces a neural style transfer model to generate a stylized image conditioning on a set of examples describing the desired style. The proposed solution produces high-quality images even in the zero-shot setting and allows for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Jan Svoboda , Asha Anoosheh , Christian Osendorfer , Jonathan Masci

Text-to-image synthesis models require the ability to generate diverse images while maintaining stability. To overcome this challenge, a number of methods have been proposed, including the collection of prompt-image datasets and the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Keunwoo Park , Jihye Chae , Joong Ho Ahn , Jihoon Kweon

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger

Despite significant progress on current state-of-the-art image generation models, synthesis of document images containing multiple and complex object layouts is a challenging task. This paper presents a novel approach, called DocSynth, to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Sanket Biswas , Pau Riba , Josep Lladós , Umapada Pal