English
Related papers

Related papers: Spatially Multi-conditional Image Generation

200 papers

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Multi-domain image-to-image translation is a problem where the goal is to learn mappings among multiple domains. This problem is challenging in terms of scalability because it requires the learning of numerous mappings, the number of which…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Takuhiro Kaneko , Tatsuya Harada

Semantic image synthesis, translating semantic layouts to photo-realistic images, is a one-to-many mapping problem. Though impressive progress has been recently made, diverse semantic synthesis that can efficiently produce semantic-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Zhentao Tan , Menglei Chai , Dongdong Chen , Jing Liao , Qi Chu , Bin Liu , Gang Hua , Nenghai Yu

The need for large amounts of training and validation data is a huge concern in scaling AI algorithms for autonomous driving. Semantic Image Synthesis (SIS), or label-to-image translation, promises to address this issue by translating…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 George Eskandar , Diandian Guo , Karim Guirguis , Bin Yang

Sparse representations using overcomplete dictionaries have proved to be a powerful tool in many signal processing applications such as denoising, super-resolution, inpainting, compression or classification. The sparsity of the…

Machine Learning · Statistics 2018-03-01 Jeremy Aghaei Mazaheri , Elif Vural , Claude Labit , Christine Guillemot

Content creation and image editing can benefit from flexible user controls. A common intermediate representation for conditional image generation is a semantic map, that has information of objects present in the image. When compared to raw…

Artificial Intelligence · Computer Science 2024-01-25 Chandrakanth Gudavalli , Erik Rosten , Lakshmanan Nataraj , Shivkumar Chandrasekaran , B. S. Manjunath

We introduce a simple but effective unsupervised method for generating realistic and diverse images. We train a class-conditional GAN model without using manually annotated class labels. Instead, our model is conditional on labels…

Computer Vision and Pattern Recognition · Computer Science 2022-02-11 Steven Liu , Tongzhou Wang , David Bau , Jun-Yan Zhu , Antonio Torralba

Photorealistic image generation from simulated label maps are necessitated in several contexts, such as for medical training in virtual reality. With conventional deep learning methods, this task requires images that are paired with…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Lin Zhang , Tiziano Portenier , Orcun Goksel

Multi-label learning has attracted significant interests in computer vision recently, finding applications in many vision tasks such as multiple object recognition and automatic image annotation. Associating multiple labels to a complex…

Computer Vision and Pattern Recognition · Computer Science 2016-08-05 Hao Yang , Joey Tianyi Zhou , Jianfei Cai

In multi-label learning, each sample is associated with several labels. Existing works indicate that exploring correlations between labels improve the prediction performance. However, embedding the label correlations into the training…

Machine Learning · Computer Science 2011-03-04 Tianyi Zhou , Dacheng Tao

Text-to-image synthesis is the task of generating images from text descriptions. Image generation, by itself, is a challenging task. When we combine image generation and text, we bring complexity to a new level: we need to combine data from…

Machine Learning · Computer Science 2020-04-27 Douglas M. Souza , Jônatas Wehrmann , Duncan D. Ruiz

Cross-domain mapping has been a very active topic in recent years. Given one image, its main purpose is to translate it to the desired target domain, or multiple domains in the case of multiple labels. This problem is highly challenging due…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Andrés Romero , Pablo Arbeláez , Luc Van Gool , Radu Timofte

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

Many tasks in computer vision and graphics fall within the framework of conditional image synthesis. In recent years, generative adversarial nets (GANs) have delivered impressive advances in quality of synthesized images. However, it…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Ke Li , Shichong Peng , Tianhao Zhang , Jitendra Malik

Image generation models trained on large datasets can synthesize high-quality images but often produce spatially inconsistent and distorted images due to limited information about the underlying structures and spatial layouts. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Hyundo Lee , Suhyung Choi , Inwoo Hwang , Byoung-Tak Zhang

Image generation abilities of text-to-image diffusion models have significantly advanced, yielding highly photo-realistic images from descriptive text and increasing the viability of leveraging synthetic images to train computer vision…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Jiahui Chen , Amy Zhang , Adriana Romero-Soriano

Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images. One of the methods is to use conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Xudong Mao , Qing Li , Haoran Xie

Recent progress in text-to-image generation has greatly advanced visual fidelity and creativity, but it has also imposed higher demands on prompt complexity-particularly in encoding intricate spatial relationships. In such cases, achieving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Zhenyu Tang , Chaoran Feng , Yufan Deng , Jie Wu , Xiaojie Li , Rui Wang , Yunpeng Chen , Daquan Zhou

This paper presents a weakly supervised sparse learning approach to the problem of noisily tagged image parsing, or segmenting all the objects within a noisily tagged image and identifying their categories (i.e. tags). Different from the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Zhiwu Lu , Zhenyong Fu , Tao Xiang , Liwei Wang , Ji-Rong Wen

Multi-label image recognition aims to predict a set of labels that present in an image. The key to deal with such problem is to mine the associations between image contents and labels, and further obtain the correct assignments between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yanan Wu , Songhe Feng , Yang Wang