English
Related papers

Related papers: Fine-grained Semantic Constraint in Image Synthesi…

200 papers

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Image generation has raised tremendous attention in both academic and industrial areas, especially for the conditional and target-oriented image generation, such as criminal portrait and fashion design. Although the current studies have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Songyao Jiang , Hongfu Liu , Yue Wu , Yun Fu

Semantic image synthesis aims to generate photo realistic images given a semantic segmentation map. Despite much recent progress, training them still requires large datasets of images annotated with per-pixel label maps that are extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Marlène Careil , Jakob Verbeek , Stéphane Lathuilière

Recent advances in generative models and adversarial training have enabled artificially generating artworks in various artistic styles. It is highly desirable to gain more control over the generated style in practice. However, artistic…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Miao , Huayan Wang , Jun Fu , Jiayi Liu , Shen Wang , Zhenyu Liao

Generative Adversarial Networks (GANs) are able to generate high-quality images, but it remains difficult to explicitly specify the semantics of synthesized images. In this work, we aim to better understand the semantic representation of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jianjin Xu , Changxi Zheng

We present a method for fine-grained face manipulation. Given a face image with an arbitrary expression, our method can synthesize another arbitrary expression by the same person. This is achieved by first fitting a 3D face model and then…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Zhenglin Geng , Chen Cao , Sergey Tulyakov

Semantic image synthesis aims at generating photorealistic images from semantic layouts. Previous approaches with conditional generative adversarial networks (GAN) show state-of-the-art performance on this task, which either feed the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Xihui Liu , Guojun Yin , Jing Shao , Xiaogang Wang , Hongsheng Li

Synthesizing high-quality, realistic images from text-descriptions is a challenging task, and current methods synthesize images from text in a multi-stage manner, typically by first generating a rough initial image and then refining image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Amrit Diggavi Seshadri , Balaraman Ravindran

In this research, we introduce an innovative method for synthesizing medical images using generative adversarial networks (GANs). Our proposed GANs method demonstrates the capability to produce realistic synthetic images even when trained…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Yinqiu Feng , Bo Zhang , Lingxi Xiao , Yutian Yang , Tana Gegen , Zexi Chen

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Qifeng Chen , Vladlen Koltun

This paper proposes a series of new approaches to improve Generative Adversarial Network (GAN) for conditional image synthesis and we name the proposed model as ArtGAN. One of the key innovation of ArtGAN is that, the gradient of the loss…

Computer Vision and Pattern Recognition · Computer Science 2018-08-27 Wei Ren Tan , Chee Seng Chan , Hernan Aguirre , Kiyoshi Tanaka

Few-shot image generation aims to generate images of high quality and great diversity with limited data. However, it is difficult for modern GANs to avoid overfitting when trained on only a few images. The discriminator can easily remember…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Generative Adversarial Networks (GANs) are the driving force behind the state-of-the-art in image generation. Despite their ability to synthesize high-resolution photo-realistic images, generating content with on-demand conditioning of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Markos Georgopoulos , James Oldfield , Grigorios G Chrysos , Yannis Panagakis

We introduce a segmentation-guided approach to synthesise images that integrate features from two distinct domains. Images synthesised by our dual-domain model belong to one domain within the semantic mask, and to another in the rest of the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Dena Bazazian , Andrew Calway , Dima Damen

Image completion has achieved significant progress due to advances in generative adversarial networks (GANs). Albeit natural-looking, the synthesized contents still lack details, especially for scenes with complex structures or images with…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pengpeng Liu , Xiaojuan Qi , Pinjia He , Yikang Li , Michael R. Lyu , Irwin King

This paper proposes a hierarchical generative model with a multi-grained latent variable to synthesize expressive speech. In recent years, fine-grained latent variables are introduced into the text-to-speech synthesis that enable the fine…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-28 Yukiya Hono , Kazuna Tsuboi , Kei Sawada , Kei Hashimoto , Keiichiro Oura , Yoshihiko Nankaku , Keiichi Tokuda

Recently image inpainting has witnessed rapid progress due to generative adversarial networks (GAN) that are able to synthesize realistic contents. However, most existing GAN-based methods for semantic inpainting apply an auto-encoder…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Haofeng Li , Guanbin Li , Liang Lin , Yizhou Yu

Semantic layouts based Image synthesizing, which has benefited from the success of Generative Adversarial Network (GAN), has drawn much attention in these days. How to enhance the synthesis image equality while keeping the stochasticity of…

Computer Vision and Pattern Recognition · Computer Science 2018-01-11 Ziqiang Zheng , Chao Wang , Zhibin Yu , Haiyong Zheng , Bing Zheng

The use of coarse-grained layouts for controllable synthesis of complex scene images via deep generative models has recently gained popularity. However, results of current approaches still fall short of their promise of high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Manuel Jahn , Robin Rombach , Björn Ommer