English
Related papers

Related papers: Deep Image Synthesis from Intuitive User Input: A …

200 papers

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

Over the past years, image generation and manipulation have achieved remarkable progress due to the rapid development of generative AI based on deep learning. Recent studies have devoted significant efforts to address the problem of face…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Yuhang Lu , Touradj Ebrahimi

Deep generative models, such as Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs), have been employed widely in computational creativity research. However, such models discourage out-of-distribution generation to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Celia Cintas , Payel Das , Brian Quanz , Girmaw Abebe Tadesse , Skyler Speakman , Pin-Yu Chen

Controllable image synthesis with user scribbles is a topic of keen interest in the computer vision community. In this paper, for the first time we study the problem of photorealistic image synthesis from incomplete and primitive human…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Jaskirat Singh , Liang Zheng , Cameron Smith , Jose Echevarria

We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs). Conditional GANs have enabled a variety of applications, but the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-21 Ting-Chun Wang , Ming-Yu Liu , Jun-Yan Zhu , Andrew Tao , Jan Kautz , Bryan Catanzaro

Noise synthesis is a challenging low-level vision task aiming to generate realistic noise given a clean image along with the camera settings. To this end, we propose an effective generative model which utilizes clean features as guidance…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Mingyang Song , Yang Zhang , Tunç O. Aydın , Elham Amin Mansour , Christopher Schroers

Art is an artistic method of using digital technologies as a part of the generative or creative process. With the advent of digital currency and NFTs (Non-Fungible Token), the demand for digital art is growing aggressively. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Rohit Gandikota , Nik Bear Brown

We present a novel introspective variational autoencoder (IntroVAE) model for synthesizing high-resolution photographic images. IntroVAE is capable of self-evaluating the quality of its generated samples and improving itself accordingly.…

Machine Learning · Computer Science 2018-10-30 Huaibo Huang , Zhihang Li , Ran He , Zhenan Sun , Tieniu Tan

A comprehensive understanding of vision and language and their interrelation are crucial to realize the underlying similarities and differences between these modalities and to learn more generalized, meaningful representations. In recent…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Anindya Sundar Das , Sriparna Saha

In recent years, Generative Adversarial Networks have achieved impressive results in photorealistic image synthesis. This progress nurtures hopes that one day the classical rendering pipeline can be replaced by efficient models that are…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Yiyi Liao , Katja Schwarz , Lars Mescheder , Andreas Geiger

Recent text-to-image generation models have shown promising results in generating high-fidelity photo-realistic images. Though the results are astonishing to human eyes, how applicable these generated images are for recognition tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Ruifei He , Shuyang Sun , Xin Yu , Chuhui Xue , Wenqing Zhang , Philip Torr , Song Bai , Xiaojuan Qi

Current developments in computer vision and deep learning allow to automatically generate hyper-realistic images, hardly distinguishable from real ones. In particular, human face generation achieved a stunning level of realism, opening new…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Francesco Marra , Cristiano Saltori , Giulia Boato , Luisa Verdoliva

While recent advances in image editing have enabled impressive visual synthesis capabilities, current methods remain constrained by explicit textual instructions and limited editing operations, lacking deep comprehension of implicit user…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Zhang , Lingfeng He , Rui Yan , Fei Shen , Jinhui Tang

Advances in generative models have led to significant interest in image synthesis, demonstrating the ability to generate high-quality images for a diverse range of text prompts. Despite this progress, most studies ignore the presence of…

Artificial Intelligence · Computer Science 2024-07-02 Nila Masrourisaadat , Nazanin Sedaghatkish , Fatemeh Sarshartehrani , Edward A. Fox

In high dimensional settings, density estimation algorithms rely crucially on their inductive bias. Despite recent empirical success, the inductive bias of deep generative models is not well understood. In this paper we propose a framework…

Machine Learning · Computer Science 2018-11-09 Shengjia Zhao , Hongyu Ren , Arianna Yuan , Jiaming Song , Noah Goodman , Stefano Ermon

Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community which has gained significant attention from the last few years in identifying the internal structure of multimodal medical…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Nripendra Kumar Singh , Khalid Raza

Semantic image synthesis, i.e., generating images from user-provided semantic label maps, is an important conditional image generation task as it allows to control both the content as well as the spatial layout of generated images. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Tariq Berrada , Jakob Verbeek , Camille Couprie , Karteek Alahari

Human emotion synthesis is a crucial aspect of affective computing. It involves using computational methods to mimic and convey human emotions through various modalities, with the goal of enabling more natural and effective human-computer…

Machine Learning · Computer Science 2024-12-11 Fei Ma , Yukan Li , Yifan Xie , Ying He , Yi Zhang , Hongwei Ren , Zhou Liu , Wei Yao , Fuji Ren , Fei Richard Yu , Shiguang Ni

Deep generative models have various content creation applications such as graphic design, e-commerce, and virtual Try-on. However, current works mainly focus on synthesizing realistic visual outputs, often ignoring other sensory modalities,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Ruihan Gao , Wenzhen Yuan , Jun-Yan Zhu

In order to operate autonomously, a robot should explore the environment and build a model of each of the surrounding objects. A common approach is to carefully scan the whole workspace. This is time-consuming. It is also often impossible…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Karol Piaskowski , Rafal Staszak , Dominik Belter