English
Related papers

Related papers: Deep Image Synthesis from Intuitive User Input: A …

200 papers

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

Recent generative data augmentation methods conditioned on both image and text prompts struggle to balance between fidelity and diversity, as it is challenging to preserve essential image details while aligning with varied text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Tianchen Zhao , Xuanbai Chen , Zhihua Li , Jun Fang , Dongsheng An , Xiang Xu , Zhuowen Tu , Yifan Xing

Image completion has achieved significant progress due to advances in generative adversarial networks (GANs). Albeit natural-looking, the synthesized contents still lack details, especially for scenes with complex structures or images with…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pengpeng Liu , Xiaojuan Qi , Pinjia He , Yikang Li , Michael R. Lyu , Irwin King

With advances in Generative Adversarial Networks (GANs) leading to dramatically-improved synthetic images and video, there is an increased need for algorithms which extend traditional forensics to this new category of imagery. While GANs…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Michael Albright , Scott McCloskey

Texture synthesis is a fundamental task in computer vision, whose goal is to generate visually realistic and structurally coherent textures for a wide range of applications, from graphics to scientific simulations. While traditional methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Elahe Salari , Zohreh Azimifar

Generative Artificial Intelligence (AI) is a cutting-edge technology capable of producing text, images, and various media content leveraging generative models and user prompts. Between 2022 and 2023, generative AI surged in popularity with…

Artificial Intelligence · Computer Science 2023-10-27 Nouar AlDahoul , Joseph Hong , Matteo Varvello , Yasir Zaki

Existing conditional image synthesis frameworks generate images based on user inputs in a single modality, such as text, segmentation, sketch, or style reference. They are often unable to leverage multimodal user inputs when available,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xun Huang , Arun Mallya , Ting-Chun Wang , Ming-Yu Liu

Deep generative models allow for photorealistic image synthesis at high resolutions. But for many applications, this is not enough: content creation also needs to be controllable. While several recent works investigate how to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Michael Niemeyer , Andreas Geiger

Recently, realistic image generation using deep neural networks has become a hot topic in machine learning and computer vision. Images can be generated at the pixel level by learning from a large collection of images. Learning to generate…

Computer Vision and Pattern Recognition · Computer Science 2017-05-09 Yifan Liu , Zengchang Qin , Zhenbo Luo , Hua Wang

Accurate evaluation of human aesthetic preferences represents a major challenge for creative evolutionary and generative systems research. Prior work has tended to focus on feature measures of the artefact, such as symmetry, complexity and…

Neural and Evolutionary Computing · Computer Science 2020-09-28 Jon McCormack , Andy Lomas

Human-computer image generation using Generative Adversarial Networks (GANs) is becoming a well-established methodology for casual entertainment and open artistic exploration. Here, we take the interaction a step further by weaving in…

Human-Computer Interaction · Computer Science 2020-12-29 Janet Rafner , Lotte Philipsen , Sebastian Risi , Joel Simon , Jacob Sherson

Generating high-resolution, photo-realistic images has been a long-standing goal in machine learning. Recently, Nguyen et al. (2016) showed one interesting way to synthesize novel images by performing gradient ascent in the latent space of…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Anh Nguyen , Jeff Clune , Yoshua Bengio , Alexey Dosovitskiy , Jason Yosinski

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to…

Computers and Society · Computer Science 2024-02-20 Maddalena Torricelli , Mauro Martino , Andrea Baronchelli , Luca Maria Aiello

A creative image-and-text generative AI system mimics humans' extraordinary abilities to provide users with diverse and comprehensive caption suggestions, as well as rich image creations. In this work, we demonstrate such an AI creation…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Yupan Huang , Bei Liu , Jianlong Fu , Yutong Lu

Personalized text-to-image generation has attracted unprecedented attention in the recent few years due to its unique capability of generating highly-personalized images via using the input concept dataset and novel textual prompt. However,…

Artificial Intelligence · Computer Science 2024-07-02 Shian Du , Xiaotian Cheng , Qi Qian , Henglu Wei , Yi Xu , Xiangyang Ji

The creative industry is both concerned and enthusiastic about how generative AI will reshape creativity. How might these tools interact with the workflow values of creative artists? In this paper, we adopt a value-sensitive design…

Human-Computer Interaction · Computer Science 2024-05-07 Ian P. Swift , Debaleena Chattopadhyay

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin

3D scene generation seeks to synthesize spatially structured, semantically meaningful, and photorealistic environments for applications such as immersive media, robotics, autonomous driving, and embodied AI. Early methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Beichen Wen , Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

Conditional image synthesis for generating photorealistic images serves various applications for content editing to content generation. Previous conditional image synthesis algorithms mostly rely on semantic maps, and often fail in complex…

Computer Vision and Pattern Recognition · Computer Science 2020-04-23 Aysegul Dundar , Karan Sapra , Guilin Liu , Andrew Tao , Bryan Catanzaro