中文
相关论文

相关论文: Scaling up GANs for Text-to-Image Synthesis

200 篇论文

Generative Adversarial Networks (GANs) have extended deep learning to complex generation and translation tasks across different data modalities. However, GANs are notoriously difficult to train: Mode collapse and other instabilities in the…

神经与进化计算 · 计算机科学 2021-10-29 Santiago Gonzalez , Mohak Kant , Risto Miikkulainen

Large-scale text-to-image diffusion models have made amazing advances. However, the status quo is to use text input alone, which can impede controllability. In this work, we propose GLIGEN, Grounded-Language-to-Image Generation, a novel…

计算机视觉与模式识别 · 计算机科学 2023-04-18 Yuheng Li , Haotian Liu , Qingyang Wu , Fangzhou Mu , Jianwei Yang , Jianfeng Gao , Chunyuan Li , Yong Jae Lee

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this study, we revisit…

计算机视觉与模式识别 · 计算机科学 2023-06-02 Kai Katsumata , Duc Minh Vo , Bei Liu , Hideki Nakayama

In this paper, we perform an in-depth study of the properties and applications of aligned generative models. We refer to two models as aligned if they share the same architecture, and one of them (the child) is obtained from the other (the…

计算机视觉与模式识别 · 计算机科学 2022-05-06 Zongze Wu , Yotam Nitzan , Eli Shechtman , Dani Lischinski

This work integrates StyleGAN, DragGAN and Principal Component Analysis (PCA) to enhance the latent space efficiency and controllability of GAN-generated images. Style-GAN provides a structured latent space, DragGAN enables intuitive image…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Kirsten Odendaal , Neela Kaushik , Spencer Halverson

The StyleGAN family succeed in high-fidelity image generation and allow for flexible and plausible editing of generated images by manipulating the semantic-rich latent style space.However, projecting a real image into its latent space…

计算机视觉与模式识别 · 计算机科学 2023-02-01 Bingchuan Li , Tianxiang Ma , Peng Zhang , Miao Hua , Wei Liu , Qian He , Zili Yi

We present a new perspective of achieving image synthesis by viewing this task as a visual token generation problem. Different from existing paradigms that directly synthesize a full image from a single input (e.g., a latent code), the new…

计算机视觉与模式识别 · 计算机科学 2021-12-21 Yanhong Zeng , Huan Yang , Hongyang Chao , Jianbo Wang , Jianlong Fu

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from…

图像与视频处理 · 电气工程与系统科学 2020-07-22 Michael Goebel , Lakshmanan Nataraj , Tejaswi Nanjundaswamy , Tajuddin Manhar Mohammed , Shivkumar Chandrasekaran , B. S. Manjunath

Generative Adversarial Networks (GANs) have been extremely successful in various application domains. Adversarial image synthesis has drawn increasing attention and made tremendous progress in recent years because of its wide range of…

计算机视觉与模式识别 · 计算机科学 2021-07-19 William Roy , Glen Kelly , Robert Leer , Frederick Ricardo

StyleGAN is a state-of-art generative adversarial network architecture that generates random 2D high-quality synthetic facial data samples. In this paper, we recap the StyleGAN architecture and training methodology and present our…

神经与进化计算 · 计算机科学 2020-03-25 Viktor Varkarakis , Shabab Bazrafkan , Peter Corcoran

Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN…

计算机视觉与模式识别 · 计算机科学 2017-09-11 Nikolay Jetchev , Urs Bergmann , Roland Vollgraf

A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images featuring multiple…

计算机视觉与模式识别 · 计算机科学 2023-05-17 George Eskandar , Youssef Farag , Tarun Yenamandra , Daniel Cremers , Karim Guirguis , Bin Yang

We consider the task of photo-realistic unconditional image generation (generate high quality, diverse samples that carry the same visual content as the image) on mobile platforms using Generative Adversarial Networks (GANs). In this paper,…

计算机视觉与模式识别 · 计算机科学 2021-03-25 Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa , Partha Pratim Pande

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Nonghai Zhang , Hao Tang

Coarse building mass models are now routinely generated at scales ranging from individual buildings through to whole cities. For example, they can be abstracted from raw measurements, generated procedurally, or created manually. However,…

图形学 · 计算机科学 2019-03-08 Tom Kelly , Paul Guerrero , Anthony Steed , Peter Wonka , Niloy J. Mitra

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

In this work, we are dedicated to text-guided image generation and propose a novel framework, i.e., CLIP2GAN, by leveraging CLIP model and StyleGAN. The key idea of our CLIP2GAN is to bridge the output feature embedding space of CLIP and…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Yixuan Wang , Wengang Zhou , Jianmin Bao , Weilun Wang , Li Li , Houqiang Li

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu