中文
相关论文

相关论文: Efficient Neural Architecture for Text-to-Image Sy…

200 篇论文

Painting is one of the ways for people to express their ideas, but what if people with disabilities in hands want to paint? To tackle this challenge, we create an end-to-end solution that can generate artistic images from text descriptions.…

计算机视觉与模式识别 · 计算机科学 2022-05-06 Qinghe Tian , Jean-Claude Franchitti

New advancements for the detection of synthetic images are critical for fighting disinformation, as the capabilities of generative AI models continuously evolve and can lead to hyper-realistic synthetic imagery at unprecedented scale and…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Pantelis Dogoulis , Giorgos Kordopatis-Zilos , Ioannis Kompatsiaris , Symeon Papadopoulos

One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Yifan Gong , Zheng Zhan , Qing Jin , Yanyu Li , Yerlan Idelbayev , Xian Liu , Andrey Zharkov , Kfir Aberman , Sergey Tulyakov , Yanzhi Wang , Jian Ren

Image to image translation is an active area of research in the field of computer vision, enabling the generation of new images with different styles, textures, or resolutions while preserving their characteristic properties. Recent…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Gaurav Kumar , Soham Satyadharma , Harpreet Singh

Recently image-to-image translation has attracted significant interests in the literature, starting from the successful use of the generative adversarial network (GAN), to the introduction of cyclic constraint, to extensions to multiple…

计算机视觉与模式识别 · 计算机科学 2020-01-16 Zengming Shen , S. Kevin Zhou , Yifan Chen , Bogdan Georgescu , Xuqi Liu , Thomas S. Huang

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

计算机视觉与模式识别 · 计算机科学 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

Our work aims to build a model that performs dual tasks of image captioning and image generation while being trained on only one task. The central idea is to train an invertible model that learns a one-to-one mapping between the image and…

计算机视觉与模式识别 · 计算机科学 2024-10-29 Nandakishore S Menon , Chandramouli Kamanchi , Raghuram Bharadwaj Diddigi

The emergence of diffusion models has significantly advanced image synthesis. The recent studies of model interaction and self-corrective reasoning approach in large language models offer new insights for enhancing text-to-image models.…

计算机视觉与模式识别 · 计算机科学 2024-12-19 Zhongjie Duan , Qianyi Zhao , Cen Chen , Daoyuan Chen , Wenmeng Zhou , Yaliang Li , Yingda Chen

One of the latest applications of Artificial Intelligence (AI) is to generate images from natural language descriptions. These generators are now becoming available and achieve impressive results that have been used for example in the front…

计算与语言 · 计算机科学 2022-11-18 Pedro Reviriego , Elena Merino-Gómez

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Ran Galun , Sagie Benaim

We introduce a memory-driven semi-parametric approach to text-to-image generation, which is based on both parametric and non-parametric techniques. The non-parametric component is a memory bank of image features constructed from a training…

计算机视觉与模式识别 · 计算机科学 2022-08-16 Bowen Li , Philip H. S. Torr , Thomas Lukasiewicz

The need for large amounts of training and validation data is a huge concern in scaling AI algorithms for autonomous driving. Semantic Image Synthesis (SIS), or label-to-image translation, promises to address this issue by translating…

计算机视觉与模式识别 · 计算机科学 2023-05-18 George Eskandar , Diandian Guo , Karim Guirguis , Bin Yang

Text-to-Image synthesis is the task of generating an image according to a specific text description. Generative Adversarial Networks have been considered the standard method for image synthesis virtually since their introduction. Denoising…

We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images from only a single training sample. We leverage the knowledge of image semantics from a pre-trained…

计算机视觉与模式识别 · 计算机科学 2021-04-14 Pei Wang , Yijun Li , Krishna Kumar Singh , Jingwan Lu , Nuno Vasconcelos

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

In this research, we introduce an innovative method for synthesizing medical images using generative adversarial networks (GANs). Our proposed GANs method demonstrates the capability to produce realistic synthetic images even when trained…

图像与视频处理 · 电气工程与系统科学 2024-06-28 Yinqiu Feng , Bo Zhang , Lingxi Xiao , Yutian Yang , Tana Gegen , Zexi Chen

Recent advancements in the domain of text-to-image synthesis have culminated in a multitude of enhancements pertaining to quality, fidelity, and diversity. Contemporary techniques enable the generation of highly intricate visuals which…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Dominic Rampas , Pablo Pernias , Marc Aubreville

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

While text-to-image (T2I) models can synthesize high-quality images, their performance degrades significantly when prompted with novel or out-of-distribution (OOD) entities due to inherent knowledge cutoffs. We introduce World-To-Image, a…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Moo Hyun Son , Jintaek Oh , Sun Bin Mun , Jaechul Roh , Sehyun Choi