中文
相关论文

相关论文: StoryDALL-E: Adapting Pretrained Text-to-Image Tra…

200 篇论文

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

机器学习 · 计算机科学 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

Semantic face editing of real world facial images is an important application of generative models. Recently, multiple works have explored possible techniques to generate such modifications using the latent structure of pre-trained GAN…

Text style transfer aims to change the style of sentences while preserving the semantic meanings. Due to the lack of parallel data, the Denoising Auto-Encoder (DAE) is widely used in this task to model distributions of different sentence…

计算与语言 · 计算机科学 2021-04-28 Jicheng Li , Yang Feng , Jiao Ou

This report explores the challenge of enhancing expressiveness control in Text-to-Speech (TTS) models by augmenting a frozen pretrained model with a Diffusion Model that is conditioned on joint semantic audio/text embeddings. The paper…

计算与语言 · 计算机科学 2023-11-21 Mathias Vogel

Non-parallel text style transfer is an important task in natural language generation. However, previous studies concentrate on the token or sentence level, such as sentence sentiment and formality transfer, but neglect long style transfer…

计算与语言 · 计算机科学 2023-05-16 Xuekai Zhu , Jian Guan , Minlie Huang , Juan Liu

Recent generative models have demonstrated impressive capabilities in generating realistic and visually pleasing images grounded on textual prompts. Nevertheless, a significant challenge remains in applying these models for the more…

计算机视觉与模式识别 · 计算机科学 2025-04-28 Xiaoqian Shen , Mohamed Elhoseiny

Generative Adversarial Networks (GANs) have revolutionized image synthesis through many applications like face generation, photograph editing, and image super-resolution. Image synthesis using GANs has predominantly been uni-modal, with few…

计算机视觉与模式识别 · 计算机科学 2021-10-12 Rohan Wadhawan , Tanuj Drall , Shubham Singh , Shampa Chakraverty

Despite the progress made in the style transfer task, most previous work focus on transferring only relatively simple features like color or texture, while missing more abstract concepts such as overall art expression or painter-specific…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Zipeng Xu , Enver Sangineto , Nicu Sebe

In this paper, we have developed a general-purpose architecture, Vit-Gan, capable of performing most of the image-to-image translation tasks from semantic image segmentation to single image depth perception. This paper is a follow-up paper,…

图像与视频处理 · 电气工程与系统科学 2021-10-19 Yiğit Gündüç

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-to-image…

计算机视觉与模式识别 · 计算机科学 2017-11-28 Pramuditha Perera , Mahdi Abavisani , Vishal M. Patel

Generative Adversarial Networks (GANs) are a class of neural networks that have been widely used in the field of image-to-image translation. In this paper, we propose a streamlined image-to-image translation network with a simpler…

计算机视觉与模式识别 · 计算机科学 2024-12-09 Guangzong Chen , Mingui Sun , Zhi-Hong Mao , Kangni Liu , Wenyan Jia

Vision language tasks, such as answering questions about or generating captions that describe an image, are difficult tasks for computers to perform. A relatively recent body of research has adapted the pretrained transformer architecture…

计算机视觉与模式识别 · 计算机科学 2023-07-10 Clayton Fields , Casey Kennington

Recent generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose, simply by learning from unlabeled image collections. Here, we investigate whether such views can be…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Lucy Chai , Jun-Yan Zhu , Eli Shechtman , Phillip Isola , Richard Zhang

In many scenarios in computer vision, machine learning, and computer graphics, there is a requirement to learn the mapping from an image of one domain to an image of another domain, called Image-to-image translation. For example, style…

图像与视频处理 · 电气工程与系统科学 2020-03-09 Mohammad Akif Beg , Jia Yuan Yu

Most image-to-image translation models postulate that a unique correspondence exists between the semantic classes of the source and target domains. However, this assumption does not always hold in real-world scenarios due to divergent…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Sidi Wu , Yizi Chen , Samuel Mermet , Lorenz Hurni , Konrad Schindler , Nicolas Gonthier , Loic Landrieu

Image to image translation is an active area of research in the field of computer vision, enabling the generation of new images with different styles, textures, or resolutions while preserving their characteristic properties. Recent…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Gaurav Kumar , Soham Satyadharma , Harpreet Singh

High quality facial image editing is a challenging problem in the movie post-production industry, requiring a high degree of control and identity preservation. Previous works that attempt to tackle this problem may suffer from the…

计算机视觉与模式识别 · 计算机科学 2021-08-18 Xu Yao , Alasdair Newson , Yann Gousseau , Pierre Hellier

Generative Adversarial Networks (GANs), particularly StyleGAN and its variants, have demonstrated remarkable capabilities in generating highly realistic images. Despite their success, adapting these models to diverse tasks such as domain…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Abdul Basit Anees , Ahmet Canberk Baykal , Muhammed Burak Kizil , Duygu Ceylan , Erkut Erdem , Aykut Erdem

The creation of high-quality human-labeled image-caption datasets presents a significant bottleneck in the development of Visual-Language Models (VLMs). In this work, we investigate an approach that leverages the strengths of Large Language…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Sahand Sharifzadeh , Christos Kaplanis , Shreya Pathak , Dharshan Kumaran , Anastasija Ilic , Jovana Mitrovic , Charles Blundell , Andrea Banino

Generative adversarial models (GANs) continue to produce advances in terms of the visual quality of still images, as well as the learning of temporal correlations. However, few works manage to combine these two interesting capabilities for…

计算机视觉与模式识别 · 计算机科学 2021-12-01 Gereon Fox , Ayush Tewari , Mohamed Elgharib , Christian Theobalt