English
Related papers

Related papers: RATLIP: Generative Adversarial CLIP Text-to-Image …

200 papers

Converting text descriptions into images using Generative Adversarial Networks has become a popular research area. Visually appealing images have been generated successfully in recent years. Inspired by these studies, we investigated the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Azmi Can Özgen , Hazım Kemal Ekenel

Generative image models have emerged as a promising technology to produce realistic images. Despite potential benefits, concerns grow about its misuse, particularly in generating deceptive images that could raise significant ethical, legal,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jinbin Huang , Chen Chen , Aditi Mishra , Bum Chul Kwon , Zhicheng Liu , Chris Bryan

VAR is a new generation paradigm that employs 'next-scale prediction' as opposed to 'next-token prediction'. This innovative transformation enables auto-regressive (AR) transformers to rapidly learn visual distributions and achieve robust…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Qian Zhang , Xiangzi Dai , Ninghua Yang , Xiang An , Ziyong Feng , Xingyu Ren

Automatic synthesis of realistic images from text would be interesting and useful, but current AI systems are still far from this goal. However, in recent years generic and powerful recurrent neural network architectures have been developed…

Neural and Evolutionary Computing · Computer Science 2016-06-07 Scott Reed , Zeynep Akata , Xinchen Yan , Lajanugen Logeswaran , Bernt Schiele , Honglak Lee

In this work, we show the generative capability of an image classifier network by synthesizing high-resolution, photo-realistic, and diverse images at scale. The overall methodology, called Synthesize-It-Classifier (STIC), does not require…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Arghya Pal , Rapha Phan , KokSheik Wong

Existing computer vision research in artwork struggles with artwork's fine-grained attributes recognition and lack of curated annotated datasets due to their costly creation. To the best of our knowledge, we are one of the first methods to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Marcos V. Conde , Kerem Turgutlu

In this paper, we propose Generative Adversarial Network (GAN) architectures that use Capsule Networks for image-synthesis. Based on the principal of positional-equivariance of features, Capsule Network's ability to encode spatial…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Yash Upadhyay , Paul Schrater

Fine-grained classification remains a challenging task because distinguishing categories needs learning complex and local differences. Diversity in the pose, scale, and position of objects in an image makes the problem even more difficult.…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Mahdi Darvish , Mahsa Pouramini , Hamid Bahador

Conditional image modeling based on textual descriptions is a relatively new domain in unsupervised learning. Previous approaches use a latent variable model and generative adversarial networks. While the formers are approximated by using…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Tehseen Zia , Shahan Arif , Shakeeb Murtaza , Mirza Ahsan Ullah

The state-of-the-art approaches in Generative Adversarial Networks (GANs) are able to learn a mapping function from one image domain to another with unpaired image data. However, these methods often produce artifacts and can only be able to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-29 Hao Tang , Dan Xu , Nicu Sebe , Yan Yan

Generating images from natural language is one of the primary applications of recent conditional generative models. Besides testing our ability to model conditional, highly dimensional distributions, text to image synthesis has many…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Cristian Bodnar

Text-to-image synthesis has recently seen significant progress thanks to large pretrained language models, large-scale training data, and the introduction of scalable model families such as diffusion and autoregressive models. However, the…

Machine Learning · Computer Science 2023-01-24 Axel Sauer , Tero Karras , Samuli Laine , Andreas Geiger , Timo Aila

Powerful generative adversarial networks (GAN) have been developed to automatically synthesize realistic images from text. However, most existing tasks are limited to generating simple images such as flowers from captions. In this work, we…

Machine Learning · Computer Science 2019-11-27 Osaid Rehman Nasir , Shailesh Kumar Jha , Manraj Singh Grover , Yi Yu , Ajit Kumar , Rajiv Ratn Shah

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jianfeng Wang , Zhengyuan Yang , Xiaowei Hu , Linjie Li , Kevin Lin , Zhe Gan , Zicheng Liu , Ce Liu , Lijuan Wang

Generative Adversarial Networks (GANs) are the driving force behind the state-of-the-art in image generation. Despite their ability to synthesize high-resolution photo-realistic images, generating content with on-demand conditioning of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Markos Georgopoulos , James Oldfield , Grigorios G Chrysos , Yannis Panagakis

In this paper, we study the problem of generalizable synthetic image detection, aiming to detect forgery images from diverse generative methods, e.g., GANs and diffusion models. Cutting-edge solutions start to explore the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Huan Liu , Zichang Tan , Chuangchuang Tan , Yunchao Wei , Yao Zhao , Jingdong Wang

Generative Adversarial Networks have been crucial in the developments made in unsupervised learning in recent times. Exemplars of image synthesis from text or other images, these networks have shown remarkable improvements over conventional…

Machine Learning · Computer Science 2019-09-02 Rohan Akut , Sumukh Marathe , Rucha Apte , Ishan Joshi , Siddhivinayak Kulkarni

Recent studies have shown that CLIP model's adversarial robustness in zero-shot classification tasks can be enhanced by adversarially fine-tuning its image encoder with adversarial examples (AEs), which are generated by minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Jiacheng Zhang , Jinhao Li , Hanxun Huang , Sarah M. Erfani , Benjamin I. P. Rubinstein , Feng Liu