English
Related papers

Related papers: What is in a Text-to-Image Prompt: The Potential o…

200 papers

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Recent progress in text-to-image (TTI) systems, such as StableDiffusion, Imagen, and DALL-E 2, have made it possible to create realistic images with simple text prompts. It is tempting to use these systems to eliminate the manual task of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 David Marwood , Shumeet Baluja , Yair Alon

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex internal structures and operations often pose challenges for non-experts to grasp. We introduce…

Human-Computer Interaction · Computer Science 2024-04-26 Seongmin Lee , Benjamin Hoover , Hendrik Strobelt , Zijie J. Wang , ShengYun Peng , Austin Wright , Kevin Li , Haekyu Park , Haoyang Yang , Polo Chau

Since the advent of GANs and VAEs, image generation models have continuously evolved, opening up various real-world applications with the introduction of Stable Diffusion and DALL-E models. These text-to-image models can generate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hyunwoo Yoo

The Stable Diffusion model is a prominent text-to-image generation model that relies on a text prompt as its input, which is encoded using the Contrastive Language-Image Pre-Training (CLIP). However, text prompts have limitations when it…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Yuxuan Ding , Chunna Tian , Haoxuan Ding , Lingqiao Liu

The field of visual computing is rapidly advancing due to the emergence of generative artificial intelligence (AI), which unlocks unprecedented capabilities for the generation, editing, and reconstruction of images, videos, and 3D scenes.…

Text-to-image generative models, specifically those based on diffusion models like Imagen and Stable Diffusion, have made substantial advancements. Recently, there has been a surge of interest in the delicate refinement of text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Wenyi Mo , Tianyu Zhang , Yalong Bai , Bing Su , Ji-Rong Wen , Qing Yang

Text-to-image (T2I) research has grown explosively in the past year, owing to the large-scale pre-trained diffusion models and many emerging personalization and editing approaches. Yet, one pain point persists: the text prompt engineering,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Xingqian Xu , Jiayi Guo , Zhangyang Wang , Gao Huang , Irfan Essa , Humphrey Shi

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

Text-To-Image (TTI) Diffusion Models such as DALL-E and Stable Diffusion are capable of generating images from text prompts. However, they have been shown to perpetuate gender stereotypes. These models process data internally in multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Abhishek Mandal , Susan Leavy , Suzanne Little

The rapid development of text-to-image generation has brought rising ethical considerations, especially regarding gender bias. Given a text prompt as input, text-to-image models generate images according to the prompt. Pioneering models…

Computers and Society · Computer Science 2024-08-22 Yankun Wu , Yuta Nakashima , Noa Garcia

In recent years, Generative Artificial Intelligence (GenAI) has undergone a profound transformation in addressing intricate tasks involving diverse modalities such as textual, auditory, visual, and pictorial generation. Within this…

Artificial Intelligence · Computer Science 2024-08-02 Felipe Mahlow , André Felipe Zanella , William Alberto Cruz Castañeda , Regilene Aparecida Sarzi-Ribeiro

Embodied AI agents require a fine-grained understanding of the physical world mediated through visual and language inputs. Such capabilities are difficult to learn solely from task-specific data. This has led to the emergence of pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Gunshi Gupta , Karmesh Yadav , Yarin Gal , Dhruv Batra , Zsolt Kira , Cong Lu , Tim G. J. Rudner

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

The revolution of artificial intelligence content generation has been rapidly accelerated with the booming text-to-image (T2I) diffusion models. Within just two years of development, it was unprecedentedly of high-quality, diversity, and…

Artificial Intelligence · Computer Science 2023-10-16 Zeqiang Lai , Xizhou Zhu , Jifeng Dai , Yu Qiao , Wenhai Wang

Diffusion-based generative models' impressive ability to create convincing images has garnered global attention. However, their complex structures and operations often pose challenges for non-experts to grasp. We present Diffusion…

This pictorial presents an ongoing research programme comprising three practice-based Design Research projects conducted through 2024, exploring the affordances of diffusion-based AI image generation systems, specifically Stable Diffusion.…

Human-Computer Interaction · Computer Science 2024-11-21 Joseph Lindley , Roger Whitham

We provide a new multi-task benchmark for evaluating text-to-image models. We perform a human evaluation comparing the most common open-source (Stable Diffusion) and commercial (DALL-E 2) models. Twenty computer science AI graduate students…

Artistic style transfer aims to transfer the learned artistic style onto an arbitrary content image, generating artistic stylized images. Existing generative adversarial network-based methods fail to generate highly realistic stylized…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zhanjie Zhang , Quanwei Zhang , Huaizhong Lin , Wei Xing , Juncheng Mo , Shuaicheng Huang , Jinheng Xie , Guangyuan Li , Junsheng Luan , Lei Zhao , Dalong Zhang , Lixia Chen

AI-based text-to-image generation has undergone a significant leap in the production of visually comprehensive and aesthetic imagery over the past year, to the point where differentiating between a man-made piece of art and an AI-generated…

Computers and Society · Computer Science 2023-06-06 Sarah K. Amer
‹ Prev 1 2 3 10 Next ›