English
Related papers

Related papers: Surrealistic-like Image Generation with Vision-Lan…

200 papers

There have been many work in the literature on generation of various kinds of images such as Hand-Written characters (MNIST dataset), scene images (CIFAR-10 dataset), various objects images (ImageNet dataset), road signboard images (SVHN…

Computer Vision and Pattern Recognition · Computer Science 2020-02-27 Tanmoy Mondal , LE Thi Thuy Trang , Mickaël Coustaty , Jean-Marc Ogier

Based on recent advances in realistic language modeling (GPT-3) and cross-modal representations (CLIP), Gaud\'i was developed to help designers search for inspirational images using natural language. In the early stages of the design…

Artificial Intelligence · Computer Science 2021-12-09 Victor S. Bursztyn , Jennifer Healey , Vishwa Vinay

Evolutionary search has been extensively used to generate artistic images. Raw images have high dimensionality which makes a direct search for an image challenging. In previous work this problem has been addressed by using compact symbolic…

Neural and Evolutionary Computing · Computer Science 2018-02-16 Aneta Neumann , Christo Pyromallis , Bradley Alexander

Generative AI systems are increasingly capable of expressing emotions via text and imagery. Effective emotional expression will likely play a major role in the efficacy of AI systems -- particularly those designed to support human mental…

In this paper, we examine how generative machine learning systems produce a new politics of visual culture. We focus on DALL-E 2 and related models as an emergent approach to image-making that operates through the cultural techniques of…

Computers and Society · Computer Science 2022-11-14 Fabian Offert , Thao Phan

We conduct a pilot study selectively evaluating the cognitive abilities (decision making and spatial reasoning) of two recently released generative transformer models, ChatGPT and DALL-E 2. Input prompts were constructed following neutral a…

Artificial Intelligence · Computer Science 2023-02-21 Zhisheng Tang , Mayank Kejriwal

One of the latest applications of Artificial Intelligence (AI) is to generate images from natural language descriptions. These generators are now becoming available and achieve impressive results that have been used for example in the front…

Computation and Language · Computer Science 2022-11-18 Pedro Reviriego , Elena Merino-Gómez

Text-to-image AI are capable of generating novel images for inspiration, but their applications for 3D design workflows and how designers can build 3D models using AI-provided inspiration have not yet been explored. To investigate this, we…

Human-Computer Interaction · Computer Science 2023-08-02 Vivian Liu , Jo Vermeulen , George Fitzmaurice , Justin Matejka

Recent generative models can synthesize "views" of artificial images that mimic real-world variations, such as changes in color or pose, simply by learning from unlabeled image collections. Here, we investigate whether such views can be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Lucy Chai , Jun-Yan Zhu , Eli Shechtman , Phillip Isola , Richard Zhang

During the last two years there has been a plethora of large generative models such as ChatGPT or Stable Diffusion that have been published. Concretely, these models are able to perform tasks such as being a general question and answering…

Machine Learning · Computer Science 2023-01-13 Roberto Gozalo-Brizuela , Eduardo C. Garrido-Merchan

Text-to-Image and Text-to-Video AI generation models are revolutionary technologies that use deep learning and natural language processing (NLP) techniques to create images and videos from textual descriptions. This paper investigates…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Aditi Singh

In the current era of generative AI breakthroughs, generating panoramic scenes from a single input image remains a key challenge. Most existing methods use diffusion-based iterative or simultaneous multi-view inpainting. However, the lack…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zhipeng Cai , Matthias Mueller , Reiner Birkl , Diana Wofk , Shao-Yen Tseng , JunDa Cheng , Gabriela Ben-Melech Stan , Vasudev Lal , Michael Paulitsch

Diffusion-based text-to-image generation models like GLIDE and DALLE-2 have gained wide success recently for their superior performance in turning complex text inputs into images of high quality and wide diversity. In particular, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Zhihong Pan , Xin Zhou , Hao Tian

The field of multimodal research focusing on the comprehension and creation of both images and text has witnessed significant strides. This progress is exemplified by the emergence of sophisticated models dedicated to image captioning at…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Hang Li , Jindong Gu , Rajat Koner , Sahand Sharifzadeh , Volker Tresp

The emergence of ChatGPT has once again sparked research in generative artificial intelligence (GAI). While people have been amazed by the generated results, they have also noticed the reasoning potential reflected in the generated textual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Xiaochuan Li , Baoyu Fan , Runze Zhang , Liang Jin , Di Wang , Zhenhua Guo , Yaqian Zhao , Rengang Li

The rapid advancements in AI technologies have revolutionized the production of graphical content across various sectors, including entertainment, advertising, and e-commerce. These developments have spurred the need for robust evaluation…

Human-Computer Interaction · Computer Science 2024-09-04 Memoona Aziz , Umair Rehman , Syed Ali Safi , Amir Zaib Abbasi

Deep Learning models are incredibly data-hungry and require very large labeled datasets for supervised learning. As a consequence, these models often suffer from overfitting, limiting their ability to generalize to real-world examples.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Sahiti Yerramilli , Jayant Sravan Tamarapalli , Tanmay Girish Kulkarni , Jonathan Francis , Eric Nyberg

We provide an overview of the diffusion model as a method to generate new samples. Generative models have been recently adopted for tasks such as art generation (Stable Diffusion, Dall-E) and text generation (ChatGPT). Diffusion models in…

Machine Learning · Statistics 2025-06-13 Justin Le

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

Attaining a high degree of user controllability in visual generation often requires intricate, fine-grained inputs like layouts. However, such inputs impose a substantial burden on users when compared to simple text inputs. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Weixi Feng , Wanrong Zhu , Tsu-jui Fu , Varun Jampani , Arjun Akula , Xuehai He , Sugato Basu , Xin Eric Wang , William Yang Wang