English
Related papers

Related papers: Steering Large Text-to-Image Model for Abstract Ar…

200 papers

Generative Artificial Intelligence (GenAI) has emerged as a fundamental component of intelligent interactive systems, enabling the automatic generation of multimodal media content. The continuous enhancement in the quality of Artificial…

Human-Computer Interaction · Computer Science 2024-07-23 Yongquan Hu , Dawen Zhang , Mingyue Yuan , Kaiqi Xian , Don Samitha Elvitigala , June Kim , Gelareh Mohammadi , Zhenchang Xing , Xiwei Xu , Aaron Quigley

Conditional text-to-image generation is an active area of research, with many possible applications. Existing research has primarily focused on generating a single image from available conditioning information in one step. One practical…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Alaaeldin El-Nouby , Shikhar Sharma , Hannes Schulz , Devon Hjelm , Layla El Asri , Samira Ebrahimi Kahou , Yoshua Bengio , Graham W. Taylor

Text-to-image (T2I) generation has greatly enhanced creative expression, yet achieving preference-aligned generation in a real-time and training-free manner remains challenging. Previous methods often rely on static, pre-collected…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yang Li , Songlin Yang , Xiaoxuan Han , Wei Wang , Jing Dong , Yueming Lyu , Ziyu Xue

Artistic style transfer, a captivating application of generative artificial intelligence, involves fusing the content of one image with the artistic style of another to create unique visual compositions. This paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jonayet Miah , Duc M Cao , Md Abu Sayed , Md. Sabbirul Haque

The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Shweta Mahajan , Tanzila Rahman , Kwang Moo Yi , Leonid Sigal

Prompting approaches have been recently explored in text style transfer, where a textual prompt is used to query a pretrained language model to generate style-transferred texts word by word in an autoregressive manner. However, such a…

Computation and Language · Computer Science 2023-12-25 Guoqing Luo , Yu Tong Han , Lili Mou , Mauajama Firdaus

Recent advancements in generative artificial intelligence (generative AI) technologies have transformed the computer science discipline of natural language processing. However, generative AI retains the anthropomorphic model of simulating…

Computers and Society · Computer Science 2026-03-03 Dejan Grba , Vladimir Todorović

This paper aims to explore a generative approach for knowledge-based design ideation by applying the latest pre-trained language models in artificial intelligence (AI). Specifically, a method of fine-tuning the generative pre-trained…

Computation and Language · Computer Science 2022-04-21 Qihao Zhu , Jianxi Luo

Generative AIs produce creative outputs in the style of human expression. We argue that encounters with the outputs of modern generative AI models are mediated by the same kinds of aesthetic judgments that organize our interactions with…

Computers and Society · Computer Science 2023-09-25 Jessica Hullman , Ari Holtzman , Andrew Gelman

This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance or type of outfit worn by the user. This is a difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xu Chen , Jie Song , Otmar Hilliges

This pictorial presents an ongoing research programme comprising three practice-based Design Research projects conducted through 2024, exploring the affordances of diffusion-based AI image generation systems, specifically Stable Diffusion.…

Human-Computer Interaction · Computer Science 2024-11-21 Joseph Lindley , Roger Whitham

Text-conditioned image generation models are a prevalent use of AI image synthesis, yet intuitively controlling output guided by an artist remains challenging. Current methods require multiple images and textual prompts for each object to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Shounak Chatterjee

As generative AI systems rapidly improve, a key question emerges: how do users adapt to these changes, and when does such adaptation matter for realizing performance gains? Drawing on theories of dynamic capabilities and IT complements, we…

Human-Computer Interaction · Computer Science 2026-01-08 Eaman Jahani , Benjamin S. Manning , Joe Zhang , Hong-Yi TuYe , Mohammed Alsobay , Christos Nicolaides , Siddharth Suri , David Holtz

Currently, personalized image generation methods mostly require considerable time to finetune and often overfit the concept resulting in generated images that are similar to custom concepts but difficult to edit by prompts. We propose an…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Zhang , Yiren Song , Jinpeng Yu , Han Pan , Zhongliang Jing

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

Mitigating biases in generative AI and, particularly in text-to-image models, is of high importance given their growing implications in society. The biased datasets used for training pose challenges in ensuring the responsible development…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Carolina Lopez Olmos , Alexandros Neophytou , Sunando Sengupta , Dim P. Papadopoulos

Creating meaningful art is often viewed as a uniquely human endeavor. A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Konstantin Dobler , Florian Hübscher , Jan Westphal , Alejandro Sierra-Múnera , Gerard de Melo , Ralf Krestel

The rapid growth of the Internet, driven by social media, web browsing, and video streaming, has made images central to the Web experience, resulting in significant data transfer and increased webpage sizes. Traditional image compression…

Networking and Internet Architecture · Computer Science 2024-07-08 Shayan Ali Hassan , Danish Humair , Ihsan Ayyub Qazi , Zafar Ayyub Qazi

We present a framework for automating generative deep learning with a specific focus on artistic applications. The framework provides opportunities to hand over creative responsibilities to a generative system as targets for automation. For…

Machine Learning · Computer Science 2021-07-06 Sebastian Berns , Terence Broad , Christian Guckelsberger , Simon Colton

Personalized text-to-image generation has attracted unprecedented attention in the recent few years due to its unique capability of generating highly-personalized images via using the input concept dataset and novel textual prompt. However,…

Artificial Intelligence · Computer Science 2024-07-02 Shian Du , Xiaotian Cheng , Qi Qian , Henglu Wei , Yi Xu , Xiangyang Ji