English
Related papers

Related papers: Modeling Artistic Workflows for Image Generation a…

200 papers

Assessing the artness of AI-generated images continues to be a challenge within the realm of image generation. Most existing metrics cannot be used to perform instance-level and reference-free artness evaluation. This paper presents…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Junyu Chen , Jie An , Hanjia Lyu , Christopher Kanan , Jiebo Luo

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

Graphics · Computer Science 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

Text-to-image models are powerful tools for image creation. However, the generation process is akin to a dice roll and makes it difficult to achieve a single image that captures everything a user wants. In this paper, we propose a framework…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sean J. Liu , Nupur Kumari , Ariel Shamir , Jun-Yan Zhu

Image generation using generative AI is rapidly becoming a major new source of visual media, with billions of AI generated images created using diffusion models such as Stable Diffusion and Midjourney over the last few years. In this paper…

Human-Computer Interaction · Computer Science 2024-01-29 Jon McCormack , Maria Teresa Llano , Stephen James Krol , Nina Rajcic

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

While recent advances in image editing have enabled impressive visual synthesis capabilities, current methods remain constrained by explicit textual instructions and limited editing operations, lacking deep comprehension of implicit user…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Dong Zhang , Lingfeng He , Rui Yan , Fei Shen , Jinhui Tang

Image generation using diffusion can be controlled in multiple ways. In this paper, we systematically analyze the equations of modern generative diffusion networks to propose a framework, called MDP, that explains the design space of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Qian Wang , Biao Zhang , Michael Birsak , Peter Wonka

Large data-driven image models are extensively used to support creative and artistic work. Under the currently predominant distribution-fitting paradigm, a dataset is treated as ground truth to be approximated as closely as possible. Yet,…

Machine Learning · Computer Science 2023-06-16 Sebastian Berns , Simon Colton , Christian Guckelsberger

The fashion industry has diverse applications in multi-modal image generation and editing. It aims to create a desired high-fidelity image with the multi-modal conditional signal as guidance. Most existing methods learn different condition…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Zhikang Li , Huiling Zhou , Shuai Bai , Peike Li , Chang Zhou , Hongxia Yang

In this work, we consider the typography generation task that aims at producing diverse typographic styling for the given graphic document. We formulate typography generation as a fine-grained attribute generation for multiple text elements…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Wataru Shimoda , Daichi Haraguchi , Seiichi Uchida , Kota Yamaguchi

There is a delicate balance between automating repetitive work in creative domains while staying true to an artist's vision. The animation industry regularly outsources large animation workloads to foreign countries where labor is…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Harrish Thasarathan , Mehran Ebrahimi

Generative AI (GenAI) is transforming filmmaking, equipping artists with tools like text-to-image and image-to-video diffusion, neural radiance fields, avatar generation, and 3D synthesis. This paper examines the adoption of these…

Prior methods for controlling image generation are limited in their ability to be taught new tasks. In contrast, vision-language models, or VLMs, can learn tasks in-context and produce the correct outputs for a given input. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Grace Luo , Jonathan Granskog , Aleksander Holynski , Trevor Darrell

The advent of artificial intelligence has contributed in a groundbreaking transformation of the fashion industry, redefining creativity and innovation in unprecedented ways. This work investigates methodologies for generating tailored…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Georgia Argyrou , Angeliki Dimitriou , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Diffusion models arise as a powerful generative tool recently. Despite the great progress, existing diffusion models mainly focus on uni-modal control, i.e., the diffusion process is driven by only one modality of condition. To further…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Ziqi Huang , Kelvin C. K. Chan , Yuming Jiang , Ziwei Liu

Recent advances in generative models have produced strong results for static 3D shapes, whereas articulated 3D generation remains challenging due to action-dependent deformations and limited datasets. We introduce ArticFlow, a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Jiong Lin , Jinchen Ruan , Hod Lipson

We describe a guided proceduralization framework that optimizes geometry processing on architectural input models to extract target grammars. We aim to provide efficient artistic workflows by creating procedural representations from…

Graphics · Computer Science 2018-07-10 Ilke Demir , Daniel G. Aliaga

Image-to-poster generation is a high-demand task requiring not only local adjustments but also high-level design understanding. Models must generate text, layout, style, and visual elements while preserving semantic fidelity and aesthetic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Sixiang Chen , Jianyu Lai , Jialin Gao , Hengyu Shi , Zhongying Liu , Tian Ye , Junfeng Luo , Xiaoming Wei , Lei Zhu

Realistic visual renderings of street-design scenarios are essential for public engagement in active transportation planning. Traditional approaches are labor-intensive, hindering collective deliberation and collaborative decision-making.…

Artificial Intelligence · Computer Science 2026-03-18 Chenguang Wang , Xiang Yan , Yilong Dai , Ziyi Wang , Susu Xu

Traditional visualisation designers often start with sketches before implementation. With generative AI, these sketches can be turned into AI-generated visualisations using specific prompts. However, guiding AI to create compelling visuals…

Human-Computer Interaction · Computer Science 2024-09-04 Aron E. Owen , Jonathan C. Roberts