English
Related papers

Related papers: Automatic Measures for Evaluating Generative Desig…

200 papers

Realistic visual renderings of street-design scenarios are essential for public engagement in active transportation planning. Traditional approaches are labor-intensive, hindering collective deliberation and collaborative decision-making.…

Artificial Intelligence · Computer Science 2026-03-18 Chenguang Wang , Xiang Yan , Yilong Dai , Ziyi Wang , Susu Xu

State-of-the-art visual generative AI tools hold immense potential to assist users in the early ideation stages of creative tasks -- offering the ability to generate (rather than search for) novel and unprecedented (instead of existing)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Evans Xu Han , Alice Qian Zhang , Haiyi Zhu , Hong Shen , Paul Pu Liang , Jane Hsieh

Text-to-image (T2I) models are increasingly used in impactful real-life applications. As such, there is a growing need to audit these models to ensure that they generate desirable, task-appropriate images. However, systematically inspecting…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Salma Abdel Magid , Weiwei Pan , Simon Warchol , Grace Guo , Junsik Kim , Mahia Rahman , Hanspeter Pfister

Generative AIs produce creative outputs in the style of human expression. We argue that encounters with the outputs of modern generative AI models are mediated by the same kinds of aesthetic judgments that organize our interactions with…

Computers and Society · Computer Science 2023-09-25 Jessica Hullman , Ari Holtzman , Andrew Gelman

As the use of text-to-image generative models increases, so does the adoption of automatic benchmarking methods used in their evaluation. However, while metrics and datasets abound, there are few unified benchmarking libraries that provide…

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

In this paper, we conduct a study on the state-of-the-art methods for text-to-image synthesis and propose a framework to evaluate these methods. We consider syntheses where an image contains a single or multiple objects. Our study outlines…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Tan M. Dinh , Rang Nguyen , Binh-Son Hua

This review surveys the state-of-the-art in text-to-image and image-to-image generation within the scope of generative AI. We provide a comparative analysis of three prominent architectures: Variational Autoencoders, Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Zineb Sordo , Eric Chagnon , Daniela Ushizima

In this work, we systematically study the problem of personalized text-to-image generation, where the output image is expected to portray information about specific human subjects. E.g., generating images of oneself appearing at imaginative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Panos Achlioptas , Alexandros Benetatos , Iordanis Fostiropoulos , Dimitris Skourtis

The field of automatic image inpainting has progressed rapidly in recent years, but no one has yet proposed a standard method of evaluating algorithms. This absence is due to the problem's challenging nature: image-inpainting algorithms…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Ivan Molodetskikh , Mikhail Erofeev , Dmitry Vatolin

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

Many automatic attribute discovery methods have been developed to extract a set of visual attributes from images for various tasks. However, despite good performance in some image classification tasks, it is difficult to evaluate whether…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Liangchen Liu , Arnold Wiliem , Shaokang Chen , Brian C. Lovell

Recent generative AI advances present new possibilities for supporting visual art creation, but how such promise might assist novice artists during early-stage processes requires investigation. How novices adopt or resist these tools can…

Human-Computer Interaction · Computer Science 2025-10-01 Cindy Peng , Alice Qian , Linghao Jin , Jieneng Chen , Evans Xu Han , Paul Pu Liang , Hong Shen , Haiyi Zhu , Jane Hsieh

In recent years Generative Machine Learning systems have advanced significantly. A current wave of generative systems use text prompts to create complex imagery, video, even 3D datasets. The creators of these systems claim a revolution in…

Computers and Society · Computer Science 2023-02-03 Jon McCormack , Camilo Cruz Gambardella , Nina Rajcic , Stephen James Krol , Maria Teresa Llano , Meng Yang

Creative generation is the synthesis of new, surprising, and valuable samples that reflect user intent yet cannot be envisioned in advance. This task aims to extend human imagination, enabling the discovery of visual concepts that exist in…

Graphics · Computer Science 2025-10-14 Shelly Golan , Yotam Nitzan , Zongze Wu , Or Patashnik

Generative systems are becoming a crucial part of current design practice. There exist gaps however, between the digital processes, field data and designer's input. To solve this problem, multiple processes were developed in order to…

Graphics · Computer Science 2023-12-22 Demircan Tas , Osman Sumer

Recent years have seen considerable advances in audio synthesis with deep generative models. However, the state-of-the-art is very difficult to quantify; different studies often use different evaluation methodologies and different metrics…

Sound · Computer Science 2022-09-02 Ashvala Vinay , Alexander Lerch

In this work, we present some recommendations on the evaluation of state-of-the-art generative models for constrained generation tasks. The progress on generative models has been rapid in recent years. These large-scale models have had…

Human-Computer Interaction · Computer Science 2022-12-02 Vikas Raunak , Matt Post , Arul Menezes

A software architect uses quality requirements to design the architecture of a system. However, it is essential to ensure that the system's final architectural design achieves the standard quality requirements. The existing architectural…

Software Engineering · Computer Science 2021-05-21 Ritu Kapur , Sumit Kalra , Kamlesh Tiwari , Geetika Arora

With success on controlled tasks, generative models are being increasingly applied to humanitarian applications [1,2]. In this paper, we focus on the evaluation of a conditional generative model that illustrates the consequences of climate…

Machine Learning · Computer Science 2019-10-23 Sharon Zhou , Alexandra Luccioni , Gautier Cosne , Michael S. Bernstein , Yoshua Bengio