English
Related papers

Related papers: SketchConcept: Sketching-based Concept Recompositi…

200 papers

Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to…

Computers and Society · Computer Science 2024-02-20 Maddalena Torricelli , Mauro Martino , Andrea Baronchelli , Luca Maria Aiello

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

Generative AI (GenAI) models excel in their ability to recognize patterns in existing data and generate new and unexpected content. Recent advances have motivated applications of GenAI tools (e.g., Stable Diffusion, ChatGPT) to professional…

Human-Computer Interaction · Computer Science 2023-06-05 Matthew K. Hong , Shabnam Hakimi , Yan-Ying Chen , Heishiro Toyoda , Charlene Wu , Matt Klenk

In product design, a decomposition of the overall product function into a set of smaller, interacting functions is usually considered a crucial first step for any computer-supported design tool. Here, we propose a new approach for the…

Artificial Intelligence · Computer Science 2023-02-10 Philipp Rosenthal , Niels Demke , Frank Mantwill , Oliver Niggemann

Contemporary deep learning techniques have made image recognition a reasonably reliable technology. However training effective photo classifiers typically takes numerous examples which limits image recognition's scalability and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Conghui Hu , Da Li , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

Direct manipulation interfaces provide intuitive and interactive features to a broad range of users, but they often exhibit two limitations: the built-in features cannot possibly cover all use cases, and the internal representation of the…

Human-Computer Interaction · Computer Science 2019-07-26 Brian Hempel , Ravi Chugh

Modeling 3D avatars benefits various application scenarios such as AR/VR, gaming, and filming. Character faces contribute significant diversity and vividity as a vital component of avatars. However, building 3D character face models usually…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zhongjin Luo , Dong Du , Heming Zhu , Yizhou Yu , Hongbo Fu , Xiaoguang Han

The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for…

Human-Computer Interaction · Computer Science 2023-10-30 Ying Zang , Chaotao Ding , Tianrun Chen , Papa Mao , Wenjun Hu

State-of-the-art visual generative AI tools hold immense potential to assist users in the early ideation stages of creative tasks -- offering the ability to generate (rather than search for) novel and unprecedented (instead of existing)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Evans Xu Han , Alice Qian Zhang , Haiyi Zhu , Hong Shen , Paul Pu Liang , Jane Hsieh

Recent advancements in artificial intelligence, such as computer vision and deep learning, have led to the emergence of numerous generative AI platforms, particularly for image generation. However, the application of AI-generated image…

Human-Computer Interaction · Computer Science 2024-06-21 Yuying Tang , Mariana Ciancia , Zhigang Wang , Ze Gao

Deep learning-based sketch-to-clothing image generation provides the initial designs and inspiration in the fashion design processes. However, clothing generation from freehand drawing is challenging due to the sparse and ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Yongming Zhang , Tianyu Zhang , Haoran Xie

The visual representation of concepts or ideas through the use of simple shapes has always been explored in the history of Humanity, and it is believed to be the origin of writing. We focus on computational generation of visual symbols to…

Graphics · Computer Science 2017-08-01 João Miguel Cunha , Pedro Martins , Amílcar Cardoso , Penousal Machado

Text-to-image models are enabling efficient design space exploration, rapidly generating images from text prompts. However, many generative AI tools are imperfect for product design applications as they are not built for the goals and…

Human-Computer Interaction · Computer Science 2025-01-22 Leah Chong , I-Ping Lo , Jude Rayan , Steven Dow , Faez Ahmed , Ioanna Lykourentzou

Extracting semantic representations from mobile user interfaces (UI) and using the representations for designers' decision-making processes have shown the potential to be effective computational design support tools. Current approaches rely…

Human-Computer Interaction · Computer Science 2023-09-20 Seokhyeon Park , Wonjae Kim , Young-Ho Kim , Jinwook Seo

Evaluating generative AI (GenAI) systems is challenging because many targets of evaluation are broad, contested concepts, such as "reasoning," "fairness," or "creativity." When these concepts are left underspecified, it becomes unclear what…

We present CoGS, a novel method for the style-conditioned, sketch-driven synthesis of images. CoGS enables exploration of diverse appearance possibilities for a given sketched object, enabling decoupled control over the structure and the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Cusuh Ham , Gemma Canet Tarres , Tu Bui , James Hays , Zhe Lin , John Collomosse

The process of fashion design usually involves sketching, refining, and coloring, with designers drawing inspiration from various images to fuel their creative endeavors. However, conventional image search methods often yield irrelevant…

Human-Computer Interaction · Computer Science 2024-10-01 Jianan Jiang , Di Wu , Hanhui Deng , Yidan Long , Wenyi Tang , Xiang Li , Can Liu , Zhanpeng Jin , Wenlei Zhang , Tangquan Qi

Generating images from hand-drawings is a crucial and fundamental task in content creation. The translation is difficult as there exist infinite possibilities and the different users usually expect different outcomes. Therefore, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Shin-I Cheng , Yu-Jie Chen , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

This paper, for the very first time, introduces human sketches to the landscape of XAI (Explainable Artificial Intelligence). We argue that sketch as a ``human-centred'' data form, represents a natural interface to study explainability. We…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Zhiyu Qu , Yulia Gryaditskaya , Ke Li , Kaiyue Pang , Tao Xiang , Yi-Zhe Song