English
Related papers

Related papers: BlackBox Toolkit: Intelligent Assistance to UI Des…

200 papers

Artificial intelligence (AI) presents new challenges for the user experience (UX) of products and services. Recently, practitioner-facing resources and design guidelines have become available to ease some of these challenges. However,…

Human-Computer Interaction · Computer Science 2023-04-21 Nur Yildirim , Mahima Pushkarna , Nitesh Goyal , Martin Wattenberg , Fernanda Viegas

Despite the potential of generative AI (GenAI) design tools to enhance design processes, professionals often struggle to integrate AI into their workflows. Fundamental cognitive challenges include the need to specify all design criteria as…

Human-Computer Interaction · Computer Science 2025-06-17 Frederic Gmeiner , Kaitao Luo , Ye Wang , Kenneth Holstein , Nikolas Martelaro

When AI systems are granted the agency to take impactful actions in the real world, there is an inherent risk that these systems behave in ways that are harmful. Typically, humans specify constraints on the AI system to prevent harmful…

Human-Computer Interaction · Computer Science 2022-11-09 Travis Mandel , Jahnu Best , Randall H. Tanaka , Hiram Temple , Chansen Haili , Kayla Schlectinger , Roy Szeto

We examined the effectiveness of various human-AI collaboration designs on creative work. Through a human subjects experiment set in the context of creative writing, we found that while AI assistance improved productivity across all models,…

Human-Computer Interaction · Computer Science 2025-01-31 Kartik Hosanagar , Daehwan Ahn

Design thrives on feedback. However, gathering constant feedback throughout the design process can be labor-intensive and disruptive. We explore how AI can bridge this gap by providing effortless, ambient feedback. We introduce FeedQUAC, a…

Human-Computer Interaction · Computer Science 2025-04-24 Tao Long , Kendra Wannamaker , Jo Vermeulen , George Fitzmaurice , Justin Matejka

Interior design often struggles to capture the subtleties of client experience, leaving gaps between what clients feel and what designers can act upon. We present AIDED, a designer-AI co-design workflow that integrates multimodal client…

Human-Computer Interaction · Computer Science 2026-02-11 Yang Chen Lin , Chen-Ying Chen , Kai-Hsin Hou , Hung-Yu Chen , Po-Chih Kuo

As generative AI (GenAI) increasingly permeates design workflows, its impact on design outcomes and designers' creative capabilities warrants investigation. We conducted a within-subjects experiment where we asked participants to design…

Human-Computer Interaction · Computer Science 2024-11-04 Yue Fu , Han Bin , Tony Zhou , Marx Wang , Yixin Chen , Zelia Gomes Da Costa Lai , Jacob O. Wobbrock , Alexis Hiniker

Artificial Intelligence (AI) has significant potential for product design: AI can check technical and non-technical constraints on products, it can support a quick design of new product variants and new AI methods may also support…

Artificial Intelligence · Computer Science 2022-01-20 Philipp Rosenthal , Oliver Niggemann

This paper explores interaction designs for generative AI interfaces that necessitate human involvement throughout the generation process. We argue that such interfaces can promote cognitive engagement, agency, and thoughtful…

Human-Computer Interaction · Computer Science 2025-04-14 Kenneth C. Arnold , Jiho Kim

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning. However, users still face challenges when applying BBO methods to their problems at hand…

Machine Learning · Computer Science 2024-05-17 Huaijun Jiang , Yu Shen , Yang Li , Beicheng Xu , Sixian Du , Wentao Zhang , Ce Zhang , Bin Cui

This study examines the role of vagueness in the design process and its strategic management for the effective human-AI interaction. While vagueness in the generation of design ideas promotes diverse interpretations and prevents fixation,…

Human-Computer Interaction · Computer Science 2024-11-14 Myungjin Kim , Bogoan Kim , Kyungsik Han

At the current pace of technological advancements, Generative AI models, including both Large Language Models and Large Multi-modal Models, are becoming integral to the developer workspace. However, challenges emerge due to the 'black box'…

Software Engineering · Computer Science 2024-05-06 Gregorio Robles , Christoph Treude , Jesus M. Gonzalez-Barahona , Raula Gaikovina Kula

Generative AI (GenAI) models have become more capable than ever at augmenting productivity and cognition across diverse contexts. However, a fundamental challenge remains as users struggle to anticipate what AI will generate. As a result,…

Human-Computer Interaction · Computer Science 2025-04-17 Bryan Min , Haijun Xia

Machines are being increasingly used in decision-making processes, resulting in the realization that decisions need explanations. Unfortunately, an increasing number of these deployed models are of a 'black-box' nature where the reasoning…

Artificial Intelligence · Computer Science 2023-11-07 Sopam Dasgupta

Artificial Intelligence (AI) has become an important part of our everyday lives, yet user requirements for designing AI-assisted systems in law enforcement remain unclear. To address this gap, we conducted qualitative research on…

Concept designers in the entertainment industry create highly detailed, often imaginary environments for movies, games, and TV shows. Their early ideation phase requires intensive research, brainstorming, visual exploration, and combination…

Human-Computer Interaction · Computer Science 2025-02-21 Wen-Fan Wang , Chien-Ting Lu , Nil Ponsa Campanyà , Bing-Yu Chen , Mike Y. Chen

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems users can…

Human-Computer Interaction · Computer Science 2022-06-07 Jeba Rezwana , Mary Lou Maher

Recent advancements in artificial intelligence, such as computer vision and deep learning, have led to the emergence of numerous generative AI platforms, particularly for image generation. However, the application of AI-generated image…

Human-Computer Interaction · Computer Science 2024-06-21 Yuying Tang , Mariana Ciancia , Zhigang Wang , Ze Gao

The need for innovative ideas in data visualisation drives us to explore new creative approaches. Combining two or more creative words, particularly those that contradict each other, can positively impact the creative process, sparking…

Human-Computer Interaction · Computer Science 2024-09-05 Aron E. Owen , Jonathan C. Roberts

Menu system design for user interfaces is a challenging task involving many design options and various human factors. For example, one crucial factor that designers need to consider is the semantic and systematic relation of menu commands.…

Computation and Language · Computer Science 2024-07-09 Amir Hossein Kargaran , Nafiseh Nikeghbal , Abbas Heydarnoori , Hinrich Schütze