English
Related papers

Related papers: BlackBox Toolkit: Intelligent Assistance to UI Des…

200 papers

Generative UI is transforming interface design by facilitating AI-driven collaborative workflows between designers and computational systems. This study establishes a working definition of Generative UI through a multi-method qualitative…

Human-Computer Interaction · Computer Science 2025-05-22 Kyungho Lee

Storyboarding is an established method for designing user experiences. Generative AI can support this process by helping designers quickly create visual narratives. However, existing tools only focus on accurate text-to-image generation.…

Human-Computer Interaction · Computer Science 2024-07-11 Zhaohui Liang , Xiaoyu Zhang , Kevin Ma , Zhao Liu , Xipei Ren , Kosa Goucher-Lambert , Can Liu

Artificial intelligence (AI) systems capable of generating creative outputs are reshaping our understanding of creativity. This shift presents an opportunity for creativity researchers to reevaluate the key components of the creative…

Computers and Society · Computer Science 2024-12-09 Jaan Aru

In conventional software development, user experience (UX) designers and engineers collaborate through separation of concerns (SoC): designers create human interface specifications, and engineers build to those specifications. However, we…

Software Engineering · Computer Science 2022-07-06 Hariharan Subramonyam , Jane Im , Colleen Seifert , Eytan Adar

Human-Computer Interaction with the traditional User Interface is done using a specified in advance script dialog menu, mainly based on human intellect and unproductive use of navigation. This approach does not lead to making qualitative…

Human-Computer Interaction · Computer Science 2014-02-11 Ben Khayut , Lina Fabri , Maya Abukhana

Public sector agencies are rapidly deploying AI systems to augment or automate critical decisions in real-world contexts like child welfare, criminal justice, and public health. A growing body of work documents how these AI systems often…

Human-Computer Interaction · Computer Science 2024-03-06 Anna Kawakami , Amanda Coston , Haiyi Zhu , Hoda Heidari , Kenneth Holstein

Machine learning advances have afforded an increase in algorithms capable of creating art, music, stories, games, and more. However, it is not yet well-understood how machine learning algorithms might best collaborate with people to support…

Human-Computer Interaction · Computer Science 2019-01-23 Matthew Guzdial , Nicholas Liao , Jonathan Chen , Shao-Yu Chen , Shukan Shah , Vishwa Shah , Joshua Reno , Gillian Smith , Mark Riedl

As artificial intelligence (AI) continues to evolve from a back-end computational tool into an interactive, generative collaborator, its integration into early-stage design processes demands a rethinking of traditional workflows in…

Human-Computer Interaction · Computer Science 2025-07-25 Zhangqi Liu

Thinking of technology as a design material is appealing. It encourages designers to explore the material's properties to understand its capabilities and limitations, a prerequisite to generative design thinking. However, as a material, AI…

Human-Computer Interaction · Computer Science 2021-05-07 Hariharan Subramonyam , Colleen Seifert , Eytan Adar

While current chat-based AI assistants primarily operate reactively, responding only when prompted by users, there is significant potential for these systems to proactively assist in tasks without explicit invocation, enabling a…

Human-Computer Interaction · Computer Science 2025-03-03 Valerie Chen , Alan Zhu , Sebastian Zhao , Hussein Mozannar , David Sontag , Ameet Talwalkar

Users may face challenges while designing graphical user interfaces, due to a lack of relevant experience and guidance. This paper aims to investigate the issues that users with no experience face during the design process, and how to…

Human-Computer Interaction · Computer Science 2020-01-17 Chunggi Lee , Sanghoon Kim , Dongyun Han , Hongjun Yang , Young-Woo Park , Bum Chul Kwon , Sungahn Ko

Artificial intelligence (AI) is becoming increasingly more popular and can be found in workplaces and homes around the world. The decisions made by such "black box" systems are often opaque; that is, so complex as to be functionally…

Artificial Intelligence · Computer Science 2022-05-27 Rob Geada , Tommaso Teofili , Rui Vieira , Rebecca Whitworth , Daniele Zonca

Artificial intelligence (AI) is driving transformative changes across numerous fields, revolutionizing conventional processes and creating new opportunities for innovation. The development of mechatronic systems is undergoing a similar…

Designing and implementing explainable systems is seen as the next step towards increasing user trust in, acceptance of and reliance on Artificial Intelligence (AI) systems. While explaining choices made by black-box algorithms such as…

Multiagent Systems · Computer Science 2022-08-23 Sharadhi Alape Suryanarayana , David Sarne , Sarit Kraus

UX practitioners (UXPs) face novel challenges when working with and communicating artificial intelligence (AI) as a design material. We explore how UXPs communicate AI concepts when given hands-on experience training and experimenting with…

Human-Computer Interaction · Computer Science 2023-05-30 K. J. Kevin Feng , Maxwell James Coppock , David W. McDonald

Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to…

Computers and Society · Computer Science 2024-02-20 Maddalena Torricelli , Mauro Martino , Andrea Baronchelli , Luca Maria Aiello

As AI integrates into design practice, designers increasingly use generative AI tools to envision AI-enabled solutions, positioning AI as both design tool and design material. This dual role creates recursive value tensions distinct from…

Human-Computer Interaction · Computer Science 2026-05-04 Pitch Sinlapanuntakul , Aayushi Dangol , Xiaoyi Xue , Mark Zachry

Early-stage concept envisioning is a critical juncture in AI design, shaping how designers frame problems and the decisions that follow. Yet values and potential harms are often too abstract or addressed too late to meaningfully shape…

Human-Computer Interaction · Computer Science 2026-05-04 Pitch Sinlapanuntakul , Soyun Moon , Yuri Kawada , Yeha Chung , Mark Zachry

The significance and abundance of data are increasing due to the growing digital data generated from social media, sensors, scholarly literature, patents, different forms of documents published online, databases, product manuals, etc.…

Machine Learning · Computer Science 2022-05-23 Workneh Yilma Ayele

In this paper, we present a review of the recent work in deep learning methods for user interface design. The survey encompasses well known deep learning techniques (deep neural networks, convolutional neural networks, recurrent neural…

Human-Computer Interaction · Computer Science 2023-03-24 Subtain Malik , Muhammad Tariq Saeed , Marya Jabeen Zia , Shahzad Rasool , Liaquat Ali Khan , Mian Ilyas Ahmed