English
Related papers

Related papers: Generative and Malleable User Interfaces with Gene…

200 papers

Prompting-based user interfaces (UIs) shift the task of defining and accessing relevant functions from developers to users. However, how UIs shape this flexibility has not yet been investigated explicitly. We explored interaction with Large…

Human-Computer Interaction · Computer Science 2024-10-15 Florian Lehmann , Daniel Buschek

This study introduces an adaptive user interface generation technology, emphasizing the role of Human-Computer Interaction (HCI) in optimizing user experience. By focusing on enhancing the interaction between users and intelligent systems,…

Human-Computer Interaction · Computer Science 2024-12-24 Qi Sun , Yayun Xue , Zhijun Song

Web accessibility rests on static standards and developer compliance. That model frays in platforms where content is user-generated: photos arrive blurry or off-frame, descriptions skip size and condition, and page structure shifts from…

Human-Computer Interaction · Computer Science 2026-04-29 Bektur Ryskeldiev

Generative AI brings novel and impressive abilities to help people in everyday tasks. There are many AI workflows that solve real and complex problems by chaining AI outputs together with human interaction. Although there is an undeniable…

Human-Computer Interaction · Computer Science 2024-06-03 Tao Long , Katy Ilonka Gero , Lydia B. Chilton

Generative AI models are capable of performing a wide variety of tasks that have traditionally required creativity and human understanding. During training, they learn patterns from existing data and can subsequently generate new content…

Random graph models are frequently used as a controllable and versatile data source for experimental campaigns in various research fields. Generating such data-sets at scale is a non-trivial task as it requires design decisions typically…

Data Structures and Algorithms · Computer Science 2020-03-03 Manuel Penschuck , Ulrik Brandes , Michael Hamann , Sebastian Lamm , Ulrich Meyer , Ilya Safro , Peter Sanders , Christian Schulz

This paper is an opinion paper that looks at the future of computing in the age of Generative \& Agentic AI. Current software systems are static and inflexible, leading to significant challenges in translating human goals into computational…

Software Engineering · Computer Science 2024-08-06 Jules White

New systems employ Machine Learning to sift through large knowledge sources, creating flexible Large Language Models. These models discern context and predict sequential information in various communication forms. Generative AI, leveraging…

Artificial Intelligence · Computer Science 2023-07-19 Ted Selker

At its core, information access and seeking is an interactive process. In existing search engines, interactions are limited to a few pre-defined actions, such as "requery", "click on a document", "scrolling up/down", "going to the next…

Information Retrieval · Computer Science 2024-07-17 Mohammad Aliannejadi , Jacek Gwizdka , Hamed Zamani

As generative artificial intelligence advances, Large Language Models (LLMs) are being explored for automated graphical user interface (GUI) design. This study investigates the usability and adaptability of LLM-generated interfaces by…

Human-Computer Interaction · Computer Science 2026-02-02 Bartosz Sawicki , Tomasz Les , Dariusz Parzych , Aleksandra Wycisk-Ficek , Pawel Trebacz , Pawel Zawadzki

Generative AI systems have entered everyday academic, professional, and personal life with remarkable speed, yet most users encounter them as mysterious artifacts rather than intelligible systems. This chapter discusses large language…

Computers and Society · Computer Science 2026-04-21 John T. Behrens

Developing user-centred applications that address diverse user needs requires rigorous user research. This is time, effort and cost-consuming. With the recent rise of generative AI techniques based on Large Language Models (LLMs), there is…

Human-Computer Interaction · Computer Science 2024-04-09 Yutan Huang , Tanjila Kanij , Anuradha Madugalla , Shruti Mahajan , Chetan Arora , John Grundy

Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI…

Human-Computer Interaction · Computer Science 2024-05-03 Zijian Ding

Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to…

Computers and Society · Computer Science 2024-02-20 Maddalena Torricelli , Mauro Martino , Andrea Baronchelli , Luca Maria Aiello

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

While deep generative models are showing exciting abilities in computer vision and natural language processing, their adoption in communication frameworks is still far underestimated. These methods are demonstrated to evolve solutions to…

Computation and Language · Computer Science 2024-01-17 Eleonora Grassucci , Jihong Park , Sergio Barbarossa , Seong-Lyun Kim , Jinho Choi , Danilo Comminiello

Generative AI is reshaping how software is designed, written, and maintained. Advances in large language models (LLMs) are enabling new development styles - from chat-oriented programming and 'vibe coding' to agentic programming - that can…

Software Engineering · Computer Science 2025-10-14 Vivek Acharya

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of…

Human-Computer Interaction · Computer Science 2025-10-30 Mingyue Yuan , Jieshan Chen , Yongquan Hu , Sidong Feng , Mulong Xie , Gelareh Mohammadi , Zhenchang Xing , Aaron Quigley

This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance…

Artificial Intelligence · Computer Science 2024-09-30 Jeevana Priya Inala , Chenglong Wang , Steven Drucker , Gonzalo Ramos , Victor Dibia , Nathalie Riche , Dave Brown , Dan Marshall , Jianfeng Gao

As personal agents evolve to handle complex, user-centric tasks, static plain-text chat is rapidly becoming a bottleneck. Generative UI emerges as the necessary new interface layer, dynamically synthesizing the right controls, options, and…

Human-Computer Interaction · Computer Science 2026-05-26 Fancy Kong , Congjie Zheng , Murphy Zhuang , Rio Yang , Sueky Zhang , Hao Fu , Gene Jin , Song Cao , Kaijie Chen , Andrew Chen , Pony Ma