English
Related papers

Related papers: AlignUI: A Method for Designing LLM-Generated UIs …

200 papers

Large Language Models (LLMs) are increasingly used to simulate how specific users respond to a given context, enabling more user-centric applications that rely on user feedback. However, existing user simulators mostly imitate surface-level…

Computation and Language · Computer Science 2026-03-05 Shirley Wu , Evelyn Choi , Arpandeep Khatua , Zhanghan Wang , Joy He-Yueya , Tharindu Cyril Weerasooriya , Wei Wei , Diyi Yang , Jure Leskovec , James Zou

How to align large language models (LLMs) with user preferences from a static general dataset has been frequently studied. However, user preferences are usually personalized, changing, and diverse regarding culture, values, or time. This…

Computation and Language · Computer Science 2025-06-13 Zhaowei Zhang , Fengshuo Bai , Qizhi Chen , Chengdong Ma , Mingzhi Wang , Haoran Sun , Zilong Zheng , Yaodong Yang

Recent work in large language modeling (LLMs) has used fine-tuning to align outputs with the preferences of a prototypical user. This work assumes that human preferences are static and homogeneous across individuals, so that aligning to a a…

AI is growing increasingly capable of automatically generating user interfaces (GenUI) from user prompts. However, designing GenUI applications that enable users to discover diverse customizations while preserving GenUI's expressiveness…

Human-Computer Interaction · Computer Science 2026-01-27 Bryan Min , Peiling Jiang , Zhicheng Huang , Haijun Xia

Automated UI evaluation can be beneficial for the design process; for example, to compare different UI designs, or conduct automated heuristic evaluation. LLM-based UI evaluation, in particular, holds the promise of generalizability to a…

Human-Computer Interaction · Computer Science 2024-08-15 Peitong Duan , Chin-yi Chen , Gang Li , Bjoern Hartmann , Yang Li

Evaluating recommender systems remains challenging due to the gap between offline metrics and real user behavior, as well as the scarcity of interaction data. Recent work explores large language model (LLM) agents as synthetic users, yet…

Information Retrieval · Computer Science 2026-01-06 Nicolas Bougie , Gian Maria Marconi , Tony Yip , Narimasa Watanabe

Evaluating UX in the context of AI's complexity, unpredictability, and generative nature presents unique challenges. How can we support HCI researchers to create comprehensive UX evaluation plans? In this paper, we introduce EvAlignUX, a…

Human-Computer Interaction · Computer Science 2025-07-09 Qingxiao Zheng , Minrui Chen , Pranav Sharma , Yiliu Tang , Mehul Oswal , Yiren Liu , Yun Huang

In the rapidly evolving landscape of large language models (LLMs), most research has primarily viewed them as independent individuals, focusing on assessing their capabilities through standardized benchmarks and enhancing their general…

Human-Computer Interaction · Computer Science 2024-01-17 Jiayin Wang , Weizhi Ma , Peijie Sun , Min Zhang , Jian-Yun Nie

Group activities are important behaviors in human society, providing personalized recommendations for groups is referred to as the group recommendation task. Existing methods can usually be categorized into two strategies to infer group…

Information Retrieval · Computer Science 2024-09-05 Jinfeng Xu , Zheyu Chen , Jinze Li , Shuo Yang , Hewei Wang , Edith C. -H. Ngai

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

An important aspect of developing LLMs that interact with humans is to align models' behavior to their users. It is possible to prompt an LLM into behaving as a certain persona, especially a user group or ideological persona the model…

Computation and Language · Computer Science 2023-05-25 EunJeong Hwang , Bodhisattwa Prasad Majumder , Niket Tandon

AI models excel at creating content, but typically render it with static, predefined interfaces. Specifically, the output of LLMs is often a markdown "wall of text". Generative UI is a long standing promise, where the model generates not…

Environment designers in the entertainment industry create imaginative 2D and 3D scenes for games, films, and television, requiring both fine-grained control of specific details and consistent global coherence. Designers have increasingly…

Human-Computer Interaction · Computer Science 2025-09-03 Wen-Fan Wang , Ting-Ying Lee , Chien-Ting Lu , Che-Wei Hsu , Nil Ponsa Campanyà , Yu Chen , Mike Y. Chen , Bing-Yu Chen

Generative user interfaces (UIs) create new opportunities to adapt interfaces to individual users on demand, but personalization remains difficult because desirable UI properties are subjective, hard to articulate, and costly to infer from…

Machine Learning · Computer Science 2026-04-14 Yi-Hao Peng , Samarth Das , Jeffrey P. Bigham , Jason Wu

The growing capabilities of Artificial Intelligence (AI), particularly Large Language Models (LLMs), prompt a reassessment of the interaction mechanisms between users and their devices. Currently, users are required to use a set of…

Artificial Intelligence · Computer Science 2025-10-10 Justus Flerlage , Ilja Behnke , Odej Kao

Large Language Models (LLMs) are increasingly employed in software engineering tasks such as requirements elicitation, design, and evaluation, raising critical questions regarding their alignment with human judgments on responsible AI…

Software Engineering · Computer Science 2025-11-07 Asma Yamani , Malak Baslyman , Moataz Ahmed

Large language models (LLMs) enable end-users to delegate complex tasks to autonomous agents through natural language. However, prompt-based interaction faces critical limitations: Users often struggle to specify procedural requirements for…

Human-Computer Interaction · Computer Science 2025-10-14 Jiawen Li , Zheng Ning , Yuan Tian , Toby Jia-jun Li

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

Computation and Language · Computer Science 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on…

Computer Science and Game Theory · Computer Science 2026-05-13 Charlotte Park , Kate Donahue , Manish Raghavan