English
Related papers

Related papers: AlignUI: A Method for Designing LLM-Generated UIs …

200 papers

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

Recent advances in Large Language Models (LLMs) highlight the need to align their behaviors with human values. A critical, yet understudied, issue is the potential divergence between an LLM's stated preferences (its reported alignment with…

Artificial Intelligence · Computer Science 2025-06-03 Zhuojun Gu , Quan Wang , Shuchu Han

AI-generated content technologies are widely used in content creation. However, current AIGC systems rely heavily on creators' inspiration, rarely generating truly user-personalized content. In real-world applications such as online…

Information Retrieval · Computer Science 2025-08-26 Junyi Chen , Lu Chi , Siliang Xu , Shiwei Ran , Bingyue Peng , Zehuan Yuan

Aligning large language models (LLMs) with human intentions has become a critical task for safely deploying models in real-world systems. While existing alignment approaches have seen empirical success, theoretically understanding how these…

Machine Learning · Computer Science 2024-08-08 Shawn Im , Yixuan Li

Current human-AI alignment and evaluation methods for large language models (LLMs) often rely on preference signals collected immediately after an interaction. This practice implicitly treats preference as static, even though many…

Human-Computer Interaction · Computer Science 2026-05-06 Simret Araya Gebreegziabher , Allison E Sproul , Yinuo Yang , Chaoran Chen , Diego Gómez-Zará , Toby Jia-Jun Li

Large language models (LLMs) are increasingly used as reasoning modules in many applications. While they are efficient in certain tasks, LLMs often struggle to produce human-aligned solutions. Human-aligned decision making requires…

Artificial Intelligence · Computer Science 2026-05-14 Alina Hyk , Sandhya Saisubramanian

The applications of generative AI have become extremely impressive, and the interplay between users and AI is even more so. Current human-AI interaction literature has taken a broad look at how humans interact with generative AI, but it…

Recent advancements in open-source multi-modal large language models (MLLMs) have primarily focused on enhancing foundational capabilities, leaving a significant gap in human preference alignment. This paper introduces OmniAlign-V, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Xiangyu Zhao , Shengyuan Ding , Zicheng Zhang , Haian Huang , Maosong Cao , Weiyun Wang , Jiaqi Wang , Xinyu Fang , Wenhai Wang , Guangtao Zhai , Haodong Duan , Hua Yang , Kai Chen

User interface (UI) design goes beyond visuals to shape user experience (UX), underscoring the shift toward UI/UX as a unified concept. While recent studies have explored UI evaluation using Multimodal Large Language Models (MLLMs), they…

Computation and Language · Computer Science 2026-01-13 Jaehyun Jeon , Min Soo Kim , Jang Han Yoon , Sumin Shim , Yejin Choi , Hanbin Kim , Dae Hyun Kim , Youngjae Yu

Recent advances in generative AI for music have achieved remarkable fidelity and stylistic diversity, yet these systems often fail to align with nuanced human preferences due to the specific loss functions they use. This paper advocates for…

Sound · Computer Science 2025-11-20 Dorien Herremans , Abhinaba Roy

Different users find different images generated for the same prompt desirable. This gives rise to personalized image generation which involves creating images aligned with an individual's visual preference. Current generative models are,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Sogand Salehi , Mahdi Shafiei , Teresa Yeo , Roman Bachmann , Amir Zamir

Code Community Question Answering (CCQA) seeks to tackle programming-related issues, thereby boosting productivity in both software engineering and academic research. Recent advancements in Reinforcement Learning from Human Feedback (RLHF)…

Computation and Language · Computer Science 2024-06-04 Hongyu Yang , Liyang He , Min Hou , Shuanghong Shen , Rui Li , Jiahui Hou , Jianhui Ma , Junda Zhao

Alignment of Large Language Models (LLMs) remains an unsolved problem. Human preferences are highly distributed and can be captured at multiple levels of abstraction, from the individual to diverse populations. Organisational preferences,…

Machine Learning · Computer Science 2024-08-02 Gareth Seneque , Lap-Hang Ho , Ariel Kuperman , Nafise Erfanian Saeedi , Jeffrey Molendijk

Large Language Models (LLMs) have demonstrated remarkable capabilities, yet their transition to real-world applications reveals a critical limitation: the inability to adapt to individual preferences while maintaining alignment with…

Computation and Language · Computer Science 2025-05-06 Jian Guan , Junfei Wu , Jia-Nan Li , Chuanqi Cheng , Wei Wu

A critical factor in the success of decision support systems is the accurate modeling of user preferences. Psychology research has demonstrated that users often develop their preferences during the elicitation process, highlighting the…

Human-Computer Interaction · Computer Science 2024-10-03 Connor Lawless , Jakob Schoeffer , Lindy Le , Kael Rowan , Shilad Sen , Cristina St. Hill , Jina Suh , Bahareh Sarrafzadeh

Large language models (LLMs) struggle to consistently generate UI code that compiles and produces visually relevant designs. Existing approaches to improve generation rely on expensive human feedback or distilling a proprietary model. In…

Computation and Language · Computer Science 2024-06-13 Jason Wu , Eldon Schoop , Alan Leung , Titus Barik , Jeffrey P. Bigham , Jeffrey Nichols

Large Language Models (LLMs) excel in handling general knowledge tasks, yet they struggle with user-specific personalization, such as understanding individual emotions, writing styles, and preferences. Personalized Large Language Models…

Artificial Intelligence · Computer Science 2025-09-23 Jiahong Liu , Zexuan Qiu , Zhongyang Li , Quanyu Dai , Wenhao Yu , Jieming Zhu , Minda Hu , Menglin Yang , Tat-Seng Chua , Irwin King

Creativity is fundamentally human. As AI takes on more of the generative work that once required human imagination, despite documented limitations in creative ability, a critical question emerges: How does GenAI affect users' creativity?…

Human-Computer Interaction · Computer Science 2026-05-14 Zeinabsadat Saghi , Run Huang , Souti Chattopadhyay

Personalization plays a critical role in numerous language tasks and applications, since users with the same requirements may prefer diverse outputs based on their individual interests. This has led to the development of various…

Computation and Language · Computer Science 2024-09-19 Jiongnan Liu , Yutao Zhu , Shuting Wang , Xiaochi Wei , Erxue Min , Yu Lu , Shuaiqiang Wang , Dawei Yin , Zhicheng Dou

Although Multimodal Large Language Models (MLLMs) have been widely applied across domains, they are still facing challenges in domain-specific tasks, such as User Interface (UI) understanding accuracy and UI generation quality. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hao Yang , Weijie Qiu , Ru Zhang , Zhou Fang , Ruichao Mao , Xiaoyu Lin , Maji Huang , Zhaosong Huang , Teng Guo , Shuoyang Liu , Hai Rao