English
Related papers

Related papers: Improving User Interface Generation Models from De…

200 papers

Despite their unprecedented success, even the largest language models make mistakes. Similar to how humans learn and improve using feedback, previous work proposed providing language models with natural language feedback to guide them in…

Computation and Language · Computer Science 2023-07-13 Afra Feyza Akyürek , Ekin Akyürek , Aman Madaan , Ashwin Kalyan , Peter Clark , Derry Wijaya , Niket Tandon

Automated feedback generation has the potential to enhance students' learning progress by providing timely and targeted feedback. Moreover, it can assist teachers in optimizing their time, allowing them to focus on more strategic and…

Computation and Language · Computer Science 2025-08-18 Sylvio Rüdian , Yassin Elsir , Marvin Kretschmer , Sabine Cayrou , Niels Pinkwart

Natural language (NL) feedback offers rich insights into user experience. While existing studies focus on an instance-level approach, where feedback is used to refine specific examples, we introduce a framework for system-level use of NL…

Computation and Language · Computer Science 2024-02-06 Weizhe Yuan , Kyunghyun Cho , Jason Weston

Graphical user interface (GUI) prototyping represents an essential activity in the development of interactive systems, which are omnipresent today. GUI prototypes facilitate elicitation of requirements and help to test, evaluate, and…

Software Engineering · Computer Science 2024-12-17 Kristian Kolthoff , Felix Kretzer , Lennart Fiebig , Christian Bartelt , Alexander Maedche , Simone Paolo Ponzetto

Reinforcement Learning with Human Feedback (RLHF) has been demonstrated to significantly enhance the performance of large language models (LLMs) by aligning their outputs with desired human values through instruction tuning. However, RLHF…

Computation and Language · Computer Science 2024-03-06 Zhang Ze Yu , Lau Jia Jaw , Zhang Hui , Bryan Kian Hsiang Low

Large language models (LLMs) are increasingly used to generate feedback, yet their impact on learning remains underexplored, especially compared to existing feedback methods. This study investigates how on-demand LLM-generated explanatory…

Computation and Language · Computer Science 2025-06-23 Danielle R. Thomas , Conrad Borchers , Shambhavi Bhushan , Erin Gatz , Shivang Gupta , Kenneth R. Koedinger

Large Language Models (LLMs) can generate functional source code from natural-language prompts, but often fail to consistently follow higher-level architectural structures or design patterns. Since LLMs are increasingly used in software…

Software Engineering · Computer Science 2026-05-27 Viktor Kjellberg , Farnaz Fotrousi , Miroslaw Staron

Conversational recommender systems (CRS) based on Large Language Models (LLMs) need to constantly be aligned to the user preferences to provide satisfying and context-relevant item recommendations. The traditional supervised fine-tuning…

Machine Learning · Computer Science 2025-08-08 Zhongheng Yang , Aijia Sun , Yushang Zhao , Yinuo Yang , Dannier Li , Chengrui Zhou

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of…

Human-Computer Interaction · Computer Science 2025-10-30 Mingyue Yuan , Jieshan Chen , Yongquan Hu , Sidong Feng , Mulong Xie , Gelareh Mohammadi , Zhenchang Xing , Aaron Quigley

Feedback on user interface (UI) mockups is crucial in design. However, human feedback is not always readily available. We explore the potential of using large language models for automatic feedback. Specifically, we focus on applying GPT-4…

Human-Computer Interaction · Computer Science 2024-03-21 Peitong Duan , Jeremy Warner , Yang Li , Bjoern Hartmann

LLM-generated drafts often contain subtle factual or logical errors, yet prior work shows that models struggle to reliably integrate multi-turn feedback aimed at fixing them. We propose in-place feedback, an interaction paradigm in which…

Machine Learning · Computer Science 2026-05-29 Youngbin Choi , Minjong Lee , Saemi Moon , Seunghyuk Cho , Chaehyeon Chung , MoonJeong Park , Dongwoo Kim

Large language models (LLMs) show strong potential to support creative tasks, but the role of the interface design is poorly understood. In particular, the effect of different modes of collaboration between humans and LLMs on co-creation…

Human-Computer Interaction · Computer Science 2026-03-10 Sebastian Maier , Manuel Schneider , Stefan Feuerriegel

Background: Feedback as one of the most influential factors for learning has been subject to a great body of research. It plays a key role in the development of educational technology systems and is traditionally rooted in deterministic…

Artificial Intelligence · Computer Science 2024-12-05 Dominic Lohr , Hieke Keuning , Natalie Kiesler

Aligning large language models (LLMs) with human preferences is crucial for enhancing their utility in terms of helpfulness, truthfulness, safety, harmlessness, and interestingness. Existing methods for achieving this alignment often…

Computation and Language · Computer Science 2024-07-04 Wenhao Liu , Xiaohua Wang , Muling Wu , Tianlong Li , Changze Lv , Zixuan Ling , Jianhao Zhu , Cenyuan Zhang , Xiaoqing Zheng , Xuanjing Huang

Large language models (LLMs) show promise for automatically generating feedback in education settings. However, it remains unclear how specific feedback elements, such as tone and information coverage, contribute to learning outcomes and…

Computation and Language · Computer Science 2026-02-13 Momoka Furuhashi , Kouta Nakayama , Noboru Kawai , Takashi Kodama , Saku Sugawara , Kyosuke Takami

Can LLMs provide support to creative writers by giving meaningful writing feedback? In this paper, we explore the challenges and limitations of model-generated writing feedback by defining a new task, dataset, and evaluation frameworks. To…

Computation and Language · Computer Science 2025-07-23 Hannah Rashkin , Elizabeth Clark , Fantine Huot , Mirella Lapata

[Context and Motivation] Online user feedback provides valuable information to support requirements engineering (RE). However, analyzing online user feedback is challenging due to its large volume and noise. Large language models (LLMs)…

Software Engineering · Computer Science 2025-10-28 Manjeshwar Aniruddh Mallya , Alessio Ferrari , Mohammad Amin Zadenoori , Jacek Dąbrowski

Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platforms has the potential to improve the learning outcomes of many students. However, both feedback generation and…

Computation and Language · Computer Science 2024-12-13 Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan

In an ideal design pipeline, user interface (UI) design is intertwined with user research to validate decisions, yet studies are often resource-constrained during early exploration. Recent advances in multimodal large language models…

Generative AI and large language models hold great promise in enhancing programming education by generating individualized feedback and hints for learners. Recent works have primarily focused on improving the quality of generated feedback…

Machine Learning · Computer Science 2025-03-10 Nachiket Kotalwar , Alkis Gotovos , Adish Singla