English
Related papers

Related papers: SpecifyUI: Supporting Iterative UI Design Intent E…

200 papers

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of…

Human-Computer Interaction · Computer Science 2025-10-30 Mingyue Yuan , Jieshan Chen , Yongquan Hu , Sidong Feng , Mulong Xie , Gelareh Mohammadi , Zhenchang Xing , Aaron Quigley

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI…

Human-Computer Interaction · Computer Science 2026-02-10 Seokhyeon Park , Soohyun Lee , Eugene Choi , Hyunwoo Kim , Minkyu Kweon , Yumin Song , Jinwook Seo

Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers…

Human-Computer Interaction · Computer Science 2025-01-29 Jialiang Wei , Anne-Lise Courbis , Thomas Lambolais , Gérard Dray , Walid Maalej

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

As Large Language Models increasingly automate complex, long-horizon tasks such as \emph{vibe coding}, a supervision gap has emerged. While models excel at execution, users often struggle to guide them effectively due to insufficient domain…

Artificial Intelligence · Computer Science 2026-02-09 Enyu Zhou , Zhiheng Xi , Long Ma , Zhihao Zhang , Shihan Dou , Zhikai Lei , Guoteng Wang , Rui Zheng , Hang Yan , Tao Gui , Qi Zhang , Xuanjing Huang

Technological advances continue to redefine the dynamics of human-machine interactions, particularly in task execution. This proposal responds to the advancements in Generative AI by outlining a research plan that probes intent-AI…

Human-Computer Interaction · Computer Science 2024-05-03 Zijian Ding

Designing user interfaces that align with user preferences is a time-consuming process, which requires iterative cycles of prototyping, user testing, and refinement. Recent advancements in LLM-based UI generation have enabled efficient UI…

Human-Computer Interaction · Computer Science 2026-01-27 Yimeng Liu , Misha Sra , Chang Xiao

Agents, as user-centric tools, are increasingly deployed for human task delegation, assisting with a broad spectrum of requests by generating thoughts, engaging with user proxies, and producing action plans. However, agents based on large…

Multiagent Systems · Computer Science 2024-10-02 Wenyue Hua , Mengting Wan , Shashank Vadrevu , Ryan Nadel , Yongfeng Zhang , Chi Wang

AI models excel at creating content, but typically render it with static, predefined interfaces. Specifically, the output of LLMs is often a markdown "wall of text". Generative UI is a long standing promise, where the model generates not…

AI is growing increasingly capable of automatically generating user interfaces (GenUI) from user prompts. However, designing GenUI applications that enable users to discover diverse customizations while preserving GenUI's expressiveness…

Human-Computer Interaction · Computer Science 2026-01-27 Bryan Min , Peiling Jiang , Zhicheng Huang , Haijun Xia

We introduce SymbolicAI, a versatile and modular framework employing a logic-based approach to concept learning and flow management in generative processes. SymbolicAI enables the seamless integration of generative models with a diverse…

Specifications are vital for ensuring program correctness, yet writing them manually remains challenging and time-intensive. Recent large language model (LLM)-based methods have shown successes in generating specifications such as…

Software Engineering · Computer Science 2026-02-26 Cuong Chi Le , Minh V. T Pham , Tung Vu Duy , Cuong Duc Van , Huy N. Phan , Hoang N. Phan , Tien N. Nguyen

State-of-the-art Large Language Models (LLMs) excel in code generation at the function level. However, the output quality significantly declines when scaling to repository-level systems. Current workflows relying only on natural language…

Software Engineering · Computer Science 2026-05-05 Shuzhao Feng , Boqi Chen , Brett H Meyer , Gunter Mussbacher

Formal program specifications play a crucial role in various stages of software development. However, manually crafting formal program specifications is rather difficult, making the job time-consuming and labor-intensive. It is even more…

Software Engineering · Computer Science 2025-02-26 Lezhi Ma , Shangqing Liu , Yi Li , Xiaofei Xie , Lei Bu

Large Language Models (LLMs) have the potential to transform the way a dynamic curriculum can be delivered. However, educators face significant challenges in interacting with these models, particularly due to complex prompt engineering and…

Computers and Society · Computer Science 2025-06-16 Abdolali Faraji , Mohammadreza Tavakoli , Mohammad Moein , Mohammadreza Molavi , Gábor Kismihók

File systems are critical OS components that require constant evolution to support new hardware and emerging application needs. However, the traditional paradigm of developing features, fixing bugs, and maintaining the system incurs…

Operating Systems · Computer Science 2026-02-11 Qingyuan Liu , Mo Zou , Hengbin Zhang , Dong Du , Yubin Xia , Haibo Chen

The recent advances in Large Language Models (LLMs) have stimulated interest among researchers and industry professionals, particularly in their application to tasks concerning mobile user interfaces (UIs). This position paper investigates…

Human-Computer Interaction · Computer Science 2023-10-25 Yuwen Lu , Ziang Tong , Qinyi Zhao , Chengzhi Zhang , Toby Jia-Jun Li

Stakeholders often struggle to accurately express their requirements due to articulation barriers arising from limited domain knowledge or from cognitive constraints. This can cause misalignment between expressed and intended requirements,…

Software Engineering · Computer Science 2026-01-26 Michael Mircea , Emre Gevrek , Elisa Schmid , Kurt Schneider

The increasing proliferation of IoT devices and AI applications has created a demand for scalable and efficient computing solutions, particularly for applications requiring real-time processing. The compute continuum integrates edge and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Negin Akbari , John Grundy , Aamir Cheema , Adel N. Toosi
‹ Prev 1 2 3 10 Next ›