English
Related papers

Related papers: SpecifyUI: Supporting Iterative UI Design Intent E…

200 papers

A rigorous formalization of desired system requirements is indispensable when performing any verification task. This often limits the application of verification techniques, as writing formal specifications is an error-prone and…

Logic in Computer Science · Computer Science 2023-03-10 Matthias Cosler , Christopher Hahn , Daniel Mendoza , Frederik Schmitt , Caroline Trippel

The advancement of Large Language Models (LLM) has also resulted in an equivalent proliferation in its applications. Software design, being one, has gained tremendous benefits in using LLMs as an interface component that extends fixed user…

Software Engineering · Computer Science 2024-07-01 Claudionor N. Coelho , Hanchen Xiong , Tushar Karayil , Sree Koratala , Rex Shang , Jacob Bollinger , Mohamed Shabar , Syam Nair

From 2000 to 2015, the UN's Millennium Development Goals guided global priorities. The subsequent Sustainable Development Goals (SDGs) adopted a more dynamic approach, with annual indicator updates. As 2030 nears and progress lags,…

Computers and Society · Computer Science 2025-04-21 Yi-De Lin , Guan-Ze Liao

This paper introduces SpecInfer, a system that accelerates generative large language model (LLM) serving with tree-based speculative inference and verification. The key idea behind SpecInfer is leveraging small speculative models to predict…

As IC design grows more complex, automating comprehension and documentation of RTL code has become increasingly important. Engineers currently should manually interpret existing RTL code and write specifications, a slow and error-prone…

Hardware Architecture · Computer Science 2025-12-02 Hung-Ming Huang , Yu-Hsin Yang , Fu-Chieh Chang , Yun-Chia Hsu , Yin-Yu Lin , Ming-Fang Tsai , Chun-Chih Yang , Pei-Yuan Wu

Large Language Models (LLMs) are revolutionizing Software Engineering (SE) by introducing innovative methods for tasks such as collecting requirements, designing software, generating code, and creating test cases, among others. This article…

Software Engineering · Computer Science 2024-05-06 Malik Abdul Sami , Zeeshan Rasheed , Muhammad Waseem , Zheying Zhang , Tomas Herda , Pekka Abrahamsson

Generative AI models differ from traditional machine learning tools in that they allow users to provide as much or as little information as they choose in their inputs. This flexibility often leads users to omit certain details, relying on…

Computer Science and Game Theory · Computer Science 2026-05-13 Charlotte Park , Kate Donahue , Manish Raghavan

We introduce the new task of generating Illustrated Instructions, i.e., visual instructions customized to a user's needs. We identify desiderata unique to this task, and formalize it through a suite of automatic and human evaluation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Sachit Menon , Ishan Misra , Rohit Girdhar

The rapid appearance of large language models (LLMs) has led to systems that turn natural-language intent into real user interfaces (UIs). Free-form code generation maximizes expressiveness but often hurts reliability, security, and…

Human-Computer Interaction · Computer Science 2025-11-04 Xinsong Li , Ning Jiang , Jay Selvaraj

Agentic multimodal large language models (MLLMs) (e.g., OpenAI o3 and Gemini Agentic Vision) achieve remarkable reasoning capabilities through iterative visual tool invocation. However, the cascaded perception, reasoning, and tool-calling…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Haoyu Huang , Jinfa Huang , Zhongwei Wan , Xiawu Zheng , Rongrong Ji , Jiebo Luo

Recent large language models (LLMs) show promise in design tasks, yet a fundamental misalignment persists: design thinking requires iterative intent formulation, while LLMs treat inputs as complete specifications. This challenges design…

Human-Computer Interaction · Computer Science 2026-01-27 Anqi Wang , Zhengyi Li , Xin Tong , Pan Hui

To handle ambiguous and open-ended requests, Large Language Models (LLMs) are increasingly trained to interact with users to surface intents they have not yet expressed (e.g., ask clarification questions). However, users are often ambiguous…

Artificial Intelligence · Computer Science 2026-05-14 Tae Soo Kim , Yoonjoo Lee , Jaesang Yu , John Joon Young Chung , Juho Kim

The development of architecture specifications is an initial and fundamental stage of the integrated circuit (IC) design process. Traditionally, architecture specifications are crafted by experienced chip architects, a process that is not…

Hardware Architecture · Computer Science 2024-01-25 Mengming Li , Wenji Fang , Qijun Zhang , Zhiyao Xie

Formal specification generation has recently drawn attention in software engineering as a way to improve program correctness without requiring manual annotations. Large Language Models (LLMs) have shown promise in this area, but early…

Software Engineering · Computer Science 2026-04-07 Ragib Shahariar Ayon , Shibbir Ahmed

Scaling test-time compute has driven the recent advances in the reasoning capabilities of large language models (LLMs), typically by allocating additional computation for more thorough exploration. However, increased compute often comes at…

Artificial Intelligence · Computer Science 2026-02-20 Mert Cemri , Nived Rajaraman , Rishabh Tiwari , Xiaoxuan Liu , Kurt Keutzer , Ion Stoica , Kannan Ramchandran , Ahmad Beirami , Ziteng Sun

Although Multimodal Large Language Models (MLLMs) have been widely applied across domains, they are still facing challenges in domain-specific tasks, such as User Interface (UI) understanding accuracy and UI generation quality. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Hao Yang , Weijie Qiu , Ru Zhang , Zhou Fang , Ruichao Mao , Xiaoyu Lin , Maji Huang , Zhaosong Huang , Teng Guo , Shuoyang Liu , Hai Rao

In this work, we explore explicit Large Language Model (LLM)-powered support for the iterative design of computer programs. Program design, like other design activity, is characterized by navigating a space of alternative problem…

Human-Computer Interaction · Computer Science 2025-03-11 J. D. Zamfirescu-Pereira , Eunice Jun , Michael Terry , Qian Yang , Björn Hartmann

Traditional formal specification generation methods are typically tailored to specific specification types, and therefore suffer from limited generality. In recent years, large language model (LLM)-based specification generation approaches…

Software Engineering · Computer Science 2026-02-03 Zehan Chen , Long Zhang , Zhiwei Zhang , JingJing Zhang , Ruoyu Zhou , Yulong Shen , JianFeng Ma , Lin Yang

Designers of digital solutions increasingly consult Large Language Models (LLMs) for their work. However, it remains unclear how this may affect the user experiences they produce and there are no established practices. We investigate how…

Human-Computer Interaction · Computer Science 2026-05-19 Eduard Kuric , Peter Demcak , Matus Krajcovic

The evolution of Large Language Models (LLMs) has showcased remarkable capacities for logical reasoning and natural language comprehension. These capabilities can be leveraged in solutions that semantically and textually model complex…

Human-Computer Interaction · Computer Science 2024-04-17 Syed Mekael Wasti , Ken Q. Pu , Ali Neshati