English
Related papers

Related papers: Portal UX Agent -- A Plug-and-Play Engine for Rend…

200 papers

Phone automation agents aim to autonomously perform a given natural-language user request, such as scheduling appointments or booking a hotel. While much research effort has been devoted to screen understanding and action planning, complex…

Human-Computer Interaction · Computer Science 2025-04-02 Noam Kahlon , Guy Rom , Anatoly Efros , Filippo Galgani , Omri Berkovitch , Sapir Caduri , William E. Bishop , Oriana Riva , Ido Dagan

Large language model (LLM)-based computer use agents execute user commands by interacting with available UI elements, but little is known about how users want to interact with these agents or what design factors matter for their user…

Human-Computer Interaction · Computer Science 2026-02-10 Ruijia Cheng , Jenny T. Liang , Eldon Schoop , Jeffrey Nichols

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Modern software applications demand efficient and reliable testing methodologies to ensure robust user interface functionality. This paper introduces an autonomous reinforcement learning (RL) agent integrated within a Behavior-Driven…

Software Engineering · Computer Science 2026-02-10 Ali Hassaan Mughal

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

This paper introduces a novel Large Language Models (LLMs)-assisted agent that automatically converts natural-language descriptions of power system optimization scenarios into compact, solver-ready formulations and generates corresponding…

Artificial Intelligence · Computer Science 2025-08-12 Yunkai Hu , Tianqiao Zhao , Meng Yue

While Large Language Model (LLM)-based agents can be used to create highly engaging interactive applications through prompting personality traits and contextual data, effectively assessing their personalities has proven challenging. This…

Human-Computer Interaction · Computer Science 2025-10-29 Eswari Jayakumar , Niladri Sekhar Dash , Debasmita Mukherjee

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

This paper reviews the architecture and implementation methods of agents powered by large language models (LLMs). Motivated by the limitations of traditional LLMs in real-world tasks, the research aims to explore patterns to develop…

Artificial Intelligence · Computer Science 2025-10-13 Victor de Lamo Castrillo , Habtom Kahsay Gidey , Alexander Lenz , Alois Knoll

Graphical User Interface (GUI) agents show amazing abilities in assisting human-computer interaction, automating human user's navigation on digital devices. An ideal GUI agent is expected to achieve high accuracy, low latency, and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Zhiyuan Huang , Ziming Cheng , Junting Pan , Zhaohui Hou , Mingjie Zhan

The deployment of Large Language Models (LLMs) in interactive systems necessitates a deep alignment with the nuanced and dynamic preferences of individual users. Current alignment techniques predominantly address universal human values or…

Computation and Language · Computer Science 2025-12-18 Xiaotian Zhang , Yuan Wang , Ruizhe Chen , Zeya Wang , Runchen Hou , Zuozhu Liu

Interactive systems are omnipresent today and the need to create graphical user interfaces (GUIs) is just as ubiquitous. For the elicitation and validation of requirements, GUI prototyping is a well-known and effective technique, typically…

Software Engineering · Computer Science 2024-06-13 Kristian Kolthoff , Felix Kretzer , Christian Bartelt , Alexander Maedche , Simone Paolo Ponzetto

Large language model (LLM)-based computer-use agents represent a convergence of AI and OS capabilities, enabling natural language to control system- and application-level functions. However, due to LLMs' inherent uncertainty issues,…

Cryptography and Security · Computer Science 2026-01-15 Haochen Gong , Chenxiao Li , Rui Chang , Wenbo Shen

Large Language Model (LLM)-based code analysis tools are adopted to automate software documentation tasks. However, the scalability of these approaches to real codebases, where Intermediate Representations (IR) exceed LLM context limits,…

Software Engineering · Computer Science 2026-05-26 Alin-Gabriel Văduva , Anca-Ioana Andreescu , Simona-Vasilica Oprea , Adela Bâra

Large Language Models (LLMs) are transforming artificial intelligence, evolving into task-oriented systems capable of autonomous planning and execution. One of the primary applications of LLMs is conversational AI systems, which must…

Computation and Language · Computer Science 2025-01-22 Elad Levi , Ilan Kadar

Recent years have witnessed a rapid development of mobile GUI agents powered by large language models (LLMs), which can autonomously execute diverse device-control tasks based on natural language instructions. The increasing accuracy of…

Cryptography and Security · Computer Science 2026-04-15 Guohong Liu , Jialei Ye , Jiacheng Liu , Yuanchun Li , Wei Liu , Pengzhi Gao , Jian Luan , Yunxin Liu

Recommender systems are essential components of many online platforms, yet traditional approaches still struggle with understanding complex user preferences and providing explainable recommendations. The emergence of Large Language Model…

Information Retrieval · Computer Science 2025-03-05 Qiyao Peng , Hongtao Liu , Hua Huang , Qing Yang , Minglai Shao

Existing works focus on fixed-size layout pattern generation, while the more practical free-size pattern generation receives limited attention. In this paper, we propose ChatPattern, a novel Large-Language-Model (LLM) powered framework for…

Computation and Language · Computer Science 2024-03-26 Zixiao Wang , Yunheng Shen , Xufeng Yao , Wenqian Zhao , Yang Bai , Farzan Farnia , Bei Yu

Large Language Models (LLMs) have revolutionized various aspects of engineering and science. Their utility is often bottlenecked by the lack of interaction with the external digital environment. To overcome this limitation and achieve…

Software Engineering · Computer Science 2024-12-24 Ioannis Tzachristas