English
Related papers

Related papers: From User Interface to Agent Interface: Efficiency…

200 papers

Multimodal large language models (MLLMs) are transforming the capabilities of graphical user interface (GUI) agents, facilitating their transition from controlled simulations to complex, real-world applications across various platforms.…

Artificial Intelligence · Computer Science 2025-06-18 Boyu Gou , Ruohan Wang , Boyuan Zheng , Yanan Xie , Cheng Chang , Yiheng Shu , Huan Sun , Yu Su

The rapid evolution of wireless networks presents unprecedented challenges in managing complex and dynamic systems. Existing methods are increasingly facing fundamental limitations in addressing these challenges. In this paper, we introduce…

Signal Processing · Electrical Eng. & Systems 2025-05-05 Jingwen Tong , Wei Guo , Jiawei Shao , Qiong Wu , Zijian Li , Zehong Lin , Jun Zhang

Automatic code optimization remains a difficult challenge, particularly for complex loop nests on modern hardware. This paper investigates a novel approach to code optimization where Large Language Models (LLMs) guide the process through a…

Programming Languages · Computer Science 2025-12-30 Massinissa Merouani , Islem Kara Bernou , Riyadh Baghdadi

Large Language Models (LLMs) have shown remarkable capabilities, with optimizing their input prompts playing a pivotal role in maximizing their performance. However, while LLM prompts consist of both the task-agnostic system prompts and…

Computation and Language · Computer Science 2025-10-13 Yumin Choi , Jinheon Baek , Sung Ju Hwang

Large language models are transforming systems research by automating the discovery of performance-critical algorithms for computer systems. Despite plausible codes generated by LLMs, producing solutions that meet the stringent correctness…

Machine Learning · Computer Science 2026-02-04 Hongyuan Su , Yu Zheng , Yong Li

Large language models (LLMs) show remarkable potential to act as computer agents, enhancing human productivity and software accessibility in multi-modal tasks that require planning and reasoning. However, measuring agent performance in…

Natural language (NL) has long been the predominant format for human cognition and communication, and by extension, has been similarly pivotal in the development and application of Large Language Models (LLMs). Yet, besides NL, LLMs have…

Computation and Language · Computer Science 2024-06-21 Weize Chen , Chenfei Yuan , Jiarui Yuan , Yusheng Su , Chen Qian , Cheng Yang , Ruobing Xie , Zhiyuan Liu , Maosong Sun

The era of foundation models has revolutionized AI research, yet Graph Foundation Models (GFMs) remain constrained by the scarcity of large-scale graph corpora. Traditional graph data synthesis techniques primarily focus on simplistic…

Machine Learning · Computer Science 2025-05-06 Enjun Du , Xunkai Li , Tian Jin , Zhihan Zhang , Rong-Hua Li , Guoren Wang

With software maintenance accounting for 50% of the cost of developing software, enhancing code quality and reliability has become more critical than ever. In response to this challenge, this doctoral research proposal aims to explore…

Software Engineering · Computer Science 2024-06-25 Fernando Vallecillos Ruiz

Adapting the user interface (UI) of software systems to meet the needs and preferences of users is a complex task. The main challenge is to provide the appropriate adaptations at the appropriate time to offer value to end-users. Recent…

Human-Computer Interaction · Computer Science 2024-05-16 Daniel Gaspar-Figueiredo , Marta Fernández-Diego , Ruben Nuredini , Silvia Abrahão , Emilio Insfrán

A burgeoning area within reinforcement learning (RL) is the design of sequential decision-making agents centered around large language models (LLMs). While autonomous decision-making agents powered by modern LLMs could facilitate numerous…

Machine Learning · Computer Science 2026-02-10 Dilip Arumugam , Thomas L. Griffiths

Multi-Agent Systems (MAS) powered by Large Language Models (LLMs) are emerging as a powerful paradigm for solving complex, multifaceted problems. However, the potential of these systems is often constrained by the prevalent plan-and-execute…

Artificial Intelligence · Computer Science 2025-07-18 Yexuan Shi , Mingyu Wang , Yunxiang Cao , Hongjie Lai , Junjian Lan , Xin Han , Yu Wang , Jie Geng , Zhenan Li , Zihao Xia , Xiang Chen , Chen Li , Jian Xu , Wenbo Duan , Yuanshuo Zhu

This paper introduces a novel architectural framework that integrates Large Language Models (LLMs) with email interfaces to automate administrative tasks, specifically targeting accessibility barriers in enterprise environments. The system…

Human-Computer Interaction · Computer Science 2025-07-01 Andres Navarro , Carlos de Quinto , José Alberto Hernández

Simulating high quality user behavior data has always been a fundamental problem in human-centered applications, where the major difficulty originates from the intricate mechanism of human decision process. Recently, substantial evidences…

Information Retrieval · Computer Science 2024-02-16 Lei Wang , Jingsen Zhang , Hao Yang , Zhiyuan Chen , Jiakai Tang , Zeyu Zhang , Xu Chen , Yankai Lin , Ruihua Song , Wayne Xin Zhao , Jun Xu , Zhicheng Dou , Jun Wang , Ji-Rong Wen

Usability describes quality attributes of application user interfaces that determine how effectively users can interact with them. Traditional usability evaluation methods require considerable expertise and resources, which can be…

Software Engineering · Computer Science 2026-04-29 Sebastian Lubos , Alexander Felfernig , Damian Garber , Viet-Man Le , Manuel Henrich

Large Action Models (LAMs) for AI Agents offer incredible potential but face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to…

Large language model (LLM) agents have shown impressive reasoning capabilities in interactive decision-making tasks. These agents interact with environment through intermediate interfaces, such as predefined action spaces and interaction…

Artificial Intelligence · Computer Science 2025-05-28 Kaiming Liu , Xuanyu Lei , Ziyue Wang , Peng Li , Yang Liu

Large Language Models (LLMs) are transforming artificial intelligence, enabling autonomous agents to perform diverse tasks across various domains. These agents, proficient in human-like text comprehension and generation, have the potential…

Artificial Intelligence · Computer Science 2024-04-10 Saikat Barua

Large language models (LLMs) have achieved remarkable success across various domains, but effectively incorporating complex and potentially noisy user timeline data into LLMs remains a challenge. Current approaches often involve translating…

Computation and Language · Computer Science 2024-09-11 Lin Ning , Luyang Liu , Jiaxing Wu , Neo Wu , Devora Berlowitz , Sushant Prakash , Bradley Green , Shawn O'Banion , Jun Xie

Current interactive systems with natural language interfaces lack the ability to understand a complex information-seeking request which expresses several implicit constraints at once, and there is no prior information about user preferences…