English
Related papers

Related papers: Towards Scalable Lightweight GUI Agents via Multi-…

200 papers

Recent advancements in Multi-Agent Systems (MAS) powered by Large Language Models (LLMs) have demonstrated tremendous potential in diverse task scenarios. Nonetheless, existing agentic systems typically rely on predefined agent-role design…

Multiagent Systems · Computer Science 2025-05-21 Zhipeng Hou , Junyi Tang , Yipeng Wang

Graphical User Interface (GUI) Agents have emerged as a transformative paradigm in human-computer interaction, evolving from rule-based automation scripts to sophisticated AI-driven systems capable of understanding and executing complex…

Human-Computer Interaction · Computer Science 2025-06-05 Fei Tang , Haolei Xu , Hang Zhang , Siqi Chen , Xingyu Wu , Yongliang Shen , Wenqi Zhang , Guiyang Hou , Zeqi Tan , Yuchen Yan , Kaitao Song , Jian Shao , Weiming Lu , Jun Xiao , Yueting Zhuang

Despite advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), their integration into language-grounded, human-like embodied agents remains incomplete, hindering complex real-life task performance in physical…

Computation and Language · Computer Science 2024-08-20 Zhili Cheng , Zhitong Wang , Jinyi Hu , Shengding Hu , An Liu , Yuge Tu , Pengkai Li , Lei Shi , Zhiyuan Liu , Maosong Sun

Advances in large language models (LLMs) and real-time speech recognition now make it possible to issue any graphical user interface (GUI) action through natural language and receive the corresponding system response directly through the…

Human-Computer Interaction · Computer Science 2025-10-10 Hans G. W. van Dam

Large Language Models (LLMs) have revolutionized Natural Language Processing but exhibit limitations, particularly in autonomously addressing novel challenges such as reasoning and problem-solving. Traditional techniques like…

Multiagent Systems · Computer Science 2024-01-03 Sumedh Rasal

Multimodal Large Language Model (MLLM)-based Graphical User Interface (GUI) agents develop rapidly, with visual grounding that maps natural language instructions to target UI elements serving as the core capability. Existing GUI agents…

Machine Learning · Computer Science 2026-03-17 Ziwei Liu , Tao Feng , Borui Kang , Yanbing Yang , Jun Luo

Hardware design presents numerous challenges stemming from its complexity and advancing technologies. These challenges result in longer turn-around-time (TAT) for optimizing performance, power, area, and cost (PPAC) during synthesis,…

Hardware Architecture · Computer Science 2025-04-04 Chia-Tung Ho , Jing Gong , Yunsheng Bai , Chenhui Deng , Haoxing Ren , Brucek Khailany

Graphical User Interface (GUI) agents are autonomous systems that interpret and generate actions, enabling intelligent user assistance and automation. Effective training of these agent presents unique challenges, such as sparsity in…

Computation and Language · Computer Science 2025-03-28 Yiqiao Jin , Stefano Petrangeli , Yu Shen , Gang Wu

Large Language Models (LLMs) have facilitated the definition of autonomous intelligent agents. Such agents have already demonstrated their potential in solving complex tasks in different domains. And they can further increase their…

Software Engineering · Computer Science 2025-06-30 Adem Ait , Javier Luis Cánovas Izquierdo , Jordi Cabot

Since the advent of Large Language Models (LLMs), various research based on such models have maintained significant academic attention and impact, especially in AI and robotics. In this paper, we propose a multi-agent framework with LLMs to…

Robotics · Computer Science 2025-05-12 Junhong Chen , Ziqi Yang , Haoyuan G Xu , Dandan Zhang , George Mylonas

In architectural interior design, miscommunication frequently arises as clients lack design knowledge, while designers struggle to explain complex spatial relationships, leading to delayed timelines and financial losses. Recent advancements…

Artificial Intelligence · Computer Science 2026-03-17 Ren Jian Lim , Rushi Dai

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Proactive large language model (LLM) agents aim to actively plan, query, and interact over multiple turns, enabling efficient task completion beyond passive instruction following and making them essential for real-world, user-centric…

Artificial Intelligence · Computer Science 2026-02-13 Yihang Yao , Zhepeng Cen , Haohong Lin , Shiqi Liu , Zuxin Liu , Jiacheng Zhu , Zhang-Wei Hong , Laixi Shi , Ding Zhao

The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for…

Machine Learning · Computer Science 2024-03-26 Xiangyan Liu , Rongxue Li , Wei Ji , Tao Lin

Large language model (LLM) multi-agent systems can scale along two distinct dimensions: by increasing the number of agents and by improving through accumulated experience over time. Although prior work has studied these dimensions…

Multiagent Systems · Computer Science 2026-04-07 Shanglin Wu , Yuyang Luo , Yueqing Liang , Kaiwen Shi , Yanfang Ye , Ali Payani , Kai Shu

The rise of (multimodal) large language models (LLMs) has shed light on software agent -- where software can understand and follow user instructions in natural language. However, existing approaches such as API-based and GUI-based agents…

Software Engineering · Computer Science 2025-02-10 Mengwei Xu

Large Language Models (LLMs) have shown remarkable capabilities as autonomous agents, yet existing benchmarks either focus on single-agent tasks or are confined to narrow domains, failing to capture the dynamics of multi-agent coordination…

Multiagent Systems · Computer Science 2025-03-05 Kunlun Zhu , Hongyi Du , Zhaochen Hong , Xiaocheng Yang , Shuyi Guo , Zhe Wang , Zhenhailong Wang , Cheng Qian , Xiangru Tang , Heng Ji , Jiaxuan You

As intelligent systems and multi-agent coordination become increasingly central to real-world applications, there is a growing need for simulation tools that are both scalable and accessible. Existing high-fidelity simulators, while…

Artificial Intelligence · Computer Science 2026-02-06 Rohan Patil , Jai Malegaonkar , Xiao Jiang , Andre Dion , Gaurav S. Sukhatme , Henrik I. Christensen

Multi-Agent Systems (MAS) powered by Large Language Models (LLMs) are emerging as a powerful paradigm for solving complex, multifaceted problems. However, the potential of these systems is often constrained by the prevalent plan-and-execute…

Artificial Intelligence · Computer Science 2025-07-18 Yexuan Shi , Mingyu Wang , Yunxiang Cao , Hongjie Lai , Junjian Lan , Xin Han , Yu Wang , Jie Geng , Zhenan Li , Zihao Xia , Xiang Chen , Chen Li , Jian Xu , Wenbo Duan , Yuanshuo Zhu

In recent years, Large Language Models (LLMs) have demonstrated remarkable capabilities in data analytics when integrated with Multi-Agent Systems (MAS). However, these systems often struggle with complex tasks that involve diverse…

Artificial Intelligence · Computer Science 2024-12-19 Yi Huang , Fangyin Cheng , Fan Zhou , Jiahui Li , Jian Gong , Hongjun Yang , Zhidong Fan , Caigao Jiang , Siqiao Xue , Faqiang Chen