English
Related papers

Related papers: BEAP-Agent: Backtrackable Execution and Adaptive P…

200 papers

External knowledge has played a crucial role in the recent development of computer use agents. We identify a critical knowledge-execution gap: retrieved knowledge often fails to translate into effective real-world task execution. Our…

Human-Computer Interaction · Computer Science 2025-11-04 Ziyun Zhang , Xinyi Liu , Xiaoyi Zhang , Jun Wang , Gang Chen , Yan Lu

Despite the rapid progress of multimodal large language models in building Graphical User Interface (GUI) agents, their real-world task completion is fundamentally bottlenecked by a lack of world knowledge about GUI operations. Existing…

Computation and Language · Computer Science 2026-05-28 Zheng Wu , Chengcheng Han , Zhengxi Lu , Tianjie Ju , Yanyu Chen , Qi Gu , Xunliang Cai , Zhuosheng Zhang

Mobile agents show immense potential, yet current state-of-the-art (SoTA) agents exhibit inadequate success rates on real-world, long-horizon, cross-application tasks. We attribute this bottleneck to the agents' excessive reliance on…

Artificial Intelligence · Computer Science 2026-03-13 Yuxiang Zhou , Jichang Li , Yanhao Zhang , Haonan Lu , Guanbin Li

Despite their growing adoption across domains, large language model (LLM)-powered agents face significant security risks from backdoor attacks during training and fine-tuning. These compromised agents can subsequently be manipulated to…

Cryptography and Security · Computer Science 2025-06-12 Li Changjiang , Liang Jiacheng , Cao Bochuan , Chen Jinghui , Wang Ting

Smartphones have become indispensable in modern life, yet navigating complex tasks on mobile devices often remains frustrating. Recent advancements in large multimodal model (LMM)-based mobile agents have demonstrated the ability to…

Computation and Language · Computer Science 2025-01-29 Zhenhailong Wang , Haiyang Xu , Junyang Wang , Xi Zhang , Ming Yan , Ji Zhang , Fei Huang , Heng Ji

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

Artificial Intelligence · Computer Science 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi-agent system that is applicable in various problem domains.…

Multiagent Systems · Computer Science 2020-04-21 Peter Hillmann , Tobias Uhlig , Gabi Dreo Rodosek , Oliver Rose

Recent agentic search systems have made substantial progress by emphasising deep, multi-step reasoning. However, this focus often overlooks the challenges of wide-scale information synthesis, where agents must aggregate large volumes of…

Artificial Intelligence · Computer Science 2026-04-06 Ka Yiu Lee , Yuxuan Huang , Zhiyuan He , Huichi Zhou , Weilin Luo , Kun Shao , Meng Fang , Jun Wang

Agentic systems augment large language models with external tools and iterative decision making, enabling complex tasks such as deep research, function calling, and coding. However, their long and intricate execution traces make failure…

Software debugging is a time-consuming endeavor involving a series of steps, such as fault localization and patch generation, each requiring thorough analysis and a deep understanding of the underlying logic. While large language models…

Software Engineering · Computer Science 2025-11-19 Cheryl Lee , Chunqiu Steven Xia , Longji Yang , Jen-tse Huang , Zhouruixin Zhu , Lingming Zhang , Michael R. Lyu

Recent advances in large language models (LLMs) have significantly improved multi-hop question answering (QA) through direct Chain-of-Thought (CoT) reasoning. However, the irreversible nature of CoT leads to error accumulation, making it…

Artificial Intelligence · Computer Science 2025-05-30 Xinjie Zhao , Fan Gao , Xingyu Song , Yingjian Chen , Rui Yang , Yanran Fu , Yuyang Wang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

The development of high-quality datasets is crucial for benchmarking and advancing research in Graphical User Interface (GUI) agents. Despite their importance, existing datasets are often constructed under idealized conditions, overlooking…

Artificial Intelligence · Computer Science 2025-06-18 Jingqi Yang , Zhilong Song , Jiawei Chen , Mingli Song , Sheng Zhou , linjun sun , Xiaogang Ouyang , Chun Chen , Can Wang

Graphical User Interface (GUI) agents have made substantial strides in understanding and executing user instructions across diverse platforms. Yet, grounding these instructions to precise interface elements remains challenging, especially…

Artificial Intelligence · Computer Science 2025-05-27 Xinbin Yuan , Jian Zhang , Kaixin Li , Zhuoxuan Cai , Lujian Yao , Jie Chen , Enguang Wang , Qibin Hou , Jinwei Chen , Peng-Tao Jiang , Bo Li

With recent advancements in large language models, web agents have been greatly improved. However, dealing with complex and dynamic web environments requires more advanced planning and search abilities. Previous studies usually adopt a…

Computation and Language · Computer Science 2026-01-16 Zhisong Zhang , Tianqing Fang , Kaixin Ma , Wenhao Yu , Hongming Zhang , Haitao Mi , Dong Yu

The goal of Multi-Agent Path Finding (MAPF) is to find a set of paths for a fleet of agents moving in a shared environment such that the agents reach their goals without colliding with each other. In practice, some of the robots executing…

Multiagent Systems · Computer Science 2025-09-15 David Zahrádka , Denisa Mužíková , David Woller , Miroslav Kulich , Jiří Švancara , Roman Barták

Graphical User Interface (GUI) agent is pivotal to advancing intelligent human-computer interaction paradigms. Constructing powerful GUI agents necessitates the large-scale annotation of high-quality user-behavior trajectory data (i.e.,…

Artificial Intelligence · Computer Science 2026-02-06 Rui Lv , Juncheng Mo , Tianyi Chu , Chen Rao , Hongyi Jing , Jiajie Teng , Jiafu Chen , Shiqi Zhang , Liangzi Ding , Shuo Fang , Huaizhong Lin , Ziqiang Dang , Chenguang Ma , Lei Zhao

With the rapid progress of large language models (LLMs), LLM-powered multi-agent systems (MAS) are drawing increasing interest across academia and industry. However, many current MAS frameworks struggle with reliability and scalability,…

Multiagent Systems · Computer Science 2025-11-04 Yang Li , Siqi Ping , Xiyu Chen , Xiaojian Qi , Zigan Wang , Ye Luo , Xiaowei Zhang

Multi-Agent Path Finding (MAPF) is an important core problem for many new and emerging industrial applications. Many works appear on this topic each year, and a large number of substantial advancements and performance improvements have been…

Artificial Intelligence · Computer Science 2023-05-16 Bojie Shen , Zhe Chen , Muhammad Aamir Cheema , Daniel D. Harabor , Peter J. Stuckey

While GUI agents have made significant progress in web navigation and basic operating system tasks, their capabilities in professional creative workflows remain largely underexplored. To bridge this gap, we introduce Cutverse, a benchmark…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Haobo Hu , Xiangwu Guo , Zhiheng Chen , Difei Gao , Haotian Liu , Libiao Jin , Qi Mao

While much work on web agents emphasizes the promise of autonomously performing tasks on behalf of users, in reality, agents often fall short on complex tasks in real-world contexts and modeling user preference. This presents an opportunity…

Artificial Intelligence · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Frank F. Xu , Tianyue Ou , Shuyan Zhou , Jeffrey P. Bigham , Graham Neubig
‹ Prev 1 8 9 10 Next ›