English
Related papers

Related papers: BEAP-Agent: Backtrackable Execution and Adaptive P…

200 papers

Multi-Agent Pathfinding (MAPF) is the problem of finding paths for multiple agents such that every agent reaches its goal and the agents do not collide. Most prior work on MAPF was on grids, assumed agents' actions have uniform duration,…

Artificial Intelligence · Computer Science 2019-06-17 Anton Andreychuk , Konstantin Yakovlev , Dor Atzmon , Roni Stern

Graphical User Interface (GUI) agents powered by Large Vision-Language Models (LVLMs) have emerged as a revolutionary approach to automating human-machine interactions, capable of autonomously operating personal devices (e.g., mobile…

Computation and Language · Computer Science 2025-09-25 Ziang Ye , Yang Zhang , Wentao Shi , Xiaoyu You , Fuli Feng , Tat-Seng Chua

Embodied instruction following (EIF) requires agents to understand and execute complex natural language commands within interactive 3D environments. Despite recent advances, existing methods often fail in long-horizon planning and handling…

Robotics · Computer Science 2026-05-26 Xicheng Gong , Guozheng Sun , Peiran Xu , Yadong Mu

Multi-agent target assignment and path planning (TAPF) are two key problems in intelligent warehouse. However, most literature only addresses one of these two problems separately. In this study, we propose a method to simultaneously solve…

Artificial Intelligence · Computer Science 2024-10-29 Qi Liu , Jianqi Gao , Dongjie Zhu , Zhongjian Qiao , Pengbin Chen , Jingxiang Guo , Yanjie Li

Background: Large-scale biological jobs on high-performance computing systems require manual intervention if one or more computing cores on which they execute fail. This places not only a cost on the maintenance of the job, but also a cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-04 Blesson Varghese , Gerard McKee , Vassil Alexandrov

With the growing reliance on digital devices equipped with graphical user interfaces (GUIs), such as computers and smartphones, the need for effective automation tools has become increasingly important. While multimodal large language…

Human-Computer Interaction · Computer Science 2024-10-18 Jakub Hoscilowicz , Bartosz Maj , Bartosz Kozakiewicz , Oleksii Tymoshchuk , Artur Janicki

Autonomous agents that navigate Graphical User Interfaces (GUIs) to automate tasks like document editing and file management can greatly enhance computer workflows. While existing research focuses on online settings, desktop environments,…

As agent systems powered by large language models (LLMs) advance, improving performance in context understanding, tool usage, and long-horizon execution has become critical. However, existing agent frameworks and benchmarks provide limited…

Artificial Intelligence · Computer Science 2026-01-28 Defei Xia , Bingfeng Pi , Shenbin Zhang , Song Hua , Yunfei Wei , Lei Zuo

Software testing has progressed toward intelligent automation, yet current AI-based test generators still suffer from static, single-shot outputs that frequently produce invalid, redundant, or non-executable tests due to the lack of…

Software Engineering · Computer Science 2026-01-07 Saba Naqvi , Mohammad Baqar , Nawaz Ali Mohammad

We present an end-to-end, model-based deep reinforcement learning agent which dynamically attends to relevant parts of its state during planning. The agent uses a bottleneck mechanism over a set-based representation to force the number of…

Artificial Intelligence · Computer Science 2021-11-05 Mingde Zhao , Zhen Liu , Sitao Luan , Shuyuan Zhang , Doina Precup , Yoshua Bengio

Artificial Intelligence agents represent the next major revolution in the continuous technological evolution of industrial automation. In this paper, we introduce a new approach for business process design and development that leverages the…

Artificial Intelligence · Computer Science 2025-07-30 Mohammad Azarijafari , Luisa Mich , Michele Missikoff

Existing GUI agent models relying on coordinate-based one-step visual grounding struggle with generalizing to varying input resolutions and aspect ratios. Alternatives introduce coordinate-free strategies yet suffer from learning under…

Machine Learning · Computer Science 2026-02-04 Xiaoce Wang , Guibin Zhang , Junzhe Li , Jinzhe Tu , Chun Li , Ming Li

The emergence of Large Language Models (LLMs) like ChatGPT has inspired the development of LLM-based agents capable of addressing complex, real-world tasks. However, these agents often struggle during task execution due to methodological…

Computation and Language · Computer Science 2025-01-22 Yaoxiang Wang , Zhiyong Wu , Junfeng Yao , Jinsong Su

Current mobile GUI agent benchmarks systematically fail to assess memory capabilities, with only 5.2-11.8% memory-related tasks and no cross-session learning evaluation. We introduce MemGUI-Bench, a comprehensive memory-centric benchmark…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-09 Guangyi Liu , Pengxiang Zhao , Yaozhen Liang , Qinyi Luo , Shunye Tang , Yuxiang Chai , Weifeng Lin , Han Xiao , WenHao Wang , Siheng Chen , Zhengxi Lu , Gao Wu , Hao Wang , Liang Liu , Yong Liu

With the rapid progress of multimodal large language models, operating system (OS) agents become increasingly capable of automating tasks through on-device graphical user interfaces (GUIs). However, most existing OS agents are designed for…

Computation and Language · Computer Science 2026-04-06 Zheng Wu , Heyuan Huang , Xingyu Lou , Xiangmou Qu , Pengzhou Cheng , Zongru Wu , Weiwen Liu , Weinan Zhang , Jun Wang , Zhaoxiang Wang , Zhuosheng Zhang

While long-horizon agentic tasks require language agents to perform dozens of sequential decisions, training such agents with reinforcement learning remains challenging. We identify two root causes: credit misattribution, where correct…

Computation and Language · Computer Science 2026-05-08 Zixuan Wang , Yuchen Yan , Hongxing Li , Teng Pan , Dingming Li , Ruiqing Zhang , Weiming Lu , Jun Xiao , Yueting Zhuang , Yongliang Shen

Vision-and-Language Scene navigation is a fundamental capability for embodied human-AI collaboration, requiring agents to follow natural language instructions to execute coherent action sequences in complex environments. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Kaiming Jin , Yuefan Wu , Shengqiong Wu , Bobo Li , Shuicheng Yan , Tat-Seng Chua

The rapid evolution to autonomous, agentic AI systems introduces significant risks due to their inherent unpredictability and emergent behaviors; this also renders traditional verification methods inadequate and necessitates a shift towards…

Artificial Intelligence · Computer Science 2025-09-30 Roham Koohestani

Autonomous GUI agents based on vision-language models (VLMs) often assume deterministic environment responses, generating actions without verifying whether previous operations succeeded. In real-world settings with network latency,…

Computation and Language · Computer Science 2026-04-08 Yuzhe Zhang , Xianwei Xue , Xingyong Wu , Mengke Chen , Chen Liu , Xinran He , Run Shao , Feiran Liu , Huanmin Xu , Qiutong Pan , Haiwei Wang

The recent advancement of autonomous agents powered by Large Language Models (LLMs) has demonstrated significant potential for automating tasks on mobile devices through graphical user interfaces (GUIs). Despite initial progress, these…

Human-Computer Interaction · Computer Science 2025-07-30 Yi Kong , Dianxi Shi , Guoli Yang , Zhang ke-di , Chenlin Huang , Xiaopeng Li , Songchang Jin