English
Related papers

Related papers: PC-Agent: A Hierarchical Multi-Agent Collaboration…

200 papers

Mobile GUI agents can automate smartphone tasks by interacting directly with app interfaces, but how they should communicate with users during execution remains underexplored. Existing systems rely on two extremes: foreground execution,…

Human-Computer Interaction · Computer Science 2026-04-24 Jeonghyeon Kim , Byeongjun Joung , Junwon Lee , Joohyung Lee , Taehoon Min , Sunjae Lee

Graphical User Interface (GUI) Agents powered by Multimodal Large Language Models (MLLMs) show significant potential for automating tasks. However, they often struggle with long-horizon tasks, leading to frequent failures. Process Reward…

Artificial Intelligence · Computer Science 2025-10-06 Tao Xiong , Xavier Hu , Yurun Chen , Yuhang Liu , Changqiao Wu , Pengzhi Gao , Wei Liu , Jian Luan , Shengyu Zhang

Deep reasoning is fundamental for solving complex tasks, especially in vision-centric scenarios that demand sequential, multimodal understanding. However, existing benchmarks typically evaluate agents with fully synthetic, single-turn…

Despite the remarkable progress of Multimodal Large Language Models (MLLMs) in 2D vision-language tasks, their application to complex 3D scene manipulation remains underexplored. In this paper, we bridge this critical gap by tackling three…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zhengfei Kuang , Rui Lin , Long Zhao , Gordon Wetzstein , Saining Xie , Sanghyun Woo

Autonomous agent frameworks still struggle to reconcile long-term experiential learning with real-time, context-sensitive decision-making. In practice, this gap appears as static cognition, rigid workflow dependence, and inefficient context…

Artificial Intelligence · Computer Science 2026-03-11 Xiaoxing Wang , Ning Liao , Shikun Wei , Chen Tang , Feiyu Xiong

Recent advances in large language models (LLMs) have substantially accelerated the development of embodied agents. LLM-based multi-agent systems mitigate the inefficiency of single agents in complex tasks. However, they still suffer from…

Emerging Technologies · Computer Science 2026-02-02 XiaoJie Zhang , JianHan Wu , Xiaoyang Qu , Jianzong Wang

With the rapid development of mobile intelligent assistant technologies, multi-modal AI assistants have become essential interfaces for daily user interactions. However, current evaluation methods face challenges including high manual…

Artificial Intelligence · Computer Science 2025-10-22 Meiping Wang , Jian Zhong , Rongduo Han , Liming Kang , Zhengkun Shi , Xiao Liang , Xing Lin , Nan Gao , Haining Zhang

VLM-based mobile agents are increasingly popular due to their capabilities to interact with smartphone GUIs and XML-structured texts and to complete daily tasks. However, existing online benchmarks struggle with obtaining stable reward…

Computation and Language · Computer Science 2026-02-03 Weikai Xu , Zhizheng Jiang , Yuxuan Liu , Pengzhi Gao , Wei Liu , Jian Luan , Yuanchun Li , Yunxin Liu , Bin Wang , Bo An

The utilisation of foundation models as smartphone assistants, termed app agents, is a critical research challenge. These agents aim to execute human instructions on smartphones by interpreting textual instructions and performing actions…

Artificial Intelligence · Computer Science 2025-02-11 Georgios Papoudakis , Thomas Coste , Zhihao Wu , Jianye Hao , Jun Wang , Kun Shao

We propose GAM-Agent, a game-theoretic multi-agent framework for enhancing vision-language reasoning. Unlike prior single-agent or monolithic models, GAM-Agent formulates the reasoning process as a non-zero-sum game between base…

Artificial Intelligence · Computer Science 2025-05-30 Jusheng Zhang , Yijia Fan , Wenjun Lin , Ruiqi Chen , Haoyi Jiang , Wenhao Chai , Jian Wang , Keze Wang

Despite rapid development, large language models (LLMs) still encounter challenges in multi-turn decision-making tasks (i.e., agent tasks) like web shopping and browser navigation, which require making a sequence of intelligent decisions…

Computation and Language · Computer Science 2025-11-12 Zhiheng Xi , Chenyang Liao , Guanyu Li , Yajie Yang , Wenxiang Chen , Zhihao Zhang , Binghai Wang , Senjie Jin , Yuhao Zhou , Jian Guan , Wei Wu , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang

The advancement of Large Language Model (LLM)-powered agents has enabled automated task processing through reasoning and tool invocation capabilities. However, existing frameworks often operate under the idealized assumption that tool…

Artificial Intelligence · Computer Science 2026-03-06 Zhipeng Chen , Zhongrui Zhang , Chao Zhang , Yifan Xu , Lan Yang , Jun Liu , Ke Li , Yi-Zhe Song

Training AI models has always been challenging, especially when there is a need for custom models to provide personalized services. Algorithm engineers often face a lengthy process to iteratively develop models tailored to specific business…

Artificial Intelligence · Computer Science 2023-11-27 Haoyuan Li , Hao Jiang , Tianke Zhang , Zhelun Yu , Aoxiong Yin , Hao Cheng , Siming Fu , Yuhao Zhang , Wanggui He

Foundation models are becoming valuable tools in medicine. Yet despite their promise, the best way to leverage Large Language Models (LLMs) in complex medical tasks remains an open question. We introduce a novel multi-agent framework, named…

Computation and Language · Computer Science 2024-10-31 Yubin Kim , Chanwoo Park , Hyewon Jeong , Yik Siu Chan , Xuhai Xu , Daniel McDuff , Hyeonhoon Lee , Marzyeh Ghassemi , Cynthia Breazeal , Hae Won Park

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Earth observation (EO) is essential for understanding the evolving states of the Earth system. Although recent MLLMs have advanced EO research, they still lack the capability to tackle complex tasks that require multi-step reasoning and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Peilin Feng , Zhutao Lv , Junyan Ye , Xiaolei Wang , Xinjie Huo , Jinhua Yu , Wanghan Xu , Wenlong Zhang , Lei Bai , Conghui He , Weijia Li

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

This paper investigates the multi-agent cooperative exploration problem, which requires multiple agents to explore an unseen environment via sensory signals in a limited time. A popular approach to exploration tasks is to combine active…

Robotics · Computer Science 2023-11-02 Xinyi Yang , Yuxiang Yang , Chao Yu , Jiayu Chen , Jingchen Yu , Haibing Ren , Huazhong Yang , Yu Wang

Agentic workflows are composed of sequences of interdependent Large Language Model (LLM) calls, and they have become a dominant workload in modern AI systems. These workflows exhibit extensive redundancy from overlapping prompts and…

Multiagent Systems · Computer Science 2026-03-18 Noppanat Wadlom , Junyi Shen , Yao Lu

Intelligent agent systems in real-world agricultural scenarios must handle diverse tasks under multimodal inputs, ranging from lightweight information understanding to complex multi-step execution. However, most existing approaches rely on…

Computation and Language · Computer Science 2026-01-14 Bo Yang , Yu Zhang , Yunkui Chen , Lanfei Feng , Xiao Xu , Nueraili Aierken , Shijian Li